lightricks
/
ltx-video
LTX-Video is the first DiT-based video generation model capable of generating high-quality videos in real-time. It produces 24 FPS videos at a 768x512 resolution faster than they can be watched.
Prediction
lightricks/ltx-video:5ddec822499d46d11a93a92ef87e26adefda6608279d9d35c454e50e5e298d92ID2g50w9dzh9rj20ckf1rbdbqdfmStatusSucceededSourceWebHardwareA100 (80GB)Total durationCreatedby @fofrInput
- cfg
- 3
- steps
- 30
- length
- 97
- prompt
- A woman with long brown hair and light skin smiles at another woman with long blonde hair. The woman with brown hair wears a black jacket and has a small, barely noticeable mole on her right cheek. The camera angle is a close-up, focused on the woman with brown hair's face. The lighting is warm and natural, likely from the setting sun, casting a soft glow on the scene. The scene appears to be real-life footage.
- target_size
- 640
- aspect_ratio
- 16:9
- negative_prompt
- low quality, worst quality, deformed, distorted, watermark
{ "cfg": 3, "steps": 30, "length": 97, "prompt": "A woman with long brown hair and light skin smiles at another woman with long blonde hair. The woman with brown hair wears a black jacket and has a small, barely noticeable mole on her right cheek. The camera angle is a close-up, focused on the woman with brown hair's face. The lighting is warm and natural, likely from the setting sun, casting a soft glow on the scene. The scene appears to be real-life footage.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" }Install Replicateâs Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lightricks/ltx-video:5ddec822499d46d11a93a92ef87e26adefda6608279d9d35c454e50e5e298d92", { input: { cfg: 3, steps: 30, length: 97, prompt: "A woman with long brown hair and light skin smiles at another woman with long blonde hair. The woman with brown hair wears a black jacket and has a small, barely noticeable mole on her right cheek. The camera angle is a close-up, focused on the woman with brown hair's face. The lighting is warm and natural, likely from the setting sun, casting a soft glow on the scene. The scene appears to be real-life footage.", target_size: 640, aspect_ratio: "16:9", negative_prompt: "low quality, worst quality, deformed, distorted, watermark" } } ); // To access the file URL: console.log(output[0].url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output[0]);To learn more, take a look at the guide on getting started with Node.js.
Install Replicateâs Python client library:pip install replicateImport the client:import replicateRun lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lightricks/ltx-video:5ddec822499d46d11a93a92ef87e26adefda6608279d9d35c454e50e5e298d92", input={ "cfg": 3, "steps": 30, "length": 97, "prompt": "A woman with long brown hair and light skin smiles at another woman with long blonde hair. The woman with brown hair wears a black jacket and has a small, barely noticeable mole on her right cheek. The camera angle is a close-up, focused on the woman with brown hair's face. The lighting is warm and natural, likely from the setting sun, casting a soft glow on the scene. The scene appears to be real-life footage.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "5ddec822499d46d11a93a92ef87e26adefda6608279d9d35c454e50e5e298d92", "input": { "cfg": 3, "steps": 30, "length": 97, "prompt": "A woman with long brown hair and light skin smiles at another woman with long blonde hair. The woman with brown hair wears a black jacket and has a small, barely noticeable mole on her right cheek. The camera angle is a close-up, focused on the woman with brown hair\'s face. The lighting is warm and natural, likely from the setting sun, casting a soft glow on the scene. The scene appears to be real-life footage.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicateâs HTTP API reference docs.
Output
{ "completed_at": "2024-11-29T15:01:27.086103Z", "created_at": "2024-11-29T15:01:15.274000Z", "data_removed": false, "error": null, "id": "2g50w9dzh9rj20ckf1rbdbqdfm", "input": { "cfg": 3, "steps": 30, "length": 97, "prompt": "A woman with long brown hair and light skin smiles at another woman with long blonde hair. The woman with brown hair wears a black jacket and has a small, barely noticeable mole on her right cheek. The camera angle is a close-up, focused on the woman with brown hair's face. The lighting is warm and natural, likely from the setting sun, casting a soft glow on the scene. The scene appears to be real-life footage.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" }, "logs": "Random seed set to: 2624027272\nChecking inputs\n====================================\nRunning workflow\n[ComfyUI] got prompt\nExecuting node 85, title: Width and height from aspect ratio ðŠī, class type: Width and height from aspect ratio ðŠī\nExecuting node 84, title: EmptyLTXVLatentVideo, class type: EmptyLTXVLatentVideo\nExecuting node 71, title: LTXVScheduler, class type: LTXVScheduler\nExecuting node 72, title: SamplerCustom, class type: SamplerCustom\n[ComfyUI]\n[ComfyUI] 0%| | 0/30 [00:00<?, ?it/s]\n[ComfyUI] 3%|â | 1/30 [00:00<00:04, 6.37it/s]\n[ComfyUI] 7%|â | 2/30 [00:00<00:07, 3.95it/s]\n[ComfyUI] 10%|â | 3/30 [00:00<00:07, 3.52it/s]\n[ComfyUI] 13%|ââ | 4/30 [00:01<00:07, 3.34it/s]\n[ComfyUI] 17%|ââ | 5/30 [00:01<00:07, 3.25it/s]\n[ComfyUI] 20%|ââ | 6/30 [00:01<00:07, 3.19it/s]\n[ComfyUI] 23%|âââ | 7/30 [00:02<00:07, 3.16it/s]\n[ComfyUI] 27%|âââ | 8/30 [00:02<00:07, 3.14it/s]\n[ComfyUI] 30%|âââ | 9/30 [00:02<00:06, 3.12it/s]\n[ComfyUI] 33%|ââââ | 10/30 [00:03<00:06, 3.12it/s]\n[ComfyUI] 37%|ââââ | 11/30 [00:03<00:06, 3.11it/s]\n[ComfyUI] 40%|ââââ | 12/30 [00:03<00:05, 3.10it/s]\n[ComfyUI] 43%|âââââ | 13/30 [00:04<00:05, 3.10it/s]\n[ComfyUI] 47%|âââââ | 14/30 [00:04<00:05, 3.10it/s]\n[ComfyUI] 50%|âââââ | 15/30 [00:04<00:04, 3.10it/s]\n[ComfyUI] 53%|ââââââ | 16/30 [00:05<00:04, 3.10it/s]\n[ComfyUI] 57%|ââââââ | 17/30 [00:05<00:04, 3.09it/s]\n[ComfyUI] 60%|ââââââ | 18/30 [00:05<00:03, 3.09it/s]\n[ComfyUI] 63%|âââââââ | 19/30 [00:05<00:03, 3.09it/s]\n[ComfyUI] 67%|âââââââ | 20/30 [00:06<00:03, 3.09it/s]\n[ComfyUI] 70%|âââââââ | 21/30 [00:06<00:02, 3.09it/s]\n[ComfyUI] 73%|ââââââââ | 22/30 [00:06<00:02, 3.09it/s]\n[ComfyUI] 77%|ââââââââ | 23/30 [00:07<00:02, 3.09it/s]\n[ComfyUI] 80%|ââââââââ | 24/30 [00:07<00:01, 3.09it/s]\n[ComfyUI] 83%|âââââââââ | 25/30 [00:07<00:01, 3.09it/s]\n[ComfyUI] 87%|âââââââââ | 26/30 [00:08<00:01, 3.09it/s]\n[ComfyUI] 90%|âââââââââ | 27/30 [00:08<00:00, 3.09it/s]\n[ComfyUI] 93%|ââââââââââ| 28/30 [00:08<00:00, 3.09it/s]\n[ComfyUI] 97%|ââââââââââ| 29/30 [00:09<00:00, 3.09it/s]\n[ComfyUI] 100%|ââââââââââ| 30/30 [00:09<00:00, 3.09it/s]\nExecuting node 8, title: VAE Decode, class type: VAEDecode\nExecuting node 79, title: Video Combine ðĨð Ĩð ð Ē, class type: VHS_VideoCombine\n[ComfyUI] 100%|ââââââââââ| 30/30 [00:09<00:00, 3.15it/s]\n[ComfyUI] Prompt executed in 11.64 seconds\noutputs: {'79': {'gifs': [{'filename': 'R8_LTX_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 25.0}]}}\n====================================\nR8_LTX_00001.png\nR8_LTX_00001.mp4", "metrics": { "predict_time": 11.803572214999999, "total_time": 11.812103 }, "output": [ "https://replicate.delivery/yhqm/WjvukHay2258P9UFGYkGiMKr7exu9eeSs27782SR7fBcUiXPB/R8_LTX_00001.mp4" ], "started_at": "2024-11-29T15:01:15.282530Z", "status": "succeeded", "urls": { "stream": "https://stream.replicate.com/v1/files/qoxq-xwt7eftpueuzod263mpuyywetfgjvpuodiv2xac2oc6wn6blbqyq", "get": "https://api.replicate.com/v1/predictions/2g50w9dzh9rj20ckf1rbdbqdfm", "cancel": "https://api.replicate.com/v1/predictions/2g50w9dzh9rj20ckf1rbdbqdfm/cancel" }, "version": "5ddec822499d46d11a93a92ef87e26adefda6608279d9d35c454e50e5e298d92" }Generated inRandom seed set to: 2624027272 Checking inputs ==================================== Running workflow [ComfyUI] got prompt Executing node 85, title: Width and height from aspect ratio ðŠī, class type: Width and height from aspect ratio ðŠī Executing node 84, title: EmptyLTXVLatentVideo, class type: EmptyLTXVLatentVideo Executing node 71, title: LTXVScheduler, class type: LTXVScheduler Executing node 72, title: SamplerCustom, class type: SamplerCustom [ComfyUI] [ComfyUI] 0%| | 0/30 [00:00<?, ?it/s] [ComfyUI] 3%|â | 1/30 [00:00<00:04, 6.37it/s] [ComfyUI] 7%|â | 2/30 [00:00<00:07, 3.95it/s] [ComfyUI] 10%|â | 3/30 [00:00<00:07, 3.52it/s] [ComfyUI] 13%|ââ | 4/30 [00:01<00:07, 3.34it/s] [ComfyUI] 17%|ââ | 5/30 [00:01<00:07, 3.25it/s] [ComfyUI] 20%|ââ | 6/30 [00:01<00:07, 3.19it/s] [ComfyUI] 23%|âââ | 7/30 [00:02<00:07, 3.16it/s] [ComfyUI] 27%|âââ | 8/30 [00:02<00:07, 3.14it/s] [ComfyUI] 30%|âââ | 9/30 [00:02<00:06, 3.12it/s] [ComfyUI] 33%|ââââ | 10/30 [00:03<00:06, 3.12it/s] [ComfyUI] 37%|ââââ | 11/30 [00:03<00:06, 3.11it/s] [ComfyUI] 40%|ââââ | 12/30 [00:03<00:05, 3.10it/s] [ComfyUI] 43%|âââââ | 13/30 [00:04<00:05, 3.10it/s] [ComfyUI] 47%|âââââ | 14/30 [00:04<00:05, 3.10it/s] [ComfyUI] 50%|âââââ | 15/30 [00:04<00:04, 3.10it/s] [ComfyUI] 53%|ââââââ | 16/30 [00:05<00:04, 3.10it/s] [ComfyUI] 57%|ââââââ | 17/30 [00:05<00:04, 3.09it/s] [ComfyUI] 60%|ââââââ | 18/30 [00:05<00:03, 3.09it/s] [ComfyUI] 63%|âââââââ | 19/30 [00:05<00:03, 3.09it/s] [ComfyUI] 67%|âââââââ | 20/30 [00:06<00:03, 3.09it/s] [ComfyUI] 70%|âââââââ | 21/30 [00:06<00:02, 3.09it/s] [ComfyUI] 73%|ââââââââ | 22/30 [00:06<00:02, 3.09it/s] [ComfyUI] 77%|ââââââââ | 23/30 [00:07<00:02, 3.09it/s] [ComfyUI] 80%|ââââââââ | 24/30 [00:07<00:01, 3.09it/s] [ComfyUI] 83%|âââââââââ | 25/30 [00:07<00:01, 3.09it/s] [ComfyUI] 87%|âââââââââ | 26/30 [00:08<00:01, 3.09it/s] [ComfyUI] 90%|âââââââââ | 27/30 [00:08<00:00, 3.09it/s] [ComfyUI] 93%|ââââââââââ| 28/30 [00:08<00:00, 3.09it/s] [ComfyUI] 97%|ââââââââââ| 29/30 [00:09<00:00, 3.09it/s] [ComfyUI] 100%|ââââââââââ| 30/30 [00:09<00:00, 3.09it/s] Executing node 8, title: VAE Decode, class type: VAEDecode Executing node 79, title: Video Combine ðĨð Ĩð ð Ē, class type: VHS_VideoCombine [ComfyUI] 100%|ââââââââââ| 30/30 [00:09<00:00, 3.15it/s] [ComfyUI] Prompt executed in 11.64 seconds outputs: {'79': {'gifs': [{'filename': 'R8_LTX_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 25.0}]}} ==================================== R8_LTX_00001.png R8_LTX_00001.mp4Prediction
lightricks/ltx-video:983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46aIDmvk6sppn6xrma0ckf29at4ffm4StatusSucceededSourceWebHardwareL40STotal durationCreatedInput
- cfg
- 3
- steps
- 30
- length
- 97
- prompt
- A chef prepares food in a professional kitchen. He has olive skin and dark, close-cropped hair, wearing traditional white chef's attire. Steam rises from the pan he's working with. The kitchen's stainless steel surfaces reflect the bright overhead lighting. The camera follows his hands as he cooks. The scene appears to be real-life footage.
- target_size
- 640
- aspect_ratio
- 16:9
- negative_prompt
- low quality, worst quality, deformed, distorted, watermark
{ "cfg": 3, "steps": 30, "length": 97, "prompt": "A chef prepares food in a professional kitchen. He has olive skin and dark, close-cropped hair, wearing traditional white chef's attire. Steam rises from the pan he's working with. The kitchen's stainless steel surfaces reflect the bright overhead lighting. The camera follows his hands as he cooks. The scene appears to be real-life footage.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" }Install Replicateâs Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lightricks/ltx-video:983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46a", { input: { cfg: 3, steps: 30, length: 97, prompt: "A chef prepares food in a professional kitchen. He has olive skin and dark, close-cropped hair, wearing traditional white chef's attire. Steam rises from the pan he's working with. The kitchen's stainless steel surfaces reflect the bright overhead lighting. The camera follows his hands as he cooks. The scene appears to be real-life footage.", target_size: 640, aspect_ratio: "16:9", negative_prompt: "low quality, worst quality, deformed, distorted, watermark" } } ); // To access the file URL: console.log(output[0].url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output[0]);To learn more, take a look at the guide on getting started with Node.js.
Install Replicateâs Python client library:pip install replicateImport the client:import replicateRun lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lightricks/ltx-video:983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46a", input={ "cfg": 3, "steps": 30, "length": 97, "prompt": "A chef prepares food in a professional kitchen. He has olive skin and dark, close-cropped hair, wearing traditional white chef's attire. Steam rises from the pan he's working with. The kitchen's stainless steel surfaces reflect the bright overhead lighting. The camera follows his hands as he cooks. The scene appears to be real-life footage.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46a", "input": { "cfg": 3, "steps": 30, "length": 97, "prompt": "A chef prepares food in a professional kitchen. He has olive skin and dark, close-cropped hair, wearing traditional white chef\'s attire. Steam rises from the pan he\'s working with. The kitchen\'s stainless steel surfaces reflect the bright overhead lighting. The camera follows his hands as he cooks. The scene appears to be real-life footage.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicateâs HTTP API reference docs.
Output
{ "completed_at": "2024-11-29T15:39:54.145021Z", "created_at": "2024-11-29T15:38:29.047000Z", "data_removed": false, "error": null, "id": "mvk6sppn6xrma0ckf29at4ffm4", "input": { "cfg": 3, "steps": 30, "length": 97, "prompt": "A chef prepares food in a professional kitchen. He has olive skin and dark, close-cropped hair, wearing traditional white chef's attire. Steam rises from the pan he's working with. The kitchen's stainless steel surfaces reflect the bright overhead lighting. The camera follows his hands as he cooks. The scene appears to be real-life footage.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" }, "logs": "Random seed set to: 3796486662\nChecking inputs\n====================================\nRunning workflow\n[ComfyUI] got prompt\nExecuting node 44, title: Load Checkpoint, class type: CheckpointLoaderSimple\n[ComfyUI] model weight dtype torch.bfloat16, manual cast: None\n[ComfyUI] model_type FLUX\n[ComfyUI] no CLIP/text encoder weights in checkpoint, the text encoder model will not be loaded.\nExecuting node 85, title: Width and height from aspect ratio ðŠī, class type: Width and height from aspect ratio ðŠī\nExecuting node 84, title: EmptyLTXVLatentVideo, class type: EmptyLTXVLatentVideo\nExecuting node 71, title: LTXVScheduler, class type: LTXVScheduler\nExecuting node 73, title: KSamplerSelect, class type: KSamplerSelect\nExecuting node 38, title: Load CLIP, class type: CLIPLoader\nExecuting node 7, title: CLIP Text Encode (Negative Prompt), class type: CLIPTextEncode\n[ComfyUI] Requested to load MochiTEModel_\n[ComfyUI] Loading 1 new model\n[ComfyUI] loaded completely 0.0 9083.38671875 True\nExecuting node 6, title: CLIP Text Encode (Positive Prompt), class type: CLIPTextEncode\nExecuting node 69, title: LTXVConditioning, class type: LTXVConditioning\nExecuting node 72, title: SamplerCustom, class type: SamplerCustom\n[ComfyUI] Requested to load LTXV\n[ComfyUI] Loading 1 new model\n[ComfyUI] loaded completely 0.0 3667.902587890625 True\n[ComfyUI]\n[ComfyUI] 0%| | 0/30 [00:00<?, ?it/s]/root/.pyenv/versions/3.10.15/lib/python3.10/site-packages/torch/functional.py:534: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3595.)\n[ComfyUI] return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]\n[ComfyUI]\n[ComfyUI] 3%|â | 1/30 [00:00<00:11, 2.47it/s]\n[ComfyUI] 7%|â | 2/30 [00:00<00:07, 3.82it/s]\n[ComfyUI] 10%|â | 3/30 [00:00<00:07, 3.41it/s]\n[ComfyUI] 13%|ââ | 4/30 [00:01<00:08, 3.25it/s]\n[ComfyUI] 17%|ââ | 5/30 [00:01<00:07, 3.16it/s]\n[ComfyUI] 20%|ââ | 6/30 [00:01<00:07, 3.11it/s]\n[ComfyUI] 23%|âââ | 7/30 [00:02<00:07, 3.08it/s]\n[ComfyUI] 27%|âââ | 8/30 [00:02<00:07, 3.06it/s]\n[ComfyUI] 30%|âââ | 9/30 [00:02<00:06, 3.05it/s]\n[ComfyUI] 33%|ââââ | 10/30 [00:03<00:06, 3.04it/s]\n[ComfyUI] 37%|ââââ | 11/30 [00:03<00:06, 3.03it/s]\n[ComfyUI] 40%|ââââ | 12/30 [00:03<00:05, 3.02it/s]\n[ComfyUI] 43%|âââââ | 13/30 [00:04<00:05, 3.02it/s]\n[ComfyUI] 47%|âââââ | 14/30 [00:04<00:05, 3.01it/s]\n[ComfyUI] 50%|âââââ | 15/30 [00:04<00:04, 3.01it/s]\n[ComfyUI] 53%|ââââââ | 16/30 [00:05<00:04, 3.01it/s]\n[ComfyUI] 57%|ââââââ | 17/30 [00:05<00:04, 3.01it/s]\n[ComfyUI] 60%|ââââââ | 18/30 [00:05<00:03, 3.01it/s]\n[ComfyUI] 63%|âââââââ | 19/30 [00:06<00:03, 3.00it/s]\n[ComfyUI] 67%|âââââââ | 20/30 [00:06<00:03, 3.00it/s]\n[ComfyUI] 70%|âââââââ | 21/30 [00:06<00:02, 3.00it/s]\n[ComfyUI] 73%|ââââââââ | 22/30 [00:07<00:02, 3.00it/s]\n[ComfyUI] 77%|ââââââââ | 23/30 [00:07<00:02, 3.00it/s]\n[ComfyUI] 80%|ââââââââ | 24/30 [00:07<00:01, 3.00it/s]\n[ComfyUI] 83%|âââââââââ | 25/30 [00:08<00:01, 3.00it/s]\n[ComfyUI] 87%|âââââââââ | 26/30 [00:08<00:01, 3.00it/s]\n[ComfyUI] 90%|âââââââââ | 27/30 [00:08<00:01, 3.00it/s]\n[ComfyUI] 93%|ââââââââââ| 28/30 [00:09<00:00, 3.00it/s]\n[ComfyUI] 97%|ââââââââââ| 29/30 [00:09<00:00, 3.00it/s]\n[ComfyUI] 100%|ââââââââââ| 30/30 [00:09<00:00, 3.00it/s]\n[ComfyUI] 100%|ââââââââââ| 30/30 [00:09<00:00, 3.04it/s]\n[ComfyUI] Requested to load VideoVAE\n[ComfyUI] Loading 1 new model\nExecuting node 8, title: VAE Decode, class type: VAEDecode\n[ComfyUI] loaded completely 0.0 799.548433303833 True\nExecuting node 79, title: Video Combine ðĨð Ĩð ð Ē, class type: VHS_VideoCombine\n[ComfyUI] Prompt executed in 15.28 seconds\noutputs: {'79': {'gifs': [{'filename': 'R8_LTX_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 25.0}]}}\n====================================\nR8_LTX_00001.png\nR8_LTX_00001.mp4", "metrics": { "predict_time": 15.426180813, "total_time": 85.098021 }, "output": [ "https://replicate.delivery/xezq/CC1fXTLZVOxNS66XRUJLBLuAOTP6kGaXhpttZjvBijDlk86JA/R8_LTX_00001.mp4" ], "started_at": "2024-11-29T15:39:38.718840Z", "status": "succeeded", "urls": { "stream": "https://stream.replicate.com/v1/files/bcwr-tnbavyammb5mkr5wxlbpmzg6ma3yakintpv4npsss3tl7gj2rh4q", "get": "https://api.replicate.com/v1/predictions/mvk6sppn6xrma0ckf29at4ffm4", "cancel": "https://api.replicate.com/v1/predictions/mvk6sppn6xrma0ckf29at4ffm4/cancel" }, "version": "983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46a" }Generated inRandom seed set to: 3796486662 Checking inputs ==================================== Running workflow [ComfyUI] got prompt Executing node 44, title: Load Checkpoint, class type: CheckpointLoaderSimple [ComfyUI] model weight dtype torch.bfloat16, manual cast: None [ComfyUI] model_type FLUX [ComfyUI] no CLIP/text encoder weights in checkpoint, the text encoder model will not be loaded. Executing node 85, title: Width and height from aspect ratio ðŠī, class type: Width and height from aspect ratio ðŠī Executing node 84, title: EmptyLTXVLatentVideo, class type: EmptyLTXVLatentVideo Executing node 71, title: LTXVScheduler, class type: LTXVScheduler Executing node 73, title: KSamplerSelect, class type: KSamplerSelect Executing node 38, title: Load CLIP, class type: CLIPLoader Executing node 7, title: CLIP Text Encode (Negative Prompt), class type: CLIPTextEncode [ComfyUI] Requested to load MochiTEModel_ [ComfyUI] Loading 1 new model [ComfyUI] loaded completely 0.0 9083.38671875 True Executing node 6, title: CLIP Text Encode (Positive Prompt), class type: CLIPTextEncode Executing node 69, title: LTXVConditioning, class type: LTXVConditioning Executing node 72, title: SamplerCustom, class type: SamplerCustom [ComfyUI] Requested to load LTXV [ComfyUI] Loading 1 new model [ComfyUI] loaded completely 0.0 3667.902587890625 True [ComfyUI] [ComfyUI] 0%| | 0/30 [00:00<?, ?it/s]/root/.pyenv/versions/3.10.15/lib/python3.10/site-packages/torch/functional.py:534: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3595.) [ComfyUI] return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] [ComfyUI] [ComfyUI] 3%|â | 1/30 [00:00<00:11, 2.47it/s] [ComfyUI] 7%|â | 2/30 [00:00<00:07, 3.82it/s] [ComfyUI] 10%|â | 3/30 [00:00<00:07, 3.41it/s] [ComfyUI] 13%|ââ | 4/30 [00:01<00:08, 3.25it/s] [ComfyUI] 17%|ââ | 5/30 [00:01<00:07, 3.16it/s] [ComfyUI] 20%|ââ | 6/30 [00:01<00:07, 3.11it/s] [ComfyUI] 23%|âââ | 7/30 [00:02<00:07, 3.08it/s] [ComfyUI] 27%|âââ | 8/30 [00:02<00:07, 3.06it/s] [ComfyUI] 30%|âââ | 9/30 [00:02<00:06, 3.05it/s] [ComfyUI] 33%|ââââ | 10/30 [00:03<00:06, 3.04it/s] [ComfyUI] 37%|ââââ | 11/30 [00:03<00:06, 3.03it/s] [ComfyUI] 40%|ââââ | 12/30 [00:03<00:05, 3.02it/s] [ComfyUI] 43%|âââââ | 13/30 [00:04<00:05, 3.02it/s] [ComfyUI] 47%|âââââ | 14/30 [00:04<00:05, 3.01it/s] [ComfyUI] 50%|âââââ | 15/30 [00:04<00:04, 3.01it/s] [ComfyUI] 53%|ââââââ | 16/30 [00:05<00:04, 3.01it/s] [ComfyUI] 57%|ââââââ | 17/30 [00:05<00:04, 3.01it/s] [ComfyUI] 60%|ââââââ | 18/30 [00:05<00:03, 3.01it/s] [ComfyUI] 63%|âââââââ | 19/30 [00:06<00:03, 3.00it/s] [ComfyUI] 67%|âââââââ | 20/30 [00:06<00:03, 3.00it/s] [ComfyUI] 70%|âââââââ | 21/30 [00:06<00:02, 3.00it/s] [ComfyUI] 73%|ââââââââ | 22/30 [00:07<00:02, 3.00it/s] [ComfyUI] 77%|ââââââââ | 23/30 [00:07<00:02, 3.00it/s] [ComfyUI] 80%|ââââââââ | 24/30 [00:07<00:01, 3.00it/s] [ComfyUI] 83%|âââââââââ | 25/30 [00:08<00:01, 3.00it/s] [ComfyUI] 87%|âââââââââ | 26/30 [00:08<00:01, 3.00it/s] [ComfyUI] 90%|âââââââââ | 27/30 [00:08<00:01, 3.00it/s] [ComfyUI] 93%|ââââââââââ| 28/30 [00:09<00:00, 3.00it/s] [ComfyUI] 97%|ââââââââââ| 29/30 [00:09<00:00, 3.00it/s] [ComfyUI] 100%|ââââââââââ| 30/30 [00:09<00:00, 3.00it/s] [ComfyUI] 100%|ââââââââââ| 30/30 [00:09<00:00, 3.04it/s] [ComfyUI] Requested to load VideoVAE [ComfyUI] Loading 1 new model Executing node 8, title: VAE Decode, class type: VAEDecode [ComfyUI] loaded completely 0.0 799.548433303833 True Executing node 79, title: Video Combine ðĨð Ĩð ð Ē, class type: VHS_VideoCombine [ComfyUI] Prompt executed in 15.28 seconds outputs: {'79': {'gifs': [{'filename': 'R8_LTX_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 25.0}]}} ==================================== R8_LTX_00001.png R8_LTX_00001.mp4Prediction
lightricks/ltx-video:983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46aIDkcannxpqvsrmc0ckf2atyn5mm0StatusSucceededSourceWebHardwareL40STotal durationCreatedInput
- cfg
- 3
- image
- steps
- 30
- length
- 97
- prompt
- A man in a blue plaid shirt turns his head to look at a woman walking past in a red top. His expression is curious as he glances away from his companion in a light blue sleeveless top. The scene takes place on a busy city street with buildings and pedestrians visible in the background. The natural lighting suggests it's daytime. The camera captures the scene from street level, with the woman in red slightly out of focus in the foreground.
- target_size
- 640
- aspect_ratio
- 16:9
- negative_prompt
- low quality, worst quality, deformed, distorted, watermark
{ "cfg": 3, "image": "https://replicate.delivery/pbxt/M3d07ok8ehsSwLhd1W8RvdTMRF5zDG96rtbQNYQ3N1h49oYU/https___replicate.delivery_xezq_QNXKO4ieQyV4CCfVilCqDemtBEO154LcY8mbiRDdBxfGa2MPB_out-0.jpg", "steps": 30, "length": 97, "prompt": "A man in a blue plaid shirt turns his head to look at a woman walking past in a red top. His expression is curious as he glances away from his companion in a light blue sleeveless top. The scene takes place on a busy city street with buildings and pedestrians visible in the background. The natural lighting suggests it's daytime. The camera captures the scene from street level, with the woman in red slightly out of focus in the foreground.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" }Install Replicateâs Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lightricks/ltx-video:983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46a", { input: { cfg: 3, image: "https://replicate.delivery/pbxt/M3d07ok8ehsSwLhd1W8RvdTMRF5zDG96rtbQNYQ3N1h49oYU/https___replicate.delivery_xezq_QNXKO4ieQyV4CCfVilCqDemtBEO154LcY8mbiRDdBxfGa2MPB_out-0.jpg", steps: 30, length: 97, prompt: "A man in a blue plaid shirt turns his head to look at a woman walking past in a red top. His expression is curious as he glances away from his companion in a light blue sleeveless top. The scene takes place on a busy city street with buildings and pedestrians visible in the background. The natural lighting suggests it's daytime. The camera captures the scene from street level, with the woman in red slightly out of focus in the foreground.", target_size: 640, aspect_ratio: "16:9", negative_prompt: "low quality, worst quality, deformed, distorted, watermark" } } ); // To access the file URL: console.log(output[0].url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output[0]);To learn more, take a look at the guide on getting started with Node.js.
Install Replicateâs Python client library:pip install replicateImport the client:import replicateRun lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lightricks/ltx-video:983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46a", input={ "cfg": 3, "image": "https://replicate.delivery/pbxt/M3d07ok8ehsSwLhd1W8RvdTMRF5zDG96rtbQNYQ3N1h49oYU/https___replicate.delivery_xezq_QNXKO4ieQyV4CCfVilCqDemtBEO154LcY8mbiRDdBxfGa2MPB_out-0.jpg", "steps": 30, "length": 97, "prompt": "A man in a blue plaid shirt turns his head to look at a woman walking past in a red top. His expression is curious as he glances away from his companion in a light blue sleeveless top. The scene takes place on a busy city street with buildings and pedestrians visible in the background. The natural lighting suggests it's daytime. The camera captures the scene from street level, with the woman in red slightly out of focus in the foreground.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lightricks/ltx-video using Replicateâs API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46a", "input": { "cfg": 3, "image": "https://replicate.delivery/pbxt/M3d07ok8ehsSwLhd1W8RvdTMRF5zDG96rtbQNYQ3N1h49oYU/https___replicate.delivery_xezq_QNXKO4ieQyV4CCfVilCqDemtBEO154LcY8mbiRDdBxfGa2MPB_out-0.jpg", "steps": 30, "length": 97, "prompt": "A man in a blue plaid shirt turns his head to look at a woman walking past in a red top. His expression is curious as he glances away from his companion in a light blue sleeveless top. The scene takes place on a busy city street with buildings and pedestrians visible in the background. The natural lighting suggests it\'s daytime. The camera captures the scene from street level, with the woman in red slightly out of focus in the foreground.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicateâs HTTP API reference docs.
Output
{ "completed_at": "2024-11-29T15:41:59.479476Z", "created_at": "2024-11-29T15:41:46.334000Z", "data_removed": false, "error": null, "id": "kcannxpqvsrmc0ckf2atyn5mm0", "input": { "cfg": 3, "image": "https://replicate.delivery/pbxt/M3d07ok8ehsSwLhd1W8RvdTMRF5zDG96rtbQNYQ3N1h49oYU/https___replicate.delivery_xezq_QNXKO4ieQyV4CCfVilCqDemtBEO154LcY8mbiRDdBxfGa2MPB_out-0.jpg", "steps": 30, "length": 97, "prompt": "A man in a blue plaid shirt turns his head to look at a woman walking past in a red top. His expression is curious as he glances away from his companion in a light blue sleeveless top. The scene takes place on a busy city street with buildings and pedestrians visible in the background. The natural lighting suggests it's daytime. The camera captures the scene from street level, with the woman in red slightly out of focus in the foreground.", "target_size": 640, "aspect_ratio": "16:9", "negative_prompt": "low quality, worst quality, deformed, distorted, watermark" }, "logs": "Random seed set to: 3897362780\nChecking inputs\nâ /tmp/inputs/image.jpg\n====================================\nRunning workflow\n[ComfyUI] got prompt\nExecuting node 78, title: Load Image, class type: LoadImage\nExecuting node 81, title: Width and height for scaling image to ideal resolution ðŠī, class type: Width and height for scaling image to ideal resolution ðŠī\nExecuting node 82, title: ð§ Image Resize, class type: ImageResize+\nExecuting node 6, title: CLIP Text Encode (Positive Prompt), class type: CLIPTextEncode\nExecuting node 77, title: LTXVImgToVideo, class type: LTXVImgToVideo\nExecuting node 71, title: LTXVScheduler, class type: LTXVScheduler\nExecuting node 69, title: LTXVConditioning, class type: LTXVConditioning\nExecuting node 72, title: SamplerCustom, class type: SamplerCustom\n[ComfyUI]\n[ComfyUI] 0%| | 0/30 [00:00<?, ?it/s]\n[ComfyUI] 3%|â | 1/30 [00:00<00:05, 5.48it/s]\n[ComfyUI] 7%|â | 2/30 [00:00<00:08, 3.42it/s]\n[ComfyUI] 10%|â | 3/30 [00:00<00:08, 3.05it/s]\n[ComfyUI] 13%|ââ | 4/30 [00:01<00:08, 2.90it/s]\n[ComfyUI] 17%|ââ | 5/30 [00:01<00:08, 2.82it/s]\n[ComfyUI] 20%|ââ | 6/30 [00:02<00:08, 2.78it/s]\n[ComfyUI] 23%|âââ | 7/30 [00:02<00:08, 2.75it/s]\n[ComfyUI] 27%|âââ | 8/30 [00:02<00:08, 2.73it/s]\n[ComfyUI] 30%|âââ | 9/30 [00:03<00:07, 2.72it/s]\n[ComfyUI] 33%|ââââ | 10/30 [00:03<00:07, 2.71it/s]\n[ComfyUI] 37%|ââââ | 11/30 [00:03<00:07, 2.71it/s]\n[ComfyUI] 40%|ââââ | 12/30 [00:04<00:06, 2.70it/s]\n[ComfyUI] 43%|âââââ | 13/30 [00:04<00:06, 2.70it/s]\n[ComfyUI] 47%|âââââ | 14/30 [00:05<00:05, 2.70it/s]\n[ComfyUI] 50%|âââââ | 15/30 [00:05<00:05, 2.70it/s]\n[ComfyUI] 53%|ââââââ | 16/30 [00:05<00:05, 2.69it/s]\n[ComfyUI] 57%|ââââââ | 17/30 [00:06<00:04, 2.69it/s]\n[ComfyUI] 60%|ââââââ | 18/30 [00:06<00:04, 2.69it/s]\n[ComfyUI] 63%|âââââââ | 19/30 [00:06<00:04, 2.69it/s]\n[ComfyUI] 67%|âââââââ | 20/30 [00:07<00:03, 2.69it/s]\n[ComfyUI] 70%|âââââââ | 21/30 [00:07<00:03, 2.69it/s]\n[ComfyUI] 73%|ââââââââ | 22/30 [00:07<00:02, 2.69it/s]\n[ComfyUI] 77%|ââââââââ | 23/30 [00:08<00:02, 2.69it/s]\n[ComfyUI] 80%|ââââââââ | 24/30 [00:08<00:02, 2.69it/s]\n[ComfyUI] 83%|âââââââââ | 25/30 [00:09<00:01, 2.69it/s]\n[ComfyUI] 87%|âââââââââ | 26/30 [00:09<00:01, 2.69it/s]\n[ComfyUI] 90%|âââââââââ | 27/30 [00:09<00:01, 2.69it/s]\n[ComfyUI] 93%|ââââââââââ| 28/30 [00:10<00:00, 2.69it/s]\n[ComfyUI] 97%|ââââââââââ| 29/30 [00:10<00:00, 2.69it/s]\n[ComfyUI] 100%|ââââââââââ| 30/30 [00:10<00:00, 2.69it/s]\nExecuting node 8, title: VAE Decode, class type: VAEDecode\nExecuting node 79, title: Video Combine ðĨð Ĩð ð Ē, class type: VHS_VideoCombine\n[ComfyUI] 100%|ââââââââââ| 30/30 [00:10<00:00, 2.74it/s]\n[ComfyUI] Prompt executed in 12.89 seconds\noutputs: {'79': {'gifs': [{'filename': 'R8_LTX_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 25.0}]}}\n====================================\nR8_LTX_00001.png\nR8_LTX_00001.mp4", "metrics": { "predict_time": 13.137691607, "total_time": 13.145476 }, "output": [ "https://replicate.delivery/xezq/SXvSABtunX4ZJ5MsYfnuBlZ5Ipn8DaUbeKEoR9iwAsdHL51TA/R8_LTX_00001.mp4" ], "started_at": "2024-11-29T15:41:46.341784Z", "status": "succeeded", "urls": { "stream": "https://stream.replicate.com/v1/files/bcwr-ehtwy3pq5ep5moifdzvau3ndc4uxwcldpxoyeae6nuoupa2r3gtq", "get": "https://api.replicate.com/v1/predictions/kcannxpqvsrmc0ckf2atyn5mm0", "cancel": "https://api.replicate.com/v1/predictions/kcannxpqvsrmc0ckf2atyn5mm0/cancel" }, "version": "983ec70a06fd872ef4c29bb6b728556fc2454125a5b2c68ab51eb8a2a9eaa46a" }Generated inRandom seed set to: 3897362780 Checking inputs â /tmp/inputs/image.jpg ==================================== Running workflow [ComfyUI] got prompt Executing node 78, title: Load Image, class type: LoadImage Executing node 81, title: Width and height for scaling image to ideal resolution ðŠī, class type: Width and height for scaling image to ideal resolution ðŠī Executing node 82, title: ð§ Image Resize, class type: ImageResize+ Executing node 6, title: CLIP Text Encode (Positive Prompt), class type: CLIPTextEncode Executing node 77, title: LTXVImgToVideo, class type: LTXVImgToVideo Executing node 71, title: LTXVScheduler, class type: LTXVScheduler Executing node 69, title: LTXVConditioning, class type: LTXVConditioning Executing node 72, title: SamplerCustom, class type: SamplerCustom [ComfyUI] [ComfyUI] 0%| | 0/30 [00:00<?, ?it/s] [ComfyUI] 3%|â | 1/30 [00:00<00:05, 5.48it/s] [ComfyUI] 7%|â | 2/30 [00:00<00:08, 3.42it/s] [ComfyUI] 10%|â | 3/30 [00:00<00:08, 3.05it/s] [ComfyUI] 13%|ââ | 4/30 [00:01<00:08, 2.90it/s] [ComfyUI] 17%|ââ | 5/30 [00:01<00:08, 2.82it/s] [ComfyUI] 20%|ââ | 6/30 [00:02<00:08, 2.78it/s] [ComfyUI] 23%|âââ | 7/30 [00:02<00:08, 2.75it/s] [ComfyUI] 27%|âââ | 8/30 [00:02<00:08, 2.73it/s] [ComfyUI] 30%|âââ | 9/30 [00:03<00:07, 2.72it/s] [ComfyUI] 33%|ââââ | 10/30 [00:03<00:07, 2.71it/s] [ComfyUI] 37%|ââââ | 11/30 [00:03<00:07, 2.71it/s] [ComfyUI] 40%|ââââ | 12/30 [00:04<00:06, 2.70it/s] [ComfyUI] 43%|âââââ | 13/30 [00:04<00:06, 2.70it/s] [ComfyUI] 47%|âââââ | 14/30 [00:05<00:05, 2.70it/s] [ComfyUI] 50%|âââââ | 15/30 [00:05<00:05, 2.70it/s] [ComfyUI] 53%|ââââââ | 16/30 [00:05<00:05, 2.69it/s] [ComfyUI] 57%|ââââââ | 17/30 [00:06<00:04, 2.69it/s] [ComfyUI] 60%|ââââââ | 18/30 [00:06<00:04, 2.69it/s] [ComfyUI] 63%|âââââââ | 19/30 [00:06<00:04, 2.69it/s] [ComfyUI] 67%|âââââââ | 20/30 [00:07<00:03, 2.69it/s] [ComfyUI] 70%|âââââââ | 21/30 [00:07<00:03, 2.69it/s] [ComfyUI] 73%|ââââââââ | 22/30 [00:07<00:02, 2.69it/s] [ComfyUI] 77%|ââââââââ | 23/30 [00:08<00:02, 2.69it/s] [ComfyUI] 80%|ââââââââ | 24/30 [00:08<00:02, 2.69it/s] [ComfyUI] 83%|âââââââââ | 25/30 [00:09<00:01, 2.69it/s] [ComfyUI] 87%|âââââââââ | 26/30 [00:09<00:01, 2.69it/s] [ComfyUI] 90%|âââââââââ | 27/30 [00:09<00:01, 2.69it/s] [ComfyUI] 93%|ââââââââââ| 28/30 [00:10<00:00, 2.69it/s] [ComfyUI] 97%|ââââââââââ| 29/30 [00:10<00:00, 2.69it/s] [ComfyUI] 100%|ââââââââââ| 30/30 [00:10<00:00, 2.69it/s] Executing node 8, title: VAE Decode, class type: VAEDecode Executing node 79, title: Video Combine ðĨð Ĩð ð Ē, class type: VHS_VideoCombine [ComfyUI] 100%|ââââââââââ| 30/30 [00:10<00:00, 2.74it/s] [ComfyUI] Prompt executed in 12.89 seconds outputs: {'79': {'gifs': [{'filename': 'R8_LTX_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 25.0}]}} ==================================== R8_LTX_00001.png R8_LTX_00001.mp4
Want to make some of these yourself?
Run this model