Failed to load versions. Head to the versions page to see all versions for this model.
You're looking at a specific version of this model. Jump to the model overview.
fofr /wan2.1-with-lora:0615656d
Input
Run this model in Node.js with one line of code:
npm install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import Replicate from "replicate";
import fs from "node:fs";
const replicate = new Replicate({
auth: process.env.REPLICATE_API_TOKEN,
});
Run fofr/wan2.1-with-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run(
"fofr/wan2.1-with-lora:0615656dcf90c621b2fe05bddc3c87db422dda0aad7b0a681fa641d8749e9fd3",
{
input: {
model: "14b",
frames: 81,
prompt: "a scene from MNCRFTMOV, a fox is running through snow",
lora_url: "https://huggingface.co/fofr/wan2.1-test-loras/resolve/main/wan2.1-14b-minecraft-movie.safetensors?download=true",
aspect_ratio: "16:9",
sample_shift: 8,
sample_steps: 30,
negative_prompt: "",
lora_strength_clip: 1,
sample_guide_scale: 5,
lora_strength_model: 1
}
}
);
// To access the file URL:
console.log(output[0].url()); //=> "http://example.com"
// To write the file to disk:
fs.writeFile("my-image.png", output[0]);
To learn more, take a look at the guide on getting started with Node.js.
pip install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import replicate
Run fofr/wan2.1-with-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"fofr/wan2.1-with-lora:0615656dcf90c621b2fe05bddc3c87db422dda0aad7b0a681fa641d8749e9fd3",
input={
"model": "14b",
"frames": 81,
"prompt": "a scene from MNCRFTMOV, a fox is running through snow",
"lora_url": "https://huggingface.co/fofr/wan2.1-test-loras/resolve/main/wan2.1-14b-minecraft-movie.safetensors?download=true",
"aspect_ratio": "16:9",
"sample_shift": 8,
"sample_steps": 30,
"negative_prompt": "",
"lora_strength_clip": 1,
"sample_guide_scale": 5,
"lora_strength_model": 1
}
)
print(output)
To learn more, take a look at the guide on getting started with Python.
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
Run fofr/wan2.1-with-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-H "Prefer: wait" \
-d $'{
"version": "fofr/wan2.1-with-lora:0615656dcf90c621b2fe05bddc3c87db422dda0aad7b0a681fa641d8749e9fd3",
"input": {
"model": "14b",
"frames": 81,
"prompt": "a scene from MNCRFTMOV, a fox is running through snow",
"lora_url": "https://huggingface.co/fofr/wan2.1-test-loras/resolve/main/wan2.1-14b-minecraft-movie.safetensors?download=true",
"aspect_ratio": "16:9",
"sample_shift": 8,
"sample_steps": 30,
"negative_prompt": "",
"lora_strength_clip": 1,
"sample_guide_scale": 5,
"lora_strength_model": 1
}
}' \
https://api.replicate.com/v1/predictions
To learn more, take a look at Replicate’s HTTP API reference docs.
Add a payment method to run this model.
By signing in, you agree to our
terms of service and privacy policy
Output
{
"completed_at": "2025-03-10T13:46:11.358399Z",
"created_at": "2025-03-10T13:39:42.030000Z",
"data_removed": false,
"error": null,
"id": "vymscy319srme0cng14aefyybw",
"input": {
"model": "14b",
"frames": 81,
"prompt": "a scene from MNCRFTMOV, a fox is running through snow",
"lora_url": "https://huggingface.co/fofr/wan2.1-test-loras/resolve/main/wan2.1-14b-minecraft-movie.safetensors?download=true",
"aspect_ratio": "16:9",
"sample_shift": 8,
"sample_steps": 30,
"negative_prompt": "",
"lora_strength_clip": 1,
"sample_guide_scale": 5,
"lora_strength_model": 1
},
"logs": "Random seed set to: 3805312421\nChecking inputs\n====================================\nChecking weights\nConverting LoraLoader node 49 to LoraLoaderFromURL\n✅ wan_2.1_vae.safetensors exists in ComfyUI/models/vae\n✅ umt5_xxl_fp16.safetensors exists in ComfyUI/models/text_encoders\n✅ wan2.1_t2v_14B_bf16.safetensors exists in ComfyUI/models/diffusion_models\n====================================\nRunning workflow\n[ComfyUI] got prompt\nExecuting node 39, title: Load VAE, class type: VAELoader\n[ComfyUI] Using pytorch attention in VAE\n[ComfyUI] Using pytorch attention in VAE\n[ComfyUI] VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16\nExecuting node 40, title: EmptyHunyuanLatentVideo, class type: EmptyHunyuanLatentVideo\nExecuting node 38, title: Load CLIP, class type: CLIPLoader\n[ComfyUI] CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16\n[ComfyUI] Requested to load WanTEModel\nExecuting node 7, title: CLIP Text Encode (Negative Prompt), class type: CLIPTextEncode\n[ComfyUI] loaded completely 141327.4875 10835.4765625 True\nExecuting node 37, title: Load Diffusion Model, class type: UNETLoader\n[ComfyUI] model weight dtype torch.bfloat16, manual cast: None\n[ComfyUI] model_type FLOW\nExecuting node 49, title: Load LoRA, class type: LoraLoaderFromURL\n[ComfyUI] Requested to load WanTEModel\nExecuting node 6, title: CLIP Text Encode (Positive Prompt), class type: CLIPTextEncode\n[ComfyUI] loaded completely 141069.4875 10835.4765625 True\nExecuting node 48, title: ModelSamplingSD3, class type: ModelSamplingSD3\nExecuting node 3, title: KSampler, class type: KSampler\n[ComfyUI] Requested to load WAN21\n[ComfyUI] loaded completely 124343.96281542968 27251.406372070312 True\n[ComfyUI] Creating huggingface_cache directory within comfy\n[ComfyUI]\n[ComfyUI] 0%| | 0/30 [00:00<?, ?it/s]\n[ComfyUI] 3%|▎ | 1/30 [00:06<03:06, 6.45s/it]\n[ComfyUI] 7%|▋ | 2/30 [00:15<03:40, 7.87s/it]\n[ComfyUI] 10%|█ | 3/30 [00:24<03:45, 8.36s/it]\n[ComfyUI] 13%|█▎ | 4/30 [00:33<03:43, 8.59s/it]\n[ComfyUI] 17%|█▋ | 5/30 [00:42<03:38, 8.72s/it]\n[ComfyUI] 20%|██ | 6/30 [00:51<03:31, 8.80s/it]\n[ComfyUI] 23%|██▎ | 7/30 [01:00<03:23, 8.86s/it]\n[ComfyUI] 27%|██▋ | 8/30 [01:09<03:15, 8.89s/it]\n[ComfyUI] 30%|███ | 9/30 [01:18<03:07, 8.91s/it]\n[ComfyUI] 33%|███▎ | 10/30 [01:26<02:58, 8.93s/it]\n[ComfyUI] 37%|███▋ | 11/30 [01:35<02:49, 8.94s/it]\n[ComfyUI] 40%|████ | 12/30 [01:44<02:41, 8.95s/it]\n[ComfyUI] 43%|████▎ | 13/30 [01:53<02:32, 8.95s/it]\n[ComfyUI] 47%|████▋ | 14/30 [02:02<02:23, 8.96s/it]\n[ComfyUI] 50%|█████ | 15/30 [02:11<02:14, 8.97s/it]\n[ComfyUI] 53%|█████▎ | 16/30 [02:20<02:05, 8.96s/it]\n[ComfyUI] 57%|█████▋ | 17/30 [02:29<01:56, 8.96s/it]\n[ComfyUI] 60%|██████ | 18/30 [02:38<01:47, 8.96s/it]\n[ComfyUI] 63%|██████▎ | 19/30 [02:47<01:38, 8.96s/it]\n[ComfyUI] 67%|██████▋ | 20/30 [02:56<01:29, 8.97s/it]\n[ComfyUI] 70%|███████ | 21/30 [03:05<01:20, 8.96s/it]\n[ComfyUI] 73%|███████▎ | 22/30 [03:14<01:11, 8.96s/it]\n[ComfyUI] 77%|███████▋ | 23/30 [03:23<01:02, 8.96s/it]\n[ComfyUI] 80%|████████ | 24/30 [03:32<00:53, 8.96s/it]\n[ComfyUI] 83%|████████▎ | 25/30 [03:41<00:44, 8.96s/it]\n[ComfyUI] 87%|████████▋ | 26/30 [03:50<00:35, 8.97s/it]\n[ComfyUI] 90%|█████████ | 27/30 [03:59<00:26, 8.97s/it]\n[ComfyUI] 93%|█████████▎| 28/30 [04:08<00:17, 8.97s/it]\n[ComfyUI] 97%|█████████▋| 29/30 [04:17<00:08, 8.97s/it]\n[ComfyUI] 100%|██████████| 30/30 [04:28<00:00, 9.77s/it]\n[ComfyUI] 100%|██████████| 30/30 [04:28<00:00, 8.97s/it]\n[ComfyUI] Requested to load WanVAE\nExecuting node 8, title: VAE Decode, class type: VAEDecode\n[ComfyUI] loaded completely 98169.40621566772 242.02829551696777 True\nExecuting node 50, title: Video Combine 🎥🅥🅗🅢, class type: VHS_VideoCombine\n[ComfyUI] Prompt executed in 291.81 seconds\noutputs: {'50': {'gifs': [{'filename': 'R8_Wan_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 16.0, 'workflow': 'R8_Wan_00001.png', 'fullpath': '/tmp/outputs/R8_Wan_00001.mp4'}]}}\n====================================\nR8_Wan_00001.png\nR8_Wan_00001.mp4",
"metrics": {
"predict_time": 291.982956802,
"total_time": 389.328399
},
"output": [
"https://replicate.delivery/xezq/hcj0YfLAfvmQZ0tcJhpdSRVit65s031SN7Hkf2G72SpG5TuoA/R8_Wan_00001.mp4"
],
"started_at": "2025-03-10T13:41:19.375442Z",
"status": "succeeded",
"urls": {
"stream": "https://stream.replicate.com/v1/files/bcwr-cjv36ojgosgkashulhv7ojaulmovtb3myqqcwiq3wa7rkstnvida",
"get": "https://api.replicate.com/v1/predictions/vymscy319srme0cng14aefyybw",
"cancel": "https://api.replicate.com/v1/predictions/vymscy319srme0cng14aefyybw/cancel"
},
"version": "0615656dcf90c621b2fe05bddc3c87db422dda0aad7b0a681fa641d8749e9fd3"
}
Random seed set to: 3805312421
Checking inputs
====================================
Checking weights
Converting LoraLoader node 49 to LoraLoaderFromURL
✅ wan_2.1_vae.safetensors exists in ComfyUI/models/vae
✅ umt5_xxl_fp16.safetensors exists in ComfyUI/models/text_encoders
✅ wan2.1_t2v_14B_bf16.safetensors exists in ComfyUI/models/diffusion_models
====================================
Running workflow
[ComfyUI] got prompt
Executing node 39, title: Load VAE, class type: VAELoader
[ComfyUI] Using pytorch attention in VAE
[ComfyUI] Using pytorch attention in VAE
[ComfyUI] VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
Executing node 40, title: EmptyHunyuanLatentVideo, class type: EmptyHunyuanLatentVideo
Executing node 38, title: Load CLIP, class type: CLIPLoader
[ComfyUI] CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
[ComfyUI] Requested to load WanTEModel
Executing node 7, title: CLIP Text Encode (Negative Prompt), class type: CLIPTextEncode
[ComfyUI] loaded completely 141327.4875 10835.4765625 True
Executing node 37, title: Load Diffusion Model, class type: UNETLoader
[ComfyUI] model weight dtype torch.bfloat16, manual cast: None
[ComfyUI] model_type FLOW
Executing node 49, title: Load LoRA, class type: LoraLoaderFromURL
[ComfyUI] Requested to load WanTEModel
Executing node 6, title: CLIP Text Encode (Positive Prompt), class type: CLIPTextEncode
[ComfyUI] loaded completely 141069.4875 10835.4765625 True
Executing node 48, title: ModelSamplingSD3, class type: ModelSamplingSD3
Executing node 3, title: KSampler, class type: KSampler
[ComfyUI] Requested to load WAN21
[ComfyUI] loaded completely 124343.96281542968 27251.406372070312 True
[ComfyUI] Creating huggingface_cache directory within comfy
[ComfyUI]
[ComfyUI] 0%| | 0/30 [00:00<?, ?it/s]
[ComfyUI] 3%|▎ | 1/30 [00:06<03:06, 6.45s/it]
[ComfyUI] 7%|▋ | 2/30 [00:15<03:40, 7.87s/it]
[ComfyUI] 10%|█ | 3/30 [00:24<03:45, 8.36s/it]
[ComfyUI] 13%|█▎ | 4/30 [00:33<03:43, 8.59s/it]
[ComfyUI] 17%|█▋ | 5/30 [00:42<03:38, 8.72s/it]
[ComfyUI] 20%|██ | 6/30 [00:51<03:31, 8.80s/it]
[ComfyUI] 23%|██▎ | 7/30 [01:00<03:23, 8.86s/it]
[ComfyUI] 27%|██▋ | 8/30 [01:09<03:15, 8.89s/it]
[ComfyUI] 30%|███ | 9/30 [01:18<03:07, 8.91s/it]
[ComfyUI] 33%|███▎ | 10/30 [01:26<02:58, 8.93s/it]
[ComfyUI] 37%|███▋ | 11/30 [01:35<02:49, 8.94s/it]
[ComfyUI] 40%|████ | 12/30 [01:44<02:41, 8.95s/it]
[ComfyUI] 43%|████▎ | 13/30 [01:53<02:32, 8.95s/it]
[ComfyUI] 47%|████▋ | 14/30 [02:02<02:23, 8.96s/it]
[ComfyUI] 50%|█████ | 15/30 [02:11<02:14, 8.97s/it]
[ComfyUI] 53%|█████▎ | 16/30 [02:20<02:05, 8.96s/it]
[ComfyUI] 57%|█████▋ | 17/30 [02:29<01:56, 8.96s/it]
[ComfyUI] 60%|██████ | 18/30 [02:38<01:47, 8.96s/it]
[ComfyUI] 63%|██████▎ | 19/30 [02:47<01:38, 8.96s/it]
[ComfyUI] 67%|██████▋ | 20/30 [02:56<01:29, 8.97s/it]
[ComfyUI] 70%|███████ | 21/30 [03:05<01:20, 8.96s/it]
[ComfyUI] 73%|███████▎ | 22/30 [03:14<01:11, 8.96s/it]
[ComfyUI] 77%|███████▋ | 23/30 [03:23<01:02, 8.96s/it]
[ComfyUI] 80%|████████ | 24/30 [03:32<00:53, 8.96s/it]
[ComfyUI] 83%|████████▎ | 25/30 [03:41<00:44, 8.96s/it]
[ComfyUI] 87%|████████▋ | 26/30 [03:50<00:35, 8.97s/it]
[ComfyUI] 90%|█████████ | 27/30 [03:59<00:26, 8.97s/it]
[ComfyUI] 93%|█████████▎| 28/30 [04:08<00:17, 8.97s/it]
[ComfyUI] 97%|█████████▋| 29/30 [04:17<00:08, 8.97s/it]
[ComfyUI] 100%|██████████| 30/30 [04:28<00:00, 9.77s/it]
[ComfyUI] 100%|██████████| 30/30 [04:28<00:00, 8.97s/it]
[ComfyUI] Requested to load WanVAE
Executing node 8, title: VAE Decode, class type: VAEDecode
[ComfyUI] loaded completely 98169.40621566772 242.02829551696777 True
Executing node 50, title: Video Combine 🎥🅥🅗🅢, class type: VHS_VideoCombine
[ComfyUI] Prompt executed in 291.81 seconds
outputs: {'50': {'gifs': [{'filename': 'R8_Wan_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 16.0, 'workflow': 'R8_Wan_00001.png', 'fullpath': '/tmp/outputs/R8_Wan_00001.mp4'}]}}
====================================
R8_Wan_00001.png
R8_Wan_00001.mp4