Readme
This model doesn't have a readme.
fofr / damo-text2video
- Public
- 451 runs
-
A100 (80GB)
Input
Run this model in Node.js with one line of code:
npx create-replicate --model=fofr/damo-text2video
or set up a project from scratch
Install Replicate’s Node.js client library:
npm install replicateSet the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the client:
import Replicate from "replicate";
const replicate = new Replicate({
auth: process.env.REPLICATE_API_TOKEN,
});Run fofr/damo-text2video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run(
"fofr/damo-text2video:712671d9f57b30e73f5c117eaf2e18eb64c492ec4b1baf42c2855ad66659f0ab",
{
input: {
fps: 8,
prompt: "An astronaut riding a llama",
num_frames: 16,
num_inference_steps: 50
}
}
);
// To access the file URL:
console.log(output.url()); //=> "http://example.com"
// To write the file to disk:
fs.writeFile("my-image.png", output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:
pip install replicateSet the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the client:
import replicateRun fofr/damo-text2video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"fofr/damo-text2video:712671d9f57b30e73f5c117eaf2e18eb64c492ec4b1baf42c2855ad66659f0ab",
input={
"fps": 8,
"prompt": "An astronaut riding a llama",
"num_frames": 16,
"num_inference_steps": 50
}
)
print(output)To learn more, take a look at the guide on getting started with Python.
Set the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run fofr/damo-text2video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-H "Prefer: wait" \
-d $'{
"version": "fofr/damo-text2video:712671d9f57b30e73f5c117eaf2e18eb64c492ec4b1baf42c2855ad66659f0ab",
"input": {
"fps": 8,
"prompt": "An astronaut riding a llama",
"num_frames": 16,
"num_inference_steps": 50
}
}' \
https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Add a payment method to run this model.
Sign in with GitHub
By signing in, you agree to our
terms of service and privacy policy
Output
{
"completed_at": "2023-06-10T22:34:47.557429Z",
"created_at": "2023-06-10T22:34:28.288223Z",
"data_removed": false,
"error": null,
"id": "7jkglkzbxlmw2sfyy4ki73mnle",
"input": {
"fps": 8,
"width": 456,
"height": 256,
"prompt": "An astronaut riding a llama",
"num_frames": 16,
"guidance_scale": 7.5,
"negative_prompt": "Horse",
"num_inference_steps": 50
},
"logs": "Using seed: 1539\n 0%| | 0/50 [00:00<?, ?it/s]\n 2%|▏ | 1/50 [00:02<02:07, 2.61s/it]\n 4%|▍ | 2/50 [00:02<00:58, 1.23s/it]\n 6%|▌ | 3/50 [00:03<00:37, 1.27it/s]\n 8%|▊ | 4/50 [00:03<00:26, 1.72it/s]\n 10%|█ | 5/50 [00:03<00:20, 2.15it/s]\n 12%|█▏ | 6/50 [00:03<00:17, 2.53it/s]\n 14%|█▍ | 7/50 [00:04<00:15, 2.84it/s]\n 16%|█▌ | 8/50 [00:04<00:13, 3.09it/s]\n 18%|█▊ | 9/50 [00:04<00:12, 3.29it/s]\n 20%|██ | 10/50 [00:04<00:11, 3.43it/s]\n 22%|██▏ | 11/50 [00:05<00:10, 3.55it/s]\n 24%|██▍ | 12/50 [00:05<00:10, 3.62it/s]\n 26%|██▌ | 13/50 [00:05<00:10, 3.68it/s]\n 28%|██▊ | 14/50 [00:06<00:09, 3.72it/s]\n 30%|███ | 15/50 [00:06<00:09, 3.75it/s]\n 32%|███▏ | 16/50 [00:06<00:09, 3.76it/s]\n 34%|███▍ | 17/50 [00:06<00:08, 3.78it/s]\n 36%|███▌ | 18/50 [00:07<00:08, 3.77it/s]\n 38%|███▊ | 19/50 [00:07<00:08, 3.78it/s]\n 40%|████ | 20/50 [00:07<00:07, 3.77it/s]\n 42%|████▏ | 21/50 [00:07<00:07, 3.78it/s]\n 44%|████▍ | 22/50 [00:08<00:07, 3.77it/s]\n 46%|████▌ | 23/50 [00:08<00:07, 3.78it/s]\n 48%|████▊ | 24/50 [00:08<00:06, 3.77it/s]\n 50%|█████ | 25/50 [00:08<00:06, 3.77it/s]\n 52%|█████▏ | 26/50 [00:09<00:06, 3.76it/s]\n 54%|█████▍ | 27/50 [00:09<00:06, 3.76it/s]\n 56%|█████▌ | 28/50 [00:09<00:05, 3.78it/s]\n 58%|█████▊ | 29/50 [00:09<00:05, 3.79it/s]\n 60%|██████ | 30/50 [00:10<00:05, 3.79it/s]\n 62%|██████▏ | 31/50 [00:10<00:05, 3.79it/s]\n 64%|██████▍ | 32/50 [00:10<00:04, 3.79it/s]\n 66%|██████▌ | 33/50 [00:11<00:04, 3.79it/s]\n 68%|██████▊ | 34/50 [00:11<00:04, 3.79it/s]\n 70%|███████ | 35/50 [00:11<00:03, 3.79it/s]\n 72%|███████▏ | 36/50 [00:11<00:03, 3.79it/s]\n 74%|███████▍ | 37/50 [00:12<00:03, 3.78it/s]\n 76%|███████▌ | 38/50 [00:12<00:03, 3.78it/s]\n 78%|███████▊ | 39/50 [00:12<00:02, 3.79it/s]\n 80%|████████ | 40/50 [00:12<00:02, 3.79it/s]\n 82%|████████▏ | 41/50 [00:13<00:02, 3.79it/s]\n 84%|████████▍ | 42/50 [00:13<00:02, 3.79it/s]\n 86%|████████▌ | 43/50 [00:13<00:01, 3.79it/s]\n 88%|████████▊ | 44/50 [00:13<00:01, 3.79it/s]\n 90%|█████████ | 45/50 [00:14<00:01, 3.80it/s]\n 92%|█████████▏| 46/50 [00:14<00:01, 3.80it/s]\n 94%|█████████▍| 47/50 [00:14<00:00, 3.81it/s]\n 96%|█████████▌| 48/50 [00:14<00:00, 3.81it/s]\n 98%|█████████▊| 49/50 [00:15<00:00, 3.80it/s]\n100%|██████████| 50/50 [00:15<00:00, 3.81it/s]\n100%|██████████| 50/50 [00:15<00:00, 3.22it/s]\nIMAGEIO FFMPEG_WRITER WARNING: input image is not divisible by macro_block_size=16, resizing from (456, 256) to (464, 256) to ensure video compatibility with most codecs and players. To prevent resizing, make your input image divisible by the macro_block_size or set the macro_block_size to 1 (risking incompatibility).\n[swscaler @ 0x64cac00] Warning: data is not aligned! This can lead to a speed loss",
"metrics": {
"predict_time": 19.361491,
"total_time": 19.269206
},
"output": "https://replicate.delivery/pbxt/HIFQOXYlCKbzP9YVim3O5Nchit7xeeT89u6AZ4sQPneOkVJiA/out.mp4",
"started_at": "2023-06-10T22:34:28.195938Z",
"status": "succeeded",
"urls": {
"get": "https://api.replicate.com/v1/predictions/7jkglkzbxlmw2sfyy4ki73mnle",
"cancel": "https://api.replicate.com/v1/predictions/7jkglkzbxlmw2sfyy4ki73mnle/cancel"
},
"version": "72db2d5426a1174a053bd20fc017cae38104886d780f517db89e8ac9059ea700"
}Generated in
Using seed: 1539
0%| | 0/50 [00:00<?, ?it/s]
2%|▏ | 1/50 [00:02<02:07, 2.61s/it]
4%|▍ | 2/50 [00:02<00:58, 1.23s/it]
6%|▌ | 3/50 [00:03<00:37, 1.27it/s]
8%|▊ | 4/50 [00:03<00:26, 1.72it/s]
10%|█ | 5/50 [00:03<00:20, 2.15it/s]
12%|█▏ | 6/50 [00:03<00:17, 2.53it/s]
14%|█▍ | 7/50 [00:04<00:15, 2.84it/s]
16%|█▌ | 8/50 [00:04<00:13, 3.09it/s]
18%|█▊ | 9/50 [00:04<00:12, 3.29it/s]
20%|██ | 10/50 [00:04<00:11, 3.43it/s]
22%|██▏ | 11/50 [00:05<00:10, 3.55it/s]
24%|██▍ | 12/50 [00:05<00:10, 3.62it/s]
26%|██▌ | 13/50 [00:05<00:10, 3.68it/s]
28%|██▊ | 14/50 [00:06<00:09, 3.72it/s]
30%|███ | 15/50 [00:06<00:09, 3.75it/s]
32%|███▏ | 16/50 [00:06<00:09, 3.76it/s]
34%|███▍ | 17/50 [00:06<00:08, 3.78it/s]
36%|███▌ | 18/50 [00:07<00:08, 3.77it/s]
38%|███▊ | 19/50 [00:07<00:08, 3.78it/s]
40%|████ | 20/50 [00:07<00:07, 3.77it/s]
42%|████▏ | 21/50 [00:07<00:07, 3.78it/s]
44%|████▍ | 22/50 [00:08<00:07, 3.77it/s]
46%|████▌ | 23/50 [00:08<00:07, 3.78it/s]
48%|████▊ | 24/50 [00:08<00:06, 3.77it/s]
50%|█████ | 25/50 [00:08<00:06, 3.77it/s]
52%|█████▏ | 26/50 [00:09<00:06, 3.76it/s]
54%|█████▍ | 27/50 [00:09<00:06, 3.76it/s]
56%|█████▌ | 28/50 [00:09<00:05, 3.78it/s]
58%|█████▊ | 29/50 [00:09<00:05, 3.79it/s]
60%|██████ | 30/50 [00:10<00:05, 3.79it/s]
62%|██████▏ | 31/50 [00:10<00:05, 3.79it/s]
64%|██████▍ | 32/50 [00:10<00:04, 3.79it/s]
66%|██████▌ | 33/50 [00:11<00:04, 3.79it/s]
68%|██████▊ | 34/50 [00:11<00:04, 3.79it/s]
70%|███████ | 35/50 [00:11<00:03, 3.79it/s]
72%|███████▏ | 36/50 [00:11<00:03, 3.79it/s]
74%|███████▍ | 37/50 [00:12<00:03, 3.78it/s]
76%|███████▌ | 38/50 [00:12<00:03, 3.78it/s]
78%|███████▊ | 39/50 [00:12<00:02, 3.79it/s]
80%|████████ | 40/50 [00:12<00:02, 3.79it/s]
82%|████████▏ | 41/50 [00:13<00:02, 3.79it/s]
84%|████████▍ | 42/50 [00:13<00:02, 3.79it/s]
86%|████████▌ | 43/50 [00:13<00:01, 3.79it/s]
88%|████████▊ | 44/50 [00:13<00:01, 3.79it/s]
90%|█████████ | 45/50 [00:14<00:01, 3.80it/s]
92%|█████████▏| 46/50 [00:14<00:01, 3.80it/s]
94%|█████████▍| 47/50 [00:14<00:00, 3.81it/s]
96%|█████████▌| 48/50 [00:14<00:00, 3.81it/s]
98%|█████████▊| 49/50 [00:15<00:00, 3.80it/s]
100%|██████████| 50/50 [00:15<00:00, 3.81it/s]
100%|██████████| 50/50 [00:15<00:00, 3.22it/s]
IMAGEIO FFMPEG_WRITER WARNING: input image is not divisible by macro_block_size=16, resizing from (456, 256) to (464, 256) to ensure video compatibility with most codecs and players. To prevent resizing, make your input image divisible by the macro_block_size or set the macro_block_size to 1 (risking incompatibility).
[swscaler @ 0x64cac00] Warning: data is not aligned! This can lead to a speed lossThis output was created using a different version of the model, fofr/damo-text2video:72db2d54.
Examples
Run time and cost
This model runs on Nvidia A100 (80GB) GPU hardware. We don't yet have enough runs of this model to provide performance information.
