You're looking at a specific version of this model. Jump to the model overview.
Input
Run this model in Node.js with one line of code:
npm install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import Replicate from "replicate";
const replicate = new Replicate({
auth: process.env.REPLICATE_API_TOKEN,
});
Run camenduru/open-sora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run(
"camenduru/open-sora:8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad",
{
input: {
seed: 1,
prompt: "A vibrant scene of a snowy mountain landscape. The sky is filled with a multitude of colorful hot air balloons, each floating at different heights, creating a dynamic and lively atmosphere. The balloons are scattered across the sky, some closer to the viewer, others further away, adding depth to the scene. Below, the mountainous terrain is blanketed in a thick layer of snow, with a few patches of bare earth visible here and there. The snow-covered mountains provide a stark contrast to the colorful balloons, enhancing the visual appeal of the scene. In the foreground, a few cars can be seen driving along a winding road that cuts through the mountains. The cars are small compared to the vastness of the landscape, emphasizing the grandeur of the surroundings. The overall style of the video is a mix of adventure and tranquility, with the hot air balloons adding a touch of whimsy to the otherwise serene mountain landscape. The video is likely shot during the day, as the lighting is bright and even, casting soft shadows on the snow-covered mountains."
}
}
);
console.log(output);
To learn more, take a look at the guide on getting started with Node.js.
pip install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import replicate
Run camenduru/open-sora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"camenduru/open-sora:8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad",
input={
"seed": 1,
"prompt": "A vibrant scene of a snowy mountain landscape. The sky is filled with a multitude of colorful hot air balloons, each floating at different heights, creating a dynamic and lively atmosphere. The balloons are scattered across the sky, some closer to the viewer, others further away, adding depth to the scene. Below, the mountainous terrain is blanketed in a thick layer of snow, with a few patches of bare earth visible here and there. The snow-covered mountains provide a stark contrast to the colorful balloons, enhancing the visual appeal of the scene. In the foreground, a few cars can be seen driving along a winding road that cuts through the mountains. The cars are small compared to the vastness of the landscape, emphasizing the grandeur of the surroundings. The overall style of the video is a mix of adventure and tranquility, with the hot air balloons adding a touch of whimsy to the otherwise serene mountain landscape. The video is likely shot during the day, as the lighting is bright and even, casting soft shadows on the snow-covered mountains."
}
)
print(output)
To learn more, take a look at the guide on getting started with Python.
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
Run camenduru/open-sora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-H "Prefer: wait" \
-d $'{
"version": "8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad",
"input": {
"seed": 1,
"prompt": "A vibrant scene of a snowy mountain landscape. The sky is filled with a multitude of colorful hot air balloons, each floating at different heights, creating a dynamic and lively atmosphere. The balloons are scattered across the sky, some closer to the viewer, others further away, adding depth to the scene. Below, the mountainous terrain is blanketed in a thick layer of snow, with a few patches of bare earth visible here and there. The snow-covered mountains provide a stark contrast to the colorful balloons, enhancing the visual appeal of the scene. In the foreground, a few cars can be seen driving along a winding road that cuts through the mountains. The cars are small compared to the vastness of the landscape, emphasizing the grandeur of the surroundings. The overall style of the video is a mix of adventure and tranquility, with the hot air balloons adding a touch of whimsy to the otherwise serene mountain landscape. The video is likely shot during the day, as the lighting is bright and even, casting soft shadows on the snow-covered mountains."
}
}' \
https://api.replicate.com/v1/predictions
To learn more, take a look at Replicate’s HTTP API reference docs.
brew install cog
If you don’t have Homebrew, there are other installation options available.
Run this to download the model and run it in your local environment:
cog predict r8.im/camenduru/open-sora@sha256:8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad \
-i 'seed=1' \
-i 'prompt="A vibrant scene of a snowy mountain landscape. The sky is filled with a multitude of colorful hot air balloons, each floating at different heights, creating a dynamic and lively atmosphere. The balloons are scattered across the sky, some closer to the viewer, others further away, adding depth to the scene. Below, the mountainous terrain is blanketed in a thick layer of snow, with a few patches of bare earth visible here and there. The snow-covered mountains provide a stark contrast to the colorful balloons, enhancing the visual appeal of the scene. In the foreground, a few cars can be seen driving along a winding road that cuts through the mountains. The cars are small compared to the vastness of the landscape, emphasizing the grandeur of the surroundings. The overall style of the video is a mix of adventure and tranquility, with the hot air balloons adding a touch of whimsy to the otherwise serene mountain landscape. The video is likely shot during the day, as the lighting is bright and even, casting soft shadows on the snow-covered mountains."'
To learn more, take a look at the Cog documentation.
Run this to download the model and run it in your local environment:
docker run -d -p 5000:5000 r8.im/camenduru/open-sora@sha256:8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad
curl -s -X POST \ -H "Content-Type: application/json" \ -d $'{ "input": { "seed": 1, "prompt": "A vibrant scene of a snowy mountain landscape. The sky is filled with a multitude of colorful hot air balloons, each floating at different heights, creating a dynamic and lively atmosphere. The balloons are scattered across the sky, some closer to the viewer, others further away, adding depth to the scene. Below, the mountainous terrain is blanketed in a thick layer of snow, with a few patches of bare earth visible here and there. The snow-covered mountains provide a stark contrast to the colorful balloons, enhancing the visual appeal of the scene. In the foreground, a few cars can be seen driving along a winding road that cuts through the mountains. The cars are small compared to the vastness of the landscape, emphasizing the grandeur of the surroundings. The overall style of the video is a mix of adventure and tranquility, with the hot air balloons adding a touch of whimsy to the otherwise serene mountain landscape. The video is likely shot during the day, as the lighting is bright and even, casting soft shadows on the snow-covered mountains." } }' \ http://localhost:5000/predictions
To learn more, take a look at the Cog documentation.
Add a payment method to run this model.
By signing in, you agree to our
terms of service and privacy policy
Output
{
"completed_at": "2024-03-22T03:53:49.475115Z",
"created_at": "2024-03-22T03:52:33.040924Z",
"data_removed": false,
"error": null,
"id": "vdgh2nlb3l6vhxjjvjaa6njcem",
"input": {
"seed": 1,
"prompt": "A vibrant scene of a snowy mountain landscape. The sky is filled with a multitude of colorful hot air balloons, each floating at different heights, creating a dynamic and lively atmosphere. The balloons are scattered across the sky, some closer to the viewer, others further away, adding depth to the scene. Below, the mountainous terrain is blanketed in a thick layer of snow, with a few patches of bare earth visible here and there. The snow-covered mountains provide a stark contrast to the colorful balloons, enhancing the visual appeal of the scene. In the foreground, a few cars can be seen driving along a winding road that cuts through the mountains. The cars are small compared to the vastness of the landscape, emphasizing the grandeur of the surroundings. The overall style of the video is a mix of adventure and tranquility, with the hot air balloons adding a touch of whimsy to the otherwise serene mountain landscape. The video is likely shot during the day, as the lighting is bright and even, casting soft shadows on the snow-covered mountains."
},
"logs": "0%| | 0/100 [00:00<?, ?it/s]\n 1%| | 1/100 [00:00<01:12, 1.36it/s]\n 2%|▏ | 2/100 [00:01<01:12, 1.35it/s]\n 3%|▎ | 3/100 [00:02<01:12, 1.34it/s]\n 4%|▍ | 4/100 [00:02<01:11, 1.34it/s]\n 5%|▌ | 5/100 [00:03<01:10, 1.35it/s]\n 6%|▌ | 6/100 [00:04<01:09, 1.35it/s]\n 7%|▋ | 7/100 [00:05<01:08, 1.35it/s]\n 8%|▊ | 8/100 [00:05<01:08, 1.35it/s]\n 9%|▉ | 9/100 [00:06<01:07, 1.35it/s]\n 10%|█ | 10/100 [00:07<01:06, 1.35it/s]\n 11%|█ | 11/100 [00:08<01:05, 1.35it/s]\n 12%|█▏ | 12/100 [00:08<01:05, 1.35it/s]\n 13%|█▎ | 13/100 [00:09<01:04, 1.35it/s]\n 14%|█▍ | 14/100 [00:10<01:03, 1.35it/s]\n 15%|█▌ | 15/100 [00:11<01:03, 1.35it/s]\n 16%|█▌ | 16/100 [00:11<01:02, 1.35it/s]\n 17%|█▋ | 17/100 [00:12<01:01, 1.35it/s]\n 18%|█▊ | 18/100 [00:13<01:00, 1.35it/s]\n 19%|█▉ | 19/100 [00:14<01:00, 1.35it/s]\n 20%|██ | 20/100 [00:14<00:59, 1.35it/s]\n 21%|██ | 21/100 [00:15<00:58, 1.35it/s]\n 22%|██▏ | 22/100 [00:16<00:57, 1.35it/s]\n 23%|██▎ | 23/100 [00:17<00:57, 1.35it/s]\n 24%|██▍ | 24/100 [00:17<00:56, 1.35it/s]\n 25%|██▌ | 25/100 [00:18<00:55, 1.35it/s]\n 26%|██▌ | 26/100 [00:19<00:54, 1.35it/s]\n 27%|██▋ | 27/100 [00:20<00:54, 1.35it/s]\n 28%|██▊ | 28/100 [00:20<00:53, 1.35it/s]\n 29%|██▉ | 29/100 [00:21<00:52, 1.34it/s]\n 30%|███ | 30/100 [00:22<00:52, 1.34it/s]\n 31%|███ | 31/100 [00:23<00:51, 1.34it/s]\n 32%|███▏ | 32/100 [00:23<00:50, 1.34it/s]\n 33%|███▎ | 33/100 [00:24<00:49, 1.34it/s]\n 34%|███▍ | 34/100 [00:25<00:49, 1.34it/s]\n 35%|███▌ | 35/100 [00:25<00:48, 1.34it/s]\n 36%|███▌ | 36/100 [00:26<00:47, 1.34it/s]\n 37%|███▋ | 37/100 [00:27<00:46, 1.34it/s]\n 38%|███▊ | 38/100 [00:28<00:46, 1.34it/s]\n 39%|███▉ | 39/100 [00:28<00:45, 1.34it/s]\n 40%|████ | 40/100 [00:29<00:44, 1.34it/s]\n 41%|████ | 41/100 [00:30<00:43, 1.34it/s]\n 42%|████▏ | 42/100 [00:31<00:43, 1.34it/s]\n 43%|████▎ | 43/100 [00:31<00:42, 1.34it/s]\n 44%|████▍ | 44/100 [00:32<00:41, 1.34it/s]\n 45%|████▌ | 45/100 [00:33<00:41, 1.34it/s]\n 46%|████▌ | 46/100 [00:34<00:40, 1.34it/s]\n 47%|████▋ | 47/100 [00:34<00:39, 1.34it/s]\n 48%|████▊ | 48/100 [00:35<00:38, 1.34it/s]\n 49%|████▉ | 49/100 [00:36<00:38, 1.34it/s]\n 50%|█████ | 50/100 [00:37<00:37, 1.34it/s]\n 51%|█████ | 51/100 [00:37<00:36, 1.34it/s]\n 52%|█████▏ | 52/100 [00:38<00:35, 1.34it/s]\n 53%|█████▎ | 53/100 [00:39<00:35, 1.34it/s]\n 54%|█████▍ | 54/100 [00:40<00:34, 1.34it/s]\n 55%|█████▌ | 55/100 [00:40<00:33, 1.34it/s]\n 56%|█████▌ | 56/100 [00:41<00:32, 1.34it/s]\n 57%|█████▋ | 57/100 [00:42<00:32, 1.34it/s]\n 58%|█████▊ | 58/100 [00:43<00:31, 1.34it/s]\n 59%|█████▉ | 59/100 [00:43<00:30, 1.34it/s]\n 60%|██████ | 60/100 [00:44<00:29, 1.34it/s]\n 61%|██████ | 61/100 [00:45<00:29, 1.34it/s]\n 62%|██████▏ | 62/100 [00:46<00:28, 1.34it/s]\n 63%|██████▎ | 63/100 [00:46<00:27, 1.34it/s]\n 64%|██████▍ | 64/100 [00:47<00:26, 1.34it/s]\n 65%|██████▌ | 65/100 [00:48<00:26, 1.34it/s]\n 66%|██████▌ | 66/100 [00:49<00:25, 1.34it/s]\n 67%|██████▋ | 67/100 [00:49<00:24, 1.34it/s]\n 68%|██████▊ | 68/100 [00:50<00:23, 1.34it/s]\n 69%|██████▉ | 69/100 [00:51<00:23, 1.34it/s]\n 70%|███████ | 70/100 [00:52<00:22, 1.34it/s]\n 71%|███████ | 71/100 [00:52<00:21, 1.34it/s]\n 72%|███████▏ | 72/100 [00:53<00:20, 1.34it/s]\n 73%|███████▎ | 73/100 [00:54<00:20, 1.34it/s]\n 74%|███████▍ | 74/100 [00:55<00:19, 1.34it/s]\n 75%|███████▌ | 75/100 [00:55<00:18, 1.34it/s]\n 76%|███████▌ | 76/100 [00:56<00:17, 1.34it/s]\n 77%|███████▋ | 77/100 [00:57<00:17, 1.34it/s]\n 78%|███████▊ | 78/100 [00:58<00:16, 1.34it/s]\n 79%|███████▉ | 79/100 [00:58<00:15, 1.34it/s]\n 80%|████████ | 80/100 [00:59<00:14, 1.34it/s]\n 81%|████████ | 81/100 [01:00<00:14, 1.34it/s]\n 82%|████████▏ | 82/100 [01:01<00:13, 1.34it/s]\n 83%|████████▎ | 83/100 [01:01<00:12, 1.34it/s]\n 84%|████████▍ | 84/100 [01:02<00:11, 1.34it/s]\n 85%|████████▌ | 85/100 [01:03<00:11, 1.34it/s]\n 86%|████████▌ | 86/100 [01:04<00:10, 1.34it/s]\n 87%|████████▋ | 87/100 [01:04<00:09, 1.34it/s]\n 88%|████████▊ | 88/100 [01:05<00:08, 1.34it/s]\n 89%|████████▉ | 89/100 [01:06<00:08, 1.34it/s]\n 90%|█████████ | 90/100 [01:07<00:07, 1.34it/s]\n 91%|█████████ | 91/100 [01:07<00:06, 1.34it/s]\n 92%|█████████▏| 92/100 [01:08<00:05, 1.33it/s]\n 93%|█████████▎| 93/100 [01:09<00:05, 1.33it/s]\n 94%|█████████▍| 94/100 [01:10<00:04, 1.33it/s]\n 95%|█████████▌| 95/100 [01:10<00:03, 1.34it/s]\n 96%|█████████▌| 96/100 [01:11<00:02, 1.34it/s]\n 97%|█████████▋| 97/100 [01:12<00:02, 1.34it/s]\n 98%|█████████▊| 98/100 [01:13<00:01, 1.34it/s]\n 99%|█████████▉| 99/100 [01:13<00:00, 1.34it/s]\n100%|██████████| 100/100 [01:14<00:00, 1.33it/s]\n100%|██████████| 100/100 [01:14<00:00, 1.34it/s]\nSaved to /content/output.mp4",
"metrics": {
"predict_time": 76.409129,
"total_time": 76.434191
},
"output": "https://replicate.delivery/pbxt/h9xV4Z0SGeQ9N6xPaxO3NsBbqgQWb9f869Bt8gOBCKPNLriSA/output.mp4",
"started_at": "2024-03-22T03:52:33.065986Z",
"status": "succeeded",
"urls": {
"get": "https://api.replicate.com/v1/predictions/vdgh2nlb3l6vhxjjvjaa6njcem",
"cancel": "https://api.replicate.com/v1/predictions/vdgh2nlb3l6vhxjjvjaa6njcem/cancel"
},
"version": "8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad"
}
0%| | 0/100 [00:00<?, ?it/s]
1%| | 1/100 [00:00<01:12, 1.36it/s]
2%|▏ | 2/100 [00:01<01:12, 1.35it/s]
3%|▎ | 3/100 [00:02<01:12, 1.34it/s]
4%|▍ | 4/100 [00:02<01:11, 1.34it/s]
5%|▌ | 5/100 [00:03<01:10, 1.35it/s]
6%|▌ | 6/100 [00:04<01:09, 1.35it/s]
7%|▋ | 7/100 [00:05<01:08, 1.35it/s]
8%|▊ | 8/100 [00:05<01:08, 1.35it/s]
9%|▉ | 9/100 [00:06<01:07, 1.35it/s]
10%|█ | 10/100 [00:07<01:06, 1.35it/s]
11%|█ | 11/100 [00:08<01:05, 1.35it/s]
12%|█▏ | 12/100 [00:08<01:05, 1.35it/s]
13%|█▎ | 13/100 [00:09<01:04, 1.35it/s]
14%|█▍ | 14/100 [00:10<01:03, 1.35it/s]
15%|█▌ | 15/100 [00:11<01:03, 1.35it/s]
16%|█▌ | 16/100 [00:11<01:02, 1.35it/s]
17%|█▋ | 17/100 [00:12<01:01, 1.35it/s]
18%|█▊ | 18/100 [00:13<01:00, 1.35it/s]
19%|█▉ | 19/100 [00:14<01:00, 1.35it/s]
20%|██ | 20/100 [00:14<00:59, 1.35it/s]
21%|██ | 21/100 [00:15<00:58, 1.35it/s]
22%|██▏ | 22/100 [00:16<00:57, 1.35it/s]
23%|██▎ | 23/100 [00:17<00:57, 1.35it/s]
24%|██▍ | 24/100 [00:17<00:56, 1.35it/s]
25%|██▌ | 25/100 [00:18<00:55, 1.35it/s]
26%|██▌ | 26/100 [00:19<00:54, 1.35it/s]
27%|██▋ | 27/100 [00:20<00:54, 1.35it/s]
28%|██▊ | 28/100 [00:20<00:53, 1.35it/s]
29%|██▉ | 29/100 [00:21<00:52, 1.34it/s]
30%|███ | 30/100 [00:22<00:52, 1.34it/s]
31%|███ | 31/100 [00:23<00:51, 1.34it/s]
32%|███▏ | 32/100 [00:23<00:50, 1.34it/s]
33%|███▎ | 33/100 [00:24<00:49, 1.34it/s]
34%|███▍ | 34/100 [00:25<00:49, 1.34it/s]
35%|███▌ | 35/100 [00:25<00:48, 1.34it/s]
36%|███▌ | 36/100 [00:26<00:47, 1.34it/s]
37%|███▋ | 37/100 [00:27<00:46, 1.34it/s]
38%|███▊ | 38/100 [00:28<00:46, 1.34it/s]
39%|███▉ | 39/100 [00:28<00:45, 1.34it/s]
40%|████ | 40/100 [00:29<00:44, 1.34it/s]
41%|████ | 41/100 [00:30<00:43, 1.34it/s]
42%|████▏ | 42/100 [00:31<00:43, 1.34it/s]
43%|████▎ | 43/100 [00:31<00:42, 1.34it/s]
44%|████▍ | 44/100 [00:32<00:41, 1.34it/s]
45%|████▌ | 45/100 [00:33<00:41, 1.34it/s]
46%|████▌ | 46/100 [00:34<00:40, 1.34it/s]
47%|████▋ | 47/100 [00:34<00:39, 1.34it/s]
48%|████▊ | 48/100 [00:35<00:38, 1.34it/s]
49%|████▉ | 49/100 [00:36<00:38, 1.34it/s]
50%|█████ | 50/100 [00:37<00:37, 1.34it/s]
51%|█████ | 51/100 [00:37<00:36, 1.34it/s]
52%|█████▏ | 52/100 [00:38<00:35, 1.34it/s]
53%|█████▎ | 53/100 [00:39<00:35, 1.34it/s]
54%|█████▍ | 54/100 [00:40<00:34, 1.34it/s]
55%|█████▌ | 55/100 [00:40<00:33, 1.34it/s]
56%|█████▌ | 56/100 [00:41<00:32, 1.34it/s]
57%|█████▋ | 57/100 [00:42<00:32, 1.34it/s]
58%|█████▊ | 58/100 [00:43<00:31, 1.34it/s]
59%|█████▉ | 59/100 [00:43<00:30, 1.34it/s]
60%|██████ | 60/100 [00:44<00:29, 1.34it/s]
61%|██████ | 61/100 [00:45<00:29, 1.34it/s]
62%|██████▏ | 62/100 [00:46<00:28, 1.34it/s]
63%|██████▎ | 63/100 [00:46<00:27, 1.34it/s]
64%|██████▍ | 64/100 [00:47<00:26, 1.34it/s]
65%|██████▌ | 65/100 [00:48<00:26, 1.34it/s]
66%|██████▌ | 66/100 [00:49<00:25, 1.34it/s]
67%|██████▋ | 67/100 [00:49<00:24, 1.34it/s]
68%|██████▊ | 68/100 [00:50<00:23, 1.34it/s]
69%|██████▉ | 69/100 [00:51<00:23, 1.34it/s]
70%|███████ | 70/100 [00:52<00:22, 1.34it/s]
71%|███████ | 71/100 [00:52<00:21, 1.34it/s]
72%|███████▏ | 72/100 [00:53<00:20, 1.34it/s]
73%|███████▎ | 73/100 [00:54<00:20, 1.34it/s]
74%|███████▍ | 74/100 [00:55<00:19, 1.34it/s]
75%|███████▌ | 75/100 [00:55<00:18, 1.34it/s]
76%|███████▌ | 76/100 [00:56<00:17, 1.34it/s]
77%|███████▋ | 77/100 [00:57<00:17, 1.34it/s]
78%|███████▊ | 78/100 [00:58<00:16, 1.34it/s]
79%|███████▉ | 79/100 [00:58<00:15, 1.34it/s]
80%|████████ | 80/100 [00:59<00:14, 1.34it/s]
81%|████████ | 81/100 [01:00<00:14, 1.34it/s]
82%|████████▏ | 82/100 [01:01<00:13, 1.34it/s]
83%|████████▎ | 83/100 [01:01<00:12, 1.34it/s]
84%|████████▍ | 84/100 [01:02<00:11, 1.34it/s]
85%|████████▌ | 85/100 [01:03<00:11, 1.34it/s]
86%|████████▌ | 86/100 [01:04<00:10, 1.34it/s]
87%|████████▋ | 87/100 [01:04<00:09, 1.34it/s]
88%|████████▊ | 88/100 [01:05<00:08, 1.34it/s]
89%|████████▉ | 89/100 [01:06<00:08, 1.34it/s]
90%|█████████ | 90/100 [01:07<00:07, 1.34it/s]
91%|█████████ | 91/100 [01:07<00:06, 1.34it/s]
92%|█████████▏| 92/100 [01:08<00:05, 1.33it/s]
93%|█████████▎| 93/100 [01:09<00:05, 1.33it/s]
94%|█████████▍| 94/100 [01:10<00:04, 1.33it/s]
95%|█████████▌| 95/100 [01:10<00:03, 1.34it/s]
96%|█████████▌| 96/100 [01:11<00:02, 1.34it/s]
97%|█████████▋| 97/100 [01:12<00:02, 1.34it/s]
98%|█████████▊| 98/100 [01:13<00:01, 1.34it/s]
99%|█████████▉| 99/100 [01:13<00:00, 1.34it/s]
100%|██████████| 100/100 [01:14<00:00, 1.33it/s]
100%|██████████| 100/100 [01:14<00:00, 1.34it/s]
Saved to /content/output.mp4