Versions
8099e572
Latest
db5ec834
d38c36a6
You're looking at a specific version of this model. Jump to the model overview.
Input
Run this model in Node.js with one line of code:
npx create-replicate --model=camenduru/open-sora
or set up a project from scratch
Install Replicate’s Node.js client library:
npm install replicateSet the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the client:
import Replicate from "replicate";
const replicate = new Replicate({
auth: process.env.REPLICATE_API_TOKEN,
});Run camenduru/open-sora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run(
"camenduru/open-sora:8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad",
{
input: {
seed: 1234,
prompt: "A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle's journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene. The video is shot from a slightly elevated angle, providing a comprehensive view of the turtle's surroundings. The overall style of the video is calm and peaceful, capturing the beauty and tranquility of the underwater world."
}
}
);
console.log(output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:
pip install replicateSet the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the client:
import replicateRun camenduru/open-sora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"camenduru/open-sora:8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad",
input={
"seed": 1234,
"prompt": "A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle's journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene. The video is shot from a slightly elevated angle, providing a comprehensive view of the turtle's surroundings. The overall style of the video is calm and peaceful, capturing the beauty and tranquility of the underwater world."
}
)
print(output)To learn more, take a look at the guide on getting started with Python.
Set the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run camenduru/open-sora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-H "Prefer: wait" \
-d $'{
"version": "8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad",
"input": {
"seed": 1234,
"prompt": "A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle\'s journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene. The video is shot from a slightly elevated angle, providing a comprehensive view of the turtle\'s surroundings. The overall style of the video is calm and peaceful, capturing the beauty and tranquility of the underwater world."
}
}' \
https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
You can run this model locally using Cog. First, install Cog:
brew install cogIf you don’t have Homebrew, there are other installation options available.
Run this to download the model and run it in your local environment:
cog predict r8.im/camenduru/open-sora@sha256:8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad \
-i 'seed=1234' \
-i $'prompt="A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle\'s journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene. The video is shot from a slightly elevated angle, providing a comprehensive view of the turtle\'s surroundings. The overall style of the video is calm and peaceful, capturing the beauty and tranquility of the underwater world."'To learn more, take a look at the Cog documentation.
Run this to download the model and run it in your local environment:
docker run -d -p 5000:5000 r8.im/camenduru/open-sora@sha256:8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72adcurl -s -X POST \ -H "Content-Type: application/json" \ -d $'{ "input": { "seed": 1234, "prompt": "A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle\'s journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene. The video is shot from a slightly elevated angle, providing a comprehensive view of the turtle\'s surroundings. The overall style of the video is calm and peaceful, capturing the beauty and tranquility of the underwater world." } }' \ http://localhost:5000/predictions
To learn more, take a look at the Cog documentation.
Add a payment method to run this model.
Each run costs approximately $0.53. Alternatively, try out our featured models for free.
Sign in with GitHub
By signing in, you agree to our
terms of service and privacy policy
Output
{
"completed_at": "2024-03-22T03:27:59.693675Z",
"created_at": "2024-03-22T03:20:54.744582Z",
"data_removed": false,
"error": null,
"id": "apejmclbjcm66jtv645f2boynq",
"input": {
"seed": 1234,
"prompt": "A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle's journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene. The video is shot from a slightly elevated angle, providing a comprehensive view of the turtle's surroundings. The overall style of the video is calm and peaceful, capturing the beauty and tranquility of the underwater world."
},
"logs": "0%| | 0/100 [00:00<?, ?it/s]\n 1%| | 1/100 [00:00<01:24, 1.18it/s]\n 2%|▏ | 2/100 [00:01<01:16, 1.27it/s]\n 3%|▎ | 3/100 [00:02<01:14, 1.31it/s]\n 4%|▍ | 4/100 [00:03<01:12, 1.32it/s]\n 5%|▌ | 5/100 [00:03<01:11, 1.33it/s]\n 6%|▌ | 6/100 [00:04<01:10, 1.33it/s]\n 7%|▋ | 7/100 [00:05<01:09, 1.34it/s]\n 8%|▊ | 8/100 [00:06<01:08, 1.34it/s]\n 9%|▉ | 9/100 [00:06<01:08, 1.34it/s]\n 10%|█ | 10/100 [00:07<01:07, 1.34it/s]\n 11%|█ | 11/100 [00:08<01:06, 1.34it/s]\n 12%|█▏ | 12/100 [00:09<01:05, 1.34it/s]\n 13%|█▎ | 13/100 [00:09<01:04, 1.34it/s]\n 14%|█▍ | 14/100 [00:10<01:04, 1.34it/s]\n 15%|█▌ | 15/100 [00:11<01:03, 1.34it/s]\n 16%|█▌ | 16/100 [00:12<01:02, 1.34it/s]\n 17%|█▋ | 17/100 [00:12<01:01, 1.34it/s]\n 18%|█▊ | 18/100 [00:13<01:01, 1.34it/s]\n 19%|█▉ | 19/100 [00:14<01:00, 1.34it/s]\n 20%|██ | 20/100 [00:15<00:59, 1.34it/s]\n 21%|██ | 21/100 [00:15<00:58, 1.35it/s]\n 22%|██▏ | 22/100 [00:16<00:57, 1.35it/s]\n 23%|██▎ | 23/100 [00:17<00:57, 1.34it/s]\n 24%|██▍ | 24/100 [00:17<00:56, 1.34it/s]\n 25%|██▌ | 25/100 [00:18<00:55, 1.34it/s]\n 26%|██▌ | 26/100 [00:19<00:55, 1.34it/s]\n 27%|██▋ | 27/100 [00:20<00:54, 1.34it/s]\n 28%|██▊ | 28/100 [00:20<00:53, 1.34it/s]\n 29%|██▉ | 29/100 [00:21<00:52, 1.34it/s]\n 30%|███ | 30/100 [00:22<00:52, 1.34it/s]\n 31%|███ | 31/100 [00:23<00:51, 1.34it/s]\n 32%|███▏ | 32/100 [00:23<00:50, 1.34it/s]\n 33%|███▎ | 33/100 [00:24<00:49, 1.34it/s]\n 34%|███▍ | 34/100 [00:25<00:49, 1.34it/s]\n 35%|███▌ | 35/100 [00:26<00:48, 1.34it/s]\n 36%|███▌ | 36/100 [00:26<00:47, 1.34it/s]\n 37%|███▋ | 37/100 [00:27<00:47, 1.34it/s]\n 38%|███▊ | 38/100 [00:28<00:46, 1.34it/s]\n 39%|███▉ | 39/100 [00:29<00:45, 1.34it/s]\n 40%|████ | 40/100 [00:29<00:44, 1.34it/s]\n 41%|████ | 41/100 [00:30<00:44, 1.34it/s]\n 42%|████▏ | 42/100 [00:31<00:43, 1.34it/s]\n 43%|████▎ | 43/100 [00:32<00:42, 1.34it/s]\n 44%|████▍ | 44/100 [00:32<00:41, 1.34it/s]\n 45%|████▌ | 45/100 [00:33<00:41, 1.34it/s]\n 46%|████▌ | 46/100 [00:34<00:40, 1.34it/s]\n 47%|████▋ | 47/100 [00:35<00:39, 1.34it/s]\n 48%|████▊ | 48/100 [00:35<00:38, 1.34it/s]\n 49%|████▉ | 49/100 [00:36<00:38, 1.33it/s]\n 50%|█████ | 50/100 [00:37<00:37, 1.33it/s]\n 51%|█████ | 51/100 [00:38<00:36, 1.33it/s]\n 52%|█████▏ | 52/100 [00:38<00:35, 1.33it/s]\n 53%|█████▎ | 53/100 [00:39<00:35, 1.33it/s]\n 54%|█████▍ | 54/100 [00:40<00:34, 1.33it/s]\n 55%|█████▌ | 55/100 [00:41<00:33, 1.33it/s]\n 56%|█████▌ | 56/100 [00:41<00:33, 1.33it/s]\n 57%|█████▋ | 57/100 [00:42<00:32, 1.33it/s]\n 58%|█████▊ | 58/100 [00:43<00:31, 1.33it/s]\n 59%|█████▉ | 59/100 [00:44<00:30, 1.33it/s]\n 60%|██████ | 60/100 [00:44<00:30, 1.33it/s]\n 61%|██████ | 61/100 [00:45<00:29, 1.33it/s]\n 62%|██████▏ | 62/100 [00:46<00:28, 1.33it/s]\n 63%|██████▎ | 63/100 [00:47<00:27, 1.33it/s]\n 64%|██████▍ | 64/100 [00:47<00:27, 1.33it/s]\n 65%|██████▌ | 65/100 [00:48<00:26, 1.33it/s]\n 66%|██████▌ | 66/100 [00:49<00:25, 1.33it/s]\n 67%|██████▋ | 67/100 [00:50<00:24, 1.33it/s]\n 68%|██████▊ | 68/100 [00:50<00:24, 1.33it/s]\n 69%|██████▉ | 69/100 [00:51<00:23, 1.33it/s]\n 70%|███████ | 70/100 [00:52<00:22, 1.33it/s]\n 71%|███████ | 71/100 [00:53<00:21, 1.33it/s]\n 72%|███████▏ | 72/100 [00:53<00:21, 1.33it/s]\n 73%|███████▎ | 73/100 [00:54<00:20, 1.33it/s]\n 74%|███████▍ | 74/100 [00:55<00:19, 1.33it/s]\n 75%|███████▌ | 75/100 [00:56<00:18, 1.33it/s]\n 76%|███████▌ | 76/100 [00:56<00:18, 1.33it/s]\n 77%|███████▋ | 77/100 [00:57<00:17, 1.33it/s]\n 78%|███████▊ | 78/100 [00:58<00:16, 1.33it/s]\n 79%|███████▉ | 79/100 [00:59<00:15, 1.33it/s]\n 80%|████████ | 80/100 [00:59<00:15, 1.33it/s]\n 81%|████████ | 81/100 [01:00<00:14, 1.33it/s]\n 82%|████████▏ | 82/100 [01:01<00:13, 1.33it/s]\n 83%|████████▎ | 83/100 [01:02<00:12, 1.33it/s]\n 84%|████████▍ | 84/100 [01:02<00:12, 1.33it/s]\n 85%|████████▌ | 85/100 [01:03<00:11, 1.33it/s]\n 86%|████████▌ | 86/100 [01:04<00:10, 1.33it/s]\n 87%|████████▋ | 87/100 [01:05<00:09, 1.33it/s]\n 88%|████████▊ | 88/100 [01:05<00:09, 1.33it/s]\n 89%|████████▉ | 89/100 [01:06<00:08, 1.33it/s]\n 90%|█████████ | 90/100 [01:07<00:07, 1.33it/s]\n 91%|█████████ | 91/100 [01:08<00:06, 1.33it/s]\n 92%|█████████▏| 92/100 [01:08<00:06, 1.33it/s]\n 93%|█████████▎| 93/100 [01:09<00:05, 1.33it/s]\n 94%|█████████▍| 94/100 [01:10<00:04, 1.33it/s]\n 95%|█████████▌| 95/100 [01:11<00:03, 1.33it/s]\n 96%|█████████▌| 96/100 [01:11<00:03, 1.33it/s]\n 97%|█████████▋| 97/100 [01:12<00:02, 1.33it/s]\n 98%|█████████▊| 98/100 [01:13<00:01, 1.33it/s]\n 99%|█████████▉| 99/100 [01:14<00:00, 1.33it/s]\n100%|██████████| 100/100 [01:14<00:00, 1.33it/s]\n100%|██████████| 100/100 [01:14<00:00, 1.33it/s]\nSaved to /content/output.mp4",
"metrics": {
"predict_time": 77.163948,
"total_time": 424.949093
},
"output": "https://replicate.delivery/pbxt/AOBIAHOqYTY6JBSySyVMhjqupzbGsXPz4rBEHsxqEiffyqiSA/output.mp4",
"started_at": "2024-03-22T03:26:42.529727Z",
"status": "succeeded",
"urls": {
"get": "https://api.replicate.com/v1/predictions/apejmclbjcm66jtv645f2boynq",
"cancel": "https://api.replicate.com/v1/predictions/apejmclbjcm66jtv645f2boynq/cancel"
},
"version": "8099e5722ba3d5f408cd3e696e6df058137056268939337a3fbe3912e86e72ad"
}Generated in
0%| | 0/100 [00:00<?, ?it/s]
1%| | 1/100 [00:00<01:24, 1.18it/s]
2%|▏ | 2/100 [00:01<01:16, 1.27it/s]
3%|▎ | 3/100 [00:02<01:14, 1.31it/s]
4%|▍ | 4/100 [00:03<01:12, 1.32it/s]
5%|▌ | 5/100 [00:03<01:11, 1.33it/s]
6%|▌ | 6/100 [00:04<01:10, 1.33it/s]
7%|▋ | 7/100 [00:05<01:09, 1.34it/s]
8%|▊ | 8/100 [00:06<01:08, 1.34it/s]
9%|▉ | 9/100 [00:06<01:08, 1.34it/s]
10%|█ | 10/100 [00:07<01:07, 1.34it/s]
11%|█ | 11/100 [00:08<01:06, 1.34it/s]
12%|█▏ | 12/100 [00:09<01:05, 1.34it/s]
13%|█▎ | 13/100 [00:09<01:04, 1.34it/s]
14%|█▍ | 14/100 [00:10<01:04, 1.34it/s]
15%|█▌ | 15/100 [00:11<01:03, 1.34it/s]
16%|█▌ | 16/100 [00:12<01:02, 1.34it/s]
17%|█▋ | 17/100 [00:12<01:01, 1.34it/s]
18%|█▊ | 18/100 [00:13<01:01, 1.34it/s]
19%|█▉ | 19/100 [00:14<01:00, 1.34it/s]
20%|██ | 20/100 [00:15<00:59, 1.34it/s]
21%|██ | 21/100 [00:15<00:58, 1.35it/s]
22%|██▏ | 22/100 [00:16<00:57, 1.35it/s]
23%|██▎ | 23/100 [00:17<00:57, 1.34it/s]
24%|██▍ | 24/100 [00:17<00:56, 1.34it/s]
25%|██▌ | 25/100 [00:18<00:55, 1.34it/s]
26%|██▌ | 26/100 [00:19<00:55, 1.34it/s]
27%|██▋ | 27/100 [00:20<00:54, 1.34it/s]
28%|██▊ | 28/100 [00:20<00:53, 1.34it/s]
29%|██▉ | 29/100 [00:21<00:52, 1.34it/s]
30%|███ | 30/100 [00:22<00:52, 1.34it/s]
31%|███ | 31/100 [00:23<00:51, 1.34it/s]
32%|███▏ | 32/100 [00:23<00:50, 1.34it/s]
33%|███▎ | 33/100 [00:24<00:49, 1.34it/s]
34%|███▍ | 34/100 [00:25<00:49, 1.34it/s]
35%|███▌ | 35/100 [00:26<00:48, 1.34it/s]
36%|███▌ | 36/100 [00:26<00:47, 1.34it/s]
37%|███▋ | 37/100 [00:27<00:47, 1.34it/s]
38%|███▊ | 38/100 [00:28<00:46, 1.34it/s]
39%|███▉ | 39/100 [00:29<00:45, 1.34it/s]
40%|████ | 40/100 [00:29<00:44, 1.34it/s]
41%|████ | 41/100 [00:30<00:44, 1.34it/s]
42%|████▏ | 42/100 [00:31<00:43, 1.34it/s]
43%|████▎ | 43/100 [00:32<00:42, 1.34it/s]
44%|████▍ | 44/100 [00:32<00:41, 1.34it/s]
45%|████▌ | 45/100 [00:33<00:41, 1.34it/s]
46%|████▌ | 46/100 [00:34<00:40, 1.34it/s]
47%|████▋ | 47/100 [00:35<00:39, 1.34it/s]
48%|████▊ | 48/100 [00:35<00:38, 1.34it/s]
49%|████▉ | 49/100 [00:36<00:38, 1.33it/s]
50%|█████ | 50/100 [00:37<00:37, 1.33it/s]
51%|█████ | 51/100 [00:38<00:36, 1.33it/s]
52%|█████▏ | 52/100 [00:38<00:35, 1.33it/s]
53%|█████▎ | 53/100 [00:39<00:35, 1.33it/s]
54%|█████▍ | 54/100 [00:40<00:34, 1.33it/s]
55%|█████▌ | 55/100 [00:41<00:33, 1.33it/s]
56%|█████▌ | 56/100 [00:41<00:33, 1.33it/s]
57%|█████▋ | 57/100 [00:42<00:32, 1.33it/s]
58%|█████▊ | 58/100 [00:43<00:31, 1.33it/s]
59%|█████▉ | 59/100 [00:44<00:30, 1.33it/s]
60%|██████ | 60/100 [00:44<00:30, 1.33it/s]
61%|██████ | 61/100 [00:45<00:29, 1.33it/s]
62%|██████▏ | 62/100 [00:46<00:28, 1.33it/s]
63%|██████▎ | 63/100 [00:47<00:27, 1.33it/s]
64%|██████▍ | 64/100 [00:47<00:27, 1.33it/s]
65%|██████▌ | 65/100 [00:48<00:26, 1.33it/s]
66%|██████▌ | 66/100 [00:49<00:25, 1.33it/s]
67%|██████▋ | 67/100 [00:50<00:24, 1.33it/s]
68%|██████▊ | 68/100 [00:50<00:24, 1.33it/s]
69%|██████▉ | 69/100 [00:51<00:23, 1.33it/s]
70%|███████ | 70/100 [00:52<00:22, 1.33it/s]
71%|███████ | 71/100 [00:53<00:21, 1.33it/s]
72%|███████▏ | 72/100 [00:53<00:21, 1.33it/s]
73%|███████▎ | 73/100 [00:54<00:20, 1.33it/s]
74%|███████▍ | 74/100 [00:55<00:19, 1.33it/s]
75%|███████▌ | 75/100 [00:56<00:18, 1.33it/s]
76%|███████▌ | 76/100 [00:56<00:18, 1.33it/s]
77%|███████▋ | 77/100 [00:57<00:17, 1.33it/s]
78%|███████▊ | 78/100 [00:58<00:16, 1.33it/s]
79%|███████▉ | 79/100 [00:59<00:15, 1.33it/s]
80%|████████ | 80/100 [00:59<00:15, 1.33it/s]
81%|████████ | 81/100 [01:00<00:14, 1.33it/s]
82%|████████▏ | 82/100 [01:01<00:13, 1.33it/s]
83%|████████▎ | 83/100 [01:02<00:12, 1.33it/s]
84%|████████▍ | 84/100 [01:02<00:12, 1.33it/s]
85%|████████▌ | 85/100 [01:03<00:11, 1.33it/s]
86%|████████▌ | 86/100 [01:04<00:10, 1.33it/s]
87%|████████▋ | 87/100 [01:05<00:09, 1.33it/s]
88%|████████▊ | 88/100 [01:05<00:09, 1.33it/s]
89%|████████▉ | 89/100 [01:06<00:08, 1.33it/s]
90%|█████████ | 90/100 [01:07<00:07, 1.33it/s]
91%|█████████ | 91/100 [01:08<00:06, 1.33it/s]
92%|█████████▏| 92/100 [01:08<00:06, 1.33it/s]
93%|█████████▎| 93/100 [01:09<00:05, 1.33it/s]
94%|█████████▍| 94/100 [01:10<00:04, 1.33it/s]
95%|█████████▌| 95/100 [01:11<00:03, 1.33it/s]
96%|█████████▌| 96/100 [01:11<00:03, 1.33it/s]
97%|█████████▋| 97/100 [01:12<00:02, 1.33it/s]
98%|█████████▊| 98/100 [01:13<00:01, 1.33it/s]
99%|█████████▉| 99/100 [01:14<00:00, 1.33it/s]
100%|██████████| 100/100 [01:14<00:00, 1.33it/s]
100%|██████████| 100/100 [01:14<00:00, 1.33it/s]
Saved to /content/output.mp4