Readme
Implementation of motexture/vseq2vseq
Usage
Increase the –times parameter to create even longer videos.
Additional info
For best results –num-frames should be 16, 24 or 32. Higher values will result in slower motion.
Text to video diffusion model with variable length frame conditioning for infinite length video
Run this model in Node.js with one line of code:
npm install replicate
REPLICATE_API_TOKEN
environment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import Replicate from "replicate";
const replicate = new Replicate({
auth: process.env.REPLICATE_API_TOKEN,
});
Run lucataco/vseq2vseq using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run(
"lucataco/vseq2vseq:13a1402f55c44835009212440ea48d1680041a7964951eb804c34188d24311e8",
{
input: {
fps: 16,
times: 8,
width: 384,
height: 192,
prompt: "A stormtrooper surfing on the ocean",
img_width: 1152,
num_steps: 30,
img_height: 640,
guidance_scale: 20,
number_of_frames: 24,
image_guidance_scale: 12
}
}
);
console.log(output);
To learn more, take a look at the guide on getting started with Node.js.
pip install replicate
REPLICATE_API_TOKEN
environment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import replicate
Run lucataco/vseq2vseq using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"lucataco/vseq2vseq:13a1402f55c44835009212440ea48d1680041a7964951eb804c34188d24311e8",
input={
"fps": 16,
"times": 8,
"width": 384,
"height": 192,
"prompt": "A stormtrooper surfing on the ocean",
"img_width": 1152,
"num_steps": 30,
"img_height": 640,
"guidance_scale": 20,
"number_of_frames": 24,
"image_guidance_scale": 12
}
)
print(output)
To learn more, take a look at the guide on getting started with Python.
REPLICATE_API_TOKEN
environment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
Run lucataco/vseq2vseq using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-H "Prefer: wait" \
-d $'{
"version": "13a1402f55c44835009212440ea48d1680041a7964951eb804c34188d24311e8",
"input": {
"fps": 16,
"times": 8,
"width": 384,
"height": 192,
"prompt": "A stormtrooper surfing on the ocean",
"img_width": 1152,
"num_steps": 30,
"img_height": 640,
"guidance_scale": 20,
"number_of_frames": 24,
"image_guidance_scale": 12
}
}' \
https://api.replicate.com/v1/predictions
To learn more, take a look at Replicate’s HTTP API reference docs.
Add a payment method to run this model.
By signing in, you agree to our
terms of service and privacy policy
{
"completed_at": "2023-11-16T22:21:29.082381Z",
"created_at": "2023-11-16T22:18:43.243648Z",
"data_removed": false,
"error": null,
"id": "7qt3ildbczf4ksvbz6hfoyfvui",
"input": {
"fps": 16,
"times": 8,
"width": 384,
"height": 192,
"prompt": "A stormtrooper surfing on the ocean",
"img_width": 1152,
"num_steps": 30,
"img_height": 640,
"guidance_scale": 20,
"number_of_frames": 24,
"image_guidance_scale": 12
},
"logs": "The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.\n0it [00:00, ?it/s]\n0it [00:00, ?it/s]\n/vseq2vseq/pipeline/pipeline.py:28: FutureWarning: Importing `DiffusionPipeline` or `ImagePipelineOutput` from diffusers.pipeline_utils is deprecated. Please import from diffusers.pipelines.pipeline_utils instead.\nfrom diffusers.pipeline_utils import DiffusionPipeline\nLoading pipeline components...: 0%| | 0/7 [00:00<?, ?it/s]\nLoading pipeline components...: 29%|██▊ | 2/7 [00:00<00:00, 7.75it/s]\nLoading pipeline components...: 43%|████▎ | 3/7 [00:00<00:01, 3.93it/s]\nLoading pipeline components...: 57%|█████▋ | 4/7 [00:01<00:01, 1.67it/s]\nLoading pipeline components...: 86%|████████▌ | 6/7 [00:01<00:00, 3.13it/s]\nLoading pipeline components...: 100%|██████████| 7/7 [00:01<00:00, 3.52it/s]\n 0%| | 0/50 [00:00<?, ?it/s]\n 2%|▏ | 1/50 [00:01<01:11, 1.46s/it]\n 6%|▌ | 3/50 [00:01<00:20, 2.27it/s]\n 10%|█ | 5/50 [00:01<00:11, 3.87it/s]\n 14%|█▍ | 7/50 [00:01<00:07, 5.39it/s]\n 18%|█▊ | 9/50 [00:02<00:06, 6.76it/s]\n 22%|██▏ | 11/50 [00:02<00:04, 7.92it/s]\n 26%|██▌ | 13/50 [00:02<00:04, 8.86it/s]\n 30%|███ | 15/50 [00:02<00:03, 9.59it/s]\n 34%|███▍ | 17/50 [00:02<00:03, 10.15it/s]\n 38%|███▊ | 19/50 [00:03<00:02, 10.57it/s]\n 42%|████▏ | 21/50 [00:03<00:02, 10.87it/s]\n 46%|████▌ | 23/50 [00:03<00:02, 11.09it/s]\n 50%|█████ | 25/50 [00:03<00:02, 11.25it/s]\n 54%|█████▍ | 27/50 [00:03<00:02, 11.36it/s]\n 58%|█████▊ | 29/50 [00:03<00:01, 11.43it/s]\n 62%|██████▏ | 31/50 [00:04<00:01, 11.49it/s]\n 66%|██████▌ | 33/50 [00:04<00:01, 11.53it/s]\n 70%|███████ | 35/50 [00:04<00:01, 11.56it/s]\n 74%|███████▍ | 37/50 [00:04<00:01, 11.58it/s]\n 78%|███████▊ | 39/50 [00:04<00:00, 11.59it/s]\n 82%|████████▏ | 41/50 [00:04<00:00, 11.59it/s]\n 86%|████████▌ | 43/50 [00:05<00:00, 11.60it/s]\n 90%|█████████ | 45/50 [00:05<00:00, 11.60it/s]\n 94%|█████████▍| 47/50 [00:05<00:00, 11.60it/s]\n 98%|█████████▊| 49/50 [00:05<00:00, 11.61it/s]\n100%|██████████| 50/50 [00:05<00:00, 8.81it/s]\nThe model has 2,333,275,464 trainable parameters\nLoading pipeline components...: 0%| | 0/5 [00:00<?, ?it/s]\nLoading pipeline components...: 100%|██████████| 5/5 [00:00<00:00, 12557.80it/s]\n49 Attention layers using Scaled Dot Product Attention.\n/root/.pyenv/versions/3.10.13/lib/python3.10/site-packages/diffusers/pipelines/text_to_video_synthesis/pipeline_text_to_video_synth.py:163: FutureWarning: `_encode_prompt()` is deprecated and it will be removed in a future version. Use `encode_prompt()` instead. Also, be aware that the output format changed from a concatenated tensor to a tuple.\ndeprecate(\"_encode_prompt()\", \"1.0.0\", deprecation_message, standard_warn=False)\nEncoding to latents...: 0%| | 0.00/1.00 [00:00<?, ?frame/s]\nEncoding to latents...: 100%|██████████| 1.00/1.00 [00:00<00:00, 22.5frame/s]\n 0%| | 0/30 [00:00<?, ?it/s]\n 3%|▎ | 1/30 [00:00<00:09, 3.09it/s]\n 7%|▋ | 2/30 [00:00<00:08, 3.24it/s]\n 10%|█ | 3/30 [00:00<00:08, 3.30it/s]\n 13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]\n 17%|█▋ | 5/30 [00:01<00:07, 3.33it/s]\n 20%|██ | 6/30 [00:01<00:07, 3.34it/s]\n 23%|██▎ | 7/30 [00:02<00:06, 3.35it/s]\n 27%|██▋ | 8/30 [00:02<00:06, 3.35it/s]\n 30%|███ | 9/30 [00:02<00:06, 3.35it/s]\n 33%|███▎ | 10/30 [00:03<00:05, 3.35it/s]\n 37%|███▋ | 11/30 [00:03<00:05, 3.36it/s]\n 40%|████ | 12/30 [00:03<00:05, 3.36it/s]\n 43%|████▎ | 13/30 [00:03<00:05, 3.36it/s]\n 47%|████▋ | 14/30 [00:04<00:04, 3.36it/s]\n 50%|█████ | 15/30 [00:04<00:04, 3.36it/s]\n 53%|█████▎ | 16/30 [00:04<00:04, 3.36it/s]\n 57%|█████▋ | 17/30 [00:05<00:03, 3.36it/s]\n 60%|██████ | 18/30 [00:05<00:03, 3.36it/s]\n 63%|██████▎ | 19/30 [00:05<00:03, 3.36it/s]\n 67%|██████▋ | 20/30 [00:05<00:02, 3.36it/s]\n 70%|███████ | 21/30 [00:06<00:02, 3.36it/s]\n 73%|███████▎ | 22/30 [00:06<00:02, 3.36it/s]\n 77%|███████▋ | 23/30 [00:06<00:02, 3.35it/s]\n 80%|████████ | 24/30 [00:07<00:01, 3.35it/s]\n 83%|████████▎ | 25/30 [00:07<00:01, 3.35it/s]\n 87%|████████▋ | 26/30 [00:07<00:01, 3.36it/s]\n 90%|█████████ | 27/30 [00:08<00:00, 3.36it/s]\n 93%|█████████▎| 28/30 [00:08<00:00, 3.36it/s]\n 97%|█████████▋| 29/30 [00:08<00:00, 3.36it/s]\n100%|██████████| 30/30 [00:08<00:00, 3.36it/s]\n100%|██████████| 30/30 [00:08<00:00, 3.35it/s]\n 0%| | 0/30 [00:00<?, ?it/s]\n 3%|▎ | 1/30 [00:00<00:08, 3.31it/s]\n 7%|▋ | 2/30 [00:00<00:08, 3.32it/s]\n 10%|█ | 3/30 [00:00<00:08, 3.32it/s]\n 13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]\n 17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]\n 20%|██ | 6/30 [00:01<00:07, 3.33it/s]\n 23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]\n 27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]\n 30%|███ | 9/30 [00:02<00:06, 3.33it/s]\n 33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]\n 37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]\n 40%|████ | 12/30 [00:03<00:05, 3.33it/s]\n 43%|████▎ | 13/30 [00:03<00:05, 3.33it/s]\n 47%|████▋ | 14/30 [00:04<00:04, 3.33it/s]\n 50%|█████ | 15/30 [00:04<00:04, 3.33it/s]\n 53%|█████▎ | 16/30 [00:04<00:04, 3.33it/s]\n 57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]\n 60%|██████ | 18/30 [00:05<00:03, 3.33it/s]\n 63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]\n 67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]\n 70%|███████ | 21/30 [00:06<00:02, 3.33it/s]\n 73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]\n 77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]\n 80%|████████ | 24/30 [00:07<00:01, 3.33it/s]\n 83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]\n 87%|████████▋ | 26/30 [00:07<00:01, 3.33it/s]\n 90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]\n 93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]\n 97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.33it/s]\n 0%| | 0/30 [00:00<?, ?it/s]\n 3%|▎ | 1/30 [00:00<00:08, 3.33it/s]\n 7%|▋ | 2/30 [00:00<00:08, 3.33it/s]\n 10%|█ | 3/30 [00:00<00:08, 3.32it/s]\n 13%|█▎ | 4/30 [00:01<00:07, 3.33it/s]\n 17%|█▋ | 5/30 [00:01<00:07, 3.33it/s]\n 20%|██ | 6/30 [00:01<00:07, 3.33it/s]\n 23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]\n 27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]\n 30%|███ | 9/30 [00:02<00:06, 3.33it/s]\n 33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]\n 37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]\n 40%|████ | 12/30 [00:03<00:05, 3.33it/s]\n 43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]\n 47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]\n 50%|█████ | 15/30 [00:04<00:04, 3.33it/s]\n 53%|█████▎ | 16/30 [00:04<00:04, 3.33it/s]\n 57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]\n 60%|██████ | 18/30 [00:05<00:03, 3.33it/s]\n 63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]\n 67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]\n 70%|███████ | 21/30 [00:06<00:02, 3.33it/s]\n 73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]\n 77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]\n 80%|████████ | 24/30 [00:07<00:01, 3.33it/s]\n 83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]\n 87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]\n 90%|█████████ | 27/30 [00:08<00:00, 3.33it/s]\n 93%|█████████▎| 28/30 [00:08<00:00, 3.33it/s]\n 97%|█████████▋| 29/30 [00:08<00:00, 3.33it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.33it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.33it/s]\n 0%| | 0/30 [00:00<?, ?it/s]\n 3%|▎ | 1/30 [00:00<00:08, 3.33it/s]\n 7%|▋ | 2/30 [00:00<00:08, 3.32it/s]\n 10%|█ | 3/30 [00:00<00:08, 3.32it/s]\n 13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]\n 17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]\n 20%|██ | 6/30 [00:01<00:07, 3.32it/s]\n 23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]\n 27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]\n 30%|███ | 9/30 [00:02<00:06, 3.33it/s]\n 33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]\n 37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]\n 40%|████ | 12/30 [00:03<00:05, 3.33it/s]\n 43%|████▎ | 13/30 [00:03<00:05, 3.33it/s]\n 47%|████▋ | 14/30 [00:04<00:04, 3.33it/s]\n 50%|█████ | 15/30 [00:04<00:04, 3.32it/s]\n 53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]\n 57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]\n 60%|██████ | 18/30 [00:05<00:03, 3.33it/s]\n 63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]\n 67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]\n 70%|███████ | 21/30 [00:06<00:02, 3.33it/s]\n 73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]\n 77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]\n 80%|████████ | 24/30 [00:07<00:01, 3.33it/s]\n 83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]\n 87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]\n 90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]\n 93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]\n 97%|█████████▋| 29/30 [00:08<00:00, 3.33it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.33it/s]\n 0%| | 0/30 [00:00<?, ?it/s]\n 3%|▎ | 1/30 [00:00<00:08, 3.33it/s]\n 7%|▋ | 2/30 [00:00<00:08, 3.32it/s]\n 10%|█ | 3/30 [00:00<00:08, 3.32it/s]\n 13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]\n 17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]\n 20%|██ | 6/30 [00:01<00:07, 3.32it/s]\n 23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]\n 27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]\n 30%|███ | 9/30 [00:02<00:06, 3.32it/s]\n 33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]\n 37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]\n 40%|████ | 12/30 [00:03<00:05, 3.32it/s]\n 43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]\n 47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]\n 50%|█████ | 15/30 [00:04<00:04, 3.32it/s]\n 53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]\n 57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]\n 60%|██████ | 18/30 [00:05<00:03, 3.32it/s]\n 63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]\n 67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]\n 70%|███████ | 21/30 [00:06<00:02, 3.32it/s]\n 73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]\n 77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]\n 80%|████████ | 24/30 [00:07<00:01, 3.32it/s]\n 83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]\n 87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]\n 90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]\n 93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]\n 97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n 0%| | 0/30 [00:00<?, ?it/s]\n 3%|▎ | 1/30 [00:00<00:08, 3.32it/s]\n 7%|▋ | 2/30 [00:00<00:08, 3.33it/s]\n 10%|█ | 3/30 [00:00<00:08, 3.32it/s]\n 13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]\n 17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]\n 20%|██ | 6/30 [00:01<00:07, 3.32it/s]\n 23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]\n 27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]\n 30%|███ | 9/30 [00:02<00:06, 3.32it/s]\n 33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]\n 37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]\n 40%|████ | 12/30 [00:03<00:05, 3.32it/s]\n 43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]\n 47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]\n 50%|█████ | 15/30 [00:04<00:04, 3.32it/s]\n 53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]\n 57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]\n 60%|██████ | 18/30 [00:05<00:03, 3.32it/s]\n 63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]\n 67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]\n 70%|███████ | 21/30 [00:06<00:02, 3.32it/s]\n 73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]\n 77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]\n 80%|████████ | 24/30 [00:07<00:01, 3.32it/s]\n 83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]\n 87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]\n 90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]\n 93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]\n 97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n 0%| | 0/30 [00:00<?, ?it/s]\n 3%|▎ | 1/30 [00:00<00:08, 3.32it/s]\n 7%|▋ | 2/30 [00:00<00:08, 3.32it/s]\n 10%|█ | 3/30 [00:00<00:08, 3.32it/s]\n 13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]\n 17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]\n 20%|██ | 6/30 [00:01<00:07, 3.32it/s]\n 23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]\n 27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]\n 30%|███ | 9/30 [00:02<00:06, 3.32it/s]\n 33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]\n 37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]\n 40%|████ | 12/30 [00:03<00:05, 3.32it/s]\n 43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]\n 47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]\n 50%|█████ | 15/30 [00:04<00:04, 3.32it/s]\n 53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]\n 57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]\n 60%|██████ | 18/30 [00:05<00:03, 3.32it/s]\n 63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]\n 67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]\n 70%|███████ | 21/30 [00:06<00:02, 3.32it/s]\n 73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]\n 77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]\n 80%|████████ | 24/30 [00:07<00:01, 3.32it/s]\n 83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]\n 87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]\n 90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]\n 93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]\n 97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n 0%| | 0/30 [00:00<?, ?it/s]\n 3%|▎ | 1/30 [00:00<00:08, 3.32it/s]\n 7%|▋ | 2/30 [00:00<00:08, 3.32it/s]\n 10%|█ | 3/30 [00:00<00:08, 3.32it/s]\n 13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]\n 17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]\n 20%|██ | 6/30 [00:01<00:07, 3.32it/s]\n 23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]\n 27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]\n 30%|███ | 9/30 [00:02<00:06, 3.32it/s]\n 33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]\n 37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]\n 40%|████ | 12/30 [00:03<00:05, 3.32it/s]\n 43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]\n 47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]\n 50%|█████ | 15/30 [00:04<00:04, 3.32it/s]\n 53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]\n 57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]\n 60%|██████ | 18/30 [00:05<00:03, 3.32it/s]\n 63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]\n 67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]\n 70%|███████ | 21/30 [00:06<00:02, 3.32it/s]\n 73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]\n 77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]\n 80%|████████ | 24/30 [00:07<00:01, 3.32it/s]\n 83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]\n 87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]\n 90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]\n 93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]\n 97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\n100%|██████████| 30/30 [00:09<00:00, 3.32it/s]\nDecoding to pixels...: 0%| | 0/192 [00:00<?, ?frame/s]\nDecoding to pixels...: 12%|█▎ | 24/192 [00:00<00:02, 70.65frame/s]\nDecoding to pixels...: 25%|██▌ | 48/192 [00:00<00:01, 72.25frame/s]\nDecoding to pixels...: 38%|███▊ | 72/192 [00:00<00:01, 73.05frame/s]\nDecoding to pixels...: 50%|█████ | 96/192 [00:01<00:01, 73.43frame/s]\nDecoding to pixels...: 62%|██████▎ | 120/192 [00:01<00:00, 73.42frame/s]\nDecoding to pixels...: 75%|███████▌ | 144/192 [00:01<00:00, 73.43frame/s]\nDecoding to pixels...: 88%|████████▊ | 168/192 [00:02<00:00, 73.62frame/s]\nDecoding to pixels...: 100%|██████████| 192/192 [00:02<00:00, 73.75frame/s]\nDecoding to pixels...: 100%|██████████| 192/192 [00:02<00:00, 73.36frame/s]\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil 56. 70.100 / 56. 70.100\nlibavcodec 58.134.100 / 58.134.100\nlibavformat 58. 76.100 / 58. 76.100\nlibavdevice 58. 13.100 / 58. 13.100\nlibavfilter 7.110.100 / 7.110.100\nlibswscale 5. 9.100 / 5. 9.100\nlibswresample 3. 9.100 / 3. 9.100\nlibpostproc 55. 9.100 / 55. 9.100\nInput #0, mov,mp4,m4a,3gp,3g2,mj2, from './output/A stormtrooper surfing on the ocean-a94b04b1.mp4':\nMetadata:\nmajor_brand : isom\nminor_version : 512\ncompatible_brands: isomiso2mp41\nencoder : Lavf59.27.100\nDuration: 00:00:12.00, start: 0.000000, bitrate: 1787 kb/s\nStream #0:0(und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 384x192 [SAR 1:1 DAR 2:1], 1786 kb/s, 16 fps, 16 tbr, 16384 tbn, 16 tbc (default)\nMetadata:\nhandler_name : VideoHandler\nvendor_id : [0][0][0][0]\nCodec AVOption b (set bitrate (in bits/s)) specified for output file #0 (./output/A stormtrooper surfing on the ocean-vseq2vseq-a94b04b1_encoded.mp4) has not been used for any stream. The most likely reason is either wrong type (e.g. a video option with no video streams) or that it is a private option of some encoder which was not actually used for any stream.\nStream mapping:\nStream #0:0 -> #0:0 (mpeg4 (native) -> h264 (libx264))\nPress [q] to stop, [?] for help\n[libx264 @ 0x558de96b7c00] using SAR=1/1\n[libx264 @ 0x558de96b7c00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512\n[libx264 @ 0x558de96b7c00] profile High, level 1.2, 4:2:0, 8-bit\n[libx264 @ 0x558de96b7c00] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=2 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=6 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=1 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=30 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to './output/A stormtrooper surfing on the ocean-vseq2vseq-a94b04b1_encoded.mp4':\nMetadata:\nmajor_brand : isom\nminor_version : 512\ncompatible_brands: isomiso2mp41\nencoder : Lavf58.76.100\nStream #0:0(und): Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 384x192 [SAR 1:1 DAR 2:1], q=2-31, 16 fps, 16384 tbn (default)\nMetadata:\nhandler_name : VideoHandler\nvendor_id : [0][0][0][0]\nencoder : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nframe= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\n[mp4 @ 0x558de96b9080] Starting second pass: moving the moov atom to the beginning of the file\nframe= 192 fps=0.0 q=-1.0 Lsize= 1228kB time=00:00:11.81 bitrate= 851.6kbits/s speed=32.5x\nvideo:1225kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.252901%\n[libx264 @ 0x558de96b7c00] frame I:5 Avg QP:23.87 size: 10294\n[libx264 @ 0x558de96b7c00] frame P:48 Avg QP:26.31 size: 8452\n[libx264 @ 0x558de96b7c00] frame B:139 Avg QP:27.31 size: 5729\n[libx264 @ 0x558de96b7c00] consecutive B-frames: 2.6% 0.0% 7.8% 89.6%\n[libx264 @ 0x558de96b7c00] mb I I16..4: 4.4% 89.8% 5.8%\n[libx264 @ 0x558de96b7c00] mb P I16..4: 1.2% 59.6% 5.0% P16..4: 12.4% 14.8% 6.7% 0.0% 0.0% skip: 0.3%\n[libx264 @ 0x558de96b7c00] mb B I16..4: 1.1% 28.3% 5.1% B16..8: 25.4% 21.1% 5.8% direct:10.7% skip: 2.5% L0:28.1% L1:19.0% BI:52.9%\n[libx264 @ 0x558de96b7c00] 8x8 transform intra:85.6% inter:52.5%\n[libx264 @ 0x558de96b7c00] coded y,uvDC,uvAC intra: 96.5% 75.8% 24.1% inter: 67.4% 38.8% 1.6%\n[libx264 @ 0x558de96b7c00] i16 v,h,dc,p: 0% 48% 9% 43%\n[libx264 @ 0x558de96b7c00] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 2% 43% 21% 4% 3% 1% 7% 2% 16%\n[libx264 @ 0x558de96b7c00] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 5% 39% 11% 6% 5% 4% 9% 4% 16%\n[libx264 @ 0x558de96b7c00] i8c dc,h,v,p: 39% 49% 6% 7%\n[libx264 @ 0x558de96b7c00] Weighted P-Frames: Y:2.1% UV:0.0%\n[libx264 @ 0x558de96b7c00] ref P L0: 71.6% 28.4%\n[libx264 @ 0x558de96b7c00] ref B L0: 92.8% 7.2%\n[libx264 @ 0x558de96b7c00] ref B L1: 98.2% 1.8%\n[libx264 @ 0x558de96b7c00] kb/s:835.71\n/src/output/A stormtrooper surfing on the ocean-vseq2vseq-06cd5f60_encoded.mp4",
"metrics": {
"predict_time": 101.858643,
"total_time": 165.838733
},
"output": "https://replicate.delivery/pbxt/JySsfZLnXKWf1En1XJFL5dqS8XyngB5VIpkdfMJd8HVQfRkHB/A%20stormtrooper%20surfing%20on%20the%20ocean-vseq2vseq-06cd5f60_encoded.mp4",
"started_at": "2023-11-16T22:19:47.223738Z",
"status": "succeeded",
"urls": {
"get": "https://api.replicate.com/v1/predictions/7qt3ildbczf4ksvbz6hfoyfvui",
"cancel": "https://api.replicate.com/v1/predictions/7qt3ildbczf4ksvbz6hfoyfvui/cancel"
},
"version": "76d6ba451b4de6da612f34ac8e8e4ea5e5dc7299829352d2d36e3cceb2cb0d89"
}
The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.
0it [00:00, ?it/s]
0it [00:00, ?it/s]
/vseq2vseq/pipeline/pipeline.py:28: FutureWarning: Importing `DiffusionPipeline` or `ImagePipelineOutput` from diffusers.pipeline_utils is deprecated. Please import from diffusers.pipelines.pipeline_utils instead.
from diffusers.pipeline_utils import DiffusionPipeline
Loading pipeline components...: 0%| | 0/7 [00:00<?, ?it/s]
Loading pipeline components...: 29%|██▊ | 2/7 [00:00<00:00, 7.75it/s]
Loading pipeline components...: 43%|████▎ | 3/7 [00:00<00:01, 3.93it/s]
Loading pipeline components...: 57%|█████▋ | 4/7 [00:01<00:01, 1.67it/s]
Loading pipeline components...: 86%|████████▌ | 6/7 [00:01<00:00, 3.13it/s]
Loading pipeline components...: 100%|██████████| 7/7 [00:01<00:00, 3.52it/s]
0%| | 0/50 [00:00<?, ?it/s]
2%|▏ | 1/50 [00:01<01:11, 1.46s/it]
6%|▌ | 3/50 [00:01<00:20, 2.27it/s]
10%|█ | 5/50 [00:01<00:11, 3.87it/s]
14%|█▍ | 7/50 [00:01<00:07, 5.39it/s]
18%|█▊ | 9/50 [00:02<00:06, 6.76it/s]
22%|██▏ | 11/50 [00:02<00:04, 7.92it/s]
26%|██▌ | 13/50 [00:02<00:04, 8.86it/s]
30%|███ | 15/50 [00:02<00:03, 9.59it/s]
34%|███▍ | 17/50 [00:02<00:03, 10.15it/s]
38%|███▊ | 19/50 [00:03<00:02, 10.57it/s]
42%|████▏ | 21/50 [00:03<00:02, 10.87it/s]
46%|████▌ | 23/50 [00:03<00:02, 11.09it/s]
50%|█████ | 25/50 [00:03<00:02, 11.25it/s]
54%|█████▍ | 27/50 [00:03<00:02, 11.36it/s]
58%|█████▊ | 29/50 [00:03<00:01, 11.43it/s]
62%|██████▏ | 31/50 [00:04<00:01, 11.49it/s]
66%|██████▌ | 33/50 [00:04<00:01, 11.53it/s]
70%|███████ | 35/50 [00:04<00:01, 11.56it/s]
74%|███████▍ | 37/50 [00:04<00:01, 11.58it/s]
78%|███████▊ | 39/50 [00:04<00:00, 11.59it/s]
82%|████████▏ | 41/50 [00:04<00:00, 11.59it/s]
86%|████████▌ | 43/50 [00:05<00:00, 11.60it/s]
90%|█████████ | 45/50 [00:05<00:00, 11.60it/s]
94%|█████████▍| 47/50 [00:05<00:00, 11.60it/s]
98%|█████████▊| 49/50 [00:05<00:00, 11.61it/s]
100%|██████████| 50/50 [00:05<00:00, 8.81it/s]
The model has 2,333,275,464 trainable parameters
Loading pipeline components...: 0%| | 0/5 [00:00<?, ?it/s]
Loading pipeline components...: 100%|██████████| 5/5 [00:00<00:00, 12557.80it/s]
49 Attention layers using Scaled Dot Product Attention.
/root/.pyenv/versions/3.10.13/lib/python3.10/site-packages/diffusers/pipelines/text_to_video_synthesis/pipeline_text_to_video_synth.py:163: FutureWarning: `_encode_prompt()` is deprecated and it will be removed in a future version. Use `encode_prompt()` instead. Also, be aware that the output format changed from a concatenated tensor to a tuple.
deprecate("_encode_prompt()", "1.0.0", deprecation_message, standard_warn=False)
Encoding to latents...: 0%| | 0.00/1.00 [00:00<?, ?frame/s]
Encoding to latents...: 100%|██████████| 1.00/1.00 [00:00<00:00, 22.5frame/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:09, 3.09it/s]
7%|▋ | 2/30 [00:00<00:08, 3.24it/s]
10%|█ | 3/30 [00:00<00:08, 3.30it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.33it/s]
20%|██ | 6/30 [00:01<00:07, 3.34it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.35it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.35it/s]
30%|███ | 9/30 [00:02<00:06, 3.35it/s]
33%|███▎ | 10/30 [00:03<00:05, 3.35it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.36it/s]
40%|████ | 12/30 [00:03<00:05, 3.36it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.36it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.36it/s]
50%|█████ | 15/30 [00:04<00:04, 3.36it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.36it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.36it/s]
60%|██████ | 18/30 [00:05<00:03, 3.36it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.36it/s]
67%|██████▋ | 20/30 [00:05<00:02, 3.36it/s]
70%|███████ | 21/30 [00:06<00:02, 3.36it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.36it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.35it/s]
80%|████████ | 24/30 [00:07<00:01, 3.35it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.35it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.36it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.36it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.36it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.36it/s]
100%|██████████| 30/30 [00:08<00:00, 3.36it/s]
100%|██████████| 30/30 [00:08<00:00, 3.35it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.31it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.33it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]
30%|███ | 9/30 [00:02<00:06, 3.33it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]
40%|████ | 12/30 [00:03<00:05, 3.33it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.33it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.33it/s]
50%|█████ | 15/30 [00:04<00:04, 3.33it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.33it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]
60%|██████ | 18/30 [00:05<00:03, 3.33it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]
70%|███████ | 21/30 [00:06<00:02, 3.33it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]
80%|████████ | 24/30 [00:07<00:01, 3.33it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.33it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.33it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.33it/s]
7%|▋ | 2/30 [00:00<00:08, 3.33it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.33it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.33it/s]
20%|██ | 6/30 [00:01<00:07, 3.33it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]
30%|███ | 9/30 [00:02<00:06, 3.33it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]
40%|████ | 12/30 [00:03<00:05, 3.33it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.33it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.33it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]
60%|██████ | 18/30 [00:05<00:03, 3.33it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]
70%|███████ | 21/30 [00:06<00:02, 3.33it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]
80%|████████ | 24/30 [00:07<00:01, 3.33it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.33it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.33it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.33it/s]
100%|██████████| 30/30 [00:09<00:00, 3.33it/s]
100%|██████████| 30/30 [00:09<00:00, 3.33it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.33it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]
30%|███ | 9/30 [00:02<00:06, 3.33it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]
40%|████ | 12/30 [00:03<00:05, 3.33it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.33it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.33it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]
60%|██████ | 18/30 [00:05<00:03, 3.33it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]
70%|███████ | 21/30 [00:06<00:02, 3.33it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]
80%|████████ | 24/30 [00:07<00:01, 3.33it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.33it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.33it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.33it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]
30%|███ | 9/30 [00:02<00:06, 3.32it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]
40%|████ | 12/30 [00:03<00:05, 3.32it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]
60%|██████ | 18/30 [00:05<00:03, 3.32it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]
70%|███████ | 21/30 [00:06<00:02, 3.32it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]
80%|████████ | 24/30 [00:07<00:01, 3.32it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.32it/s]
7%|▋ | 2/30 [00:00<00:08, 3.33it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]
30%|███ | 9/30 [00:02<00:06, 3.32it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]
40%|████ | 12/30 [00:03<00:05, 3.32it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]
60%|██████ | 18/30 [00:05<00:03, 3.32it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]
70%|███████ | 21/30 [00:06<00:02, 3.32it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]
80%|████████ | 24/30 [00:07<00:01, 3.32it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.32it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]
30%|███ | 9/30 [00:02<00:06, 3.32it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]
40%|████ | 12/30 [00:03<00:05, 3.32it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]
60%|██████ | 18/30 [00:05<00:03, 3.32it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]
70%|███████ | 21/30 [00:06<00:02, 3.32it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]
80%|████████ | 24/30 [00:07<00:01, 3.32it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.32it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]
30%|███ | 9/30 [00:02<00:06, 3.32it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]
40%|████ | 12/30 [00:03<00:05, 3.32it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]
60%|██████ | 18/30 [00:05<00:03, 3.32it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]
70%|███████ | 21/30 [00:06<00:02, 3.32it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]
80%|████████ | 24/30 [00:07<00:01, 3.32it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
Decoding to pixels...: 0%| | 0/192 [00:00<?, ?frame/s]
Decoding to pixels...: 12%|█▎ | 24/192 [00:00<00:02, 70.65frame/s]
Decoding to pixels...: 25%|██▌ | 48/192 [00:00<00:01, 72.25frame/s]
Decoding to pixels...: 38%|███▊ | 72/192 [00:00<00:01, 73.05frame/s]
Decoding to pixels...: 50%|█████ | 96/192 [00:01<00:01, 73.43frame/s]
Decoding to pixels...: 62%|██████▎ | 120/192 [00:01<00:00, 73.42frame/s]
Decoding to pixels...: 75%|███████▌ | 144/192 [00:01<00:00, 73.43frame/s]
Decoding to pixels...: 88%|████████▊ | 168/192 [00:02<00:00, 73.62frame/s]
Decoding to pixels...: 100%|██████████| 192/192 [00:02<00:00, 73.75frame/s]
Decoding to pixels...: 100%|██████████| 192/192 [00:02<00:00, 73.36frame/s]
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil 56. 70.100 / 56. 70.100
libavcodec 58.134.100 / 58.134.100
libavformat 58. 76.100 / 58. 76.100
libavdevice 58. 13.100 / 58. 13.100
libavfilter 7.110.100 / 7.110.100
libswscale 5. 9.100 / 5. 9.100
libswresample 3. 9.100 / 3. 9.100
libpostproc 55. 9.100 / 55. 9.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from './output/A stormtrooper surfing on the ocean-a94b04b1.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2mp41
encoder : Lavf59.27.100
Duration: 00:00:12.00, start: 0.000000, bitrate: 1787 kb/s
Stream #0:0(und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 384x192 [SAR 1:1 DAR 2:1], 1786 kb/s, 16 fps, 16 tbr, 16384 tbn, 16 tbc (default)
Metadata:
handler_name : VideoHandler
vendor_id : [0][0][0][0]
Codec AVOption b (set bitrate (in bits/s)) specified for output file #0 (./output/A stormtrooper surfing on the ocean-vseq2vseq-a94b04b1_encoded.mp4) has not been used for any stream. The most likely reason is either wrong type (e.g. a video option with no video streams) or that it is a private option of some encoder which was not actually used for any stream.
Stream mapping:
Stream #0:0 -> #0:0 (mpeg4 (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 0x558de96b7c00] using SAR=1/1
[libx264 @ 0x558de96b7c00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512
[libx264 @ 0x558de96b7c00] profile High, level 1.2, 4:2:0, 8-bit
[libx264 @ 0x558de96b7c00] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=2 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=6 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=1 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=30 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to './output/A stormtrooper surfing on the ocean-vseq2vseq-a94b04b1_encoded.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2mp41
encoder : Lavf58.76.100
Stream #0:0(und): Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 384x192 [SAR 1:1 DAR 2:1], q=2-31, 16 fps, 16384 tbn (default)
Metadata:
handler_name : VideoHandler
vendor_id : [0][0][0][0]
encoder : Lavc58.134.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x
[mp4 @ 0x558de96b9080] Starting second pass: moving the moov atom to the beginning of the file
frame= 192 fps=0.0 q=-1.0 Lsize= 1228kB time=00:00:11.81 bitrate= 851.6kbits/s speed=32.5x
video:1225kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.252901%
[libx264 @ 0x558de96b7c00] frame I:5 Avg QP:23.87 size: 10294
[libx264 @ 0x558de96b7c00] frame P:48 Avg QP:26.31 size: 8452
[libx264 @ 0x558de96b7c00] frame B:139 Avg QP:27.31 size: 5729
[libx264 @ 0x558de96b7c00] consecutive B-frames: 2.6% 0.0% 7.8% 89.6%
[libx264 @ 0x558de96b7c00] mb I I16..4: 4.4% 89.8% 5.8%
[libx264 @ 0x558de96b7c00] mb P I16..4: 1.2% 59.6% 5.0% P16..4: 12.4% 14.8% 6.7% 0.0% 0.0% skip: 0.3%
[libx264 @ 0x558de96b7c00] mb B I16..4: 1.1% 28.3% 5.1% B16..8: 25.4% 21.1% 5.8% direct:10.7% skip: 2.5% L0:28.1% L1:19.0% BI:52.9%
[libx264 @ 0x558de96b7c00] 8x8 transform intra:85.6% inter:52.5%
[libx264 @ 0x558de96b7c00] coded y,uvDC,uvAC intra: 96.5% 75.8% 24.1% inter: 67.4% 38.8% 1.6%
[libx264 @ 0x558de96b7c00] i16 v,h,dc,p: 0% 48% 9% 43%
[libx264 @ 0x558de96b7c00] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 2% 43% 21% 4% 3% 1% 7% 2% 16%
[libx264 @ 0x558de96b7c00] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 5% 39% 11% 6% 5% 4% 9% 4% 16%
[libx264 @ 0x558de96b7c00] i8c dc,h,v,p: 39% 49% 6% 7%
[libx264 @ 0x558de96b7c00] Weighted P-Frames: Y:2.1% UV:0.0%
[libx264 @ 0x558de96b7c00] ref P L0: 71.6% 28.4%
[libx264 @ 0x558de96b7c00] ref B L0: 92.8% 7.2%
[libx264 @ 0x558de96b7c00] ref B L1: 98.2% 1.8%
[libx264 @ 0x558de96b7c00] kb/s:835.71
/src/output/A stormtrooper surfing on the ocean-vseq2vseq-06cd5f60_encoded.mp4
This example was created by a different version, lucataco/vseq2vseq:76d6ba45.
This model costs approximately $0.28 to run on Replicate, or 3 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.
This model runs on Nvidia A100 (80GB) GPU hardware. Predictions typically complete within 4 minutes. The predict time for this model varies significantly based on the inputs.
Implementation of motexture/vseq2vseq
Increase the –times parameter to create even longer videos.
For best results –num-frames should be 16, 24 or 32. Higher values will result in slower motion.
This model is cold. You'll get a fast response if the model is warm and already running, and a slower response if the model is cold and starting up.
The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.
0it [00:00, ?it/s]
0it [00:00, ?it/s]
/vseq2vseq/pipeline/pipeline.py:28: FutureWarning: Importing `DiffusionPipeline` or `ImagePipelineOutput` from diffusers.pipeline_utils is deprecated. Please import from diffusers.pipelines.pipeline_utils instead.
from diffusers.pipeline_utils import DiffusionPipeline
Loading pipeline components...: 0%| | 0/7 [00:00<?, ?it/s]
Loading pipeline components...: 29%|██▊ | 2/7 [00:00<00:00, 7.75it/s]
Loading pipeline components...: 43%|████▎ | 3/7 [00:00<00:01, 3.93it/s]
Loading pipeline components...: 57%|█████▋ | 4/7 [00:01<00:01, 1.67it/s]
Loading pipeline components...: 86%|████████▌ | 6/7 [00:01<00:00, 3.13it/s]
Loading pipeline components...: 100%|██████████| 7/7 [00:01<00:00, 3.52it/s]
0%| | 0/50 [00:00<?, ?it/s]
2%|▏ | 1/50 [00:01<01:11, 1.46s/it]
6%|▌ | 3/50 [00:01<00:20, 2.27it/s]
10%|█ | 5/50 [00:01<00:11, 3.87it/s]
14%|█▍ | 7/50 [00:01<00:07, 5.39it/s]
18%|█▊ | 9/50 [00:02<00:06, 6.76it/s]
22%|██▏ | 11/50 [00:02<00:04, 7.92it/s]
26%|██▌ | 13/50 [00:02<00:04, 8.86it/s]
30%|███ | 15/50 [00:02<00:03, 9.59it/s]
34%|███▍ | 17/50 [00:02<00:03, 10.15it/s]
38%|███▊ | 19/50 [00:03<00:02, 10.57it/s]
42%|████▏ | 21/50 [00:03<00:02, 10.87it/s]
46%|████▌ | 23/50 [00:03<00:02, 11.09it/s]
50%|█████ | 25/50 [00:03<00:02, 11.25it/s]
54%|█████▍ | 27/50 [00:03<00:02, 11.36it/s]
58%|█████▊ | 29/50 [00:03<00:01, 11.43it/s]
62%|██████▏ | 31/50 [00:04<00:01, 11.49it/s]
66%|██████▌ | 33/50 [00:04<00:01, 11.53it/s]
70%|███████ | 35/50 [00:04<00:01, 11.56it/s]
74%|███████▍ | 37/50 [00:04<00:01, 11.58it/s]
78%|███████▊ | 39/50 [00:04<00:00, 11.59it/s]
82%|████████▏ | 41/50 [00:04<00:00, 11.59it/s]
86%|████████▌ | 43/50 [00:05<00:00, 11.60it/s]
90%|█████████ | 45/50 [00:05<00:00, 11.60it/s]
94%|█████████▍| 47/50 [00:05<00:00, 11.60it/s]
98%|█████████▊| 49/50 [00:05<00:00, 11.61it/s]
100%|██████████| 50/50 [00:05<00:00, 8.81it/s]
The model has 2,333,275,464 trainable parameters
Loading pipeline components...: 0%| | 0/5 [00:00<?, ?it/s]
Loading pipeline components...: 100%|██████████| 5/5 [00:00<00:00, 12557.80it/s]
49 Attention layers using Scaled Dot Product Attention.
/root/.pyenv/versions/3.10.13/lib/python3.10/site-packages/diffusers/pipelines/text_to_video_synthesis/pipeline_text_to_video_synth.py:163: FutureWarning: `_encode_prompt()` is deprecated and it will be removed in a future version. Use `encode_prompt()` instead. Also, be aware that the output format changed from a concatenated tensor to a tuple.
deprecate("_encode_prompt()", "1.0.0", deprecation_message, standard_warn=False)
Encoding to latents...: 0%| | 0.00/1.00 [00:00<?, ?frame/s]
Encoding to latents...: 100%|██████████| 1.00/1.00 [00:00<00:00, 22.5frame/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:09, 3.09it/s]
7%|▋ | 2/30 [00:00<00:08, 3.24it/s]
10%|█ | 3/30 [00:00<00:08, 3.30it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.33it/s]
20%|██ | 6/30 [00:01<00:07, 3.34it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.35it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.35it/s]
30%|███ | 9/30 [00:02<00:06, 3.35it/s]
33%|███▎ | 10/30 [00:03<00:05, 3.35it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.36it/s]
40%|████ | 12/30 [00:03<00:05, 3.36it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.36it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.36it/s]
50%|█████ | 15/30 [00:04<00:04, 3.36it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.36it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.36it/s]
60%|██████ | 18/30 [00:05<00:03, 3.36it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.36it/s]
67%|██████▋ | 20/30 [00:05<00:02, 3.36it/s]
70%|███████ | 21/30 [00:06<00:02, 3.36it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.36it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.35it/s]
80%|████████ | 24/30 [00:07<00:01, 3.35it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.35it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.36it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.36it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.36it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.36it/s]
100%|██████████| 30/30 [00:08<00:00, 3.36it/s]
100%|██████████| 30/30 [00:08<00:00, 3.35it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.31it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.33it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]
30%|███ | 9/30 [00:02<00:06, 3.33it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]
40%|████ | 12/30 [00:03<00:05, 3.33it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.33it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.33it/s]
50%|█████ | 15/30 [00:04<00:04, 3.33it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.33it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]
60%|██████ | 18/30 [00:05<00:03, 3.33it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]
70%|███████ | 21/30 [00:06<00:02, 3.33it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]
80%|████████ | 24/30 [00:07<00:01, 3.33it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.33it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.33it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.33it/s]
7%|▋ | 2/30 [00:00<00:08, 3.33it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.33it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.33it/s]
20%|██ | 6/30 [00:01<00:07, 3.33it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]
30%|███ | 9/30 [00:02<00:06, 3.33it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]
40%|████ | 12/30 [00:03<00:05, 3.33it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.33it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.33it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]
60%|██████ | 18/30 [00:05<00:03, 3.33it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]
70%|███████ | 21/30 [00:06<00:02, 3.33it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]
80%|████████ | 24/30 [00:07<00:01, 3.33it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.33it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.33it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.33it/s]
100%|██████████| 30/30 [00:09<00:00, 3.33it/s]
100%|██████████| 30/30 [00:09<00:00, 3.33it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.33it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.33it/s]
30%|███ | 9/30 [00:02<00:06, 3.33it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.33it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.33it/s]
40%|████ | 12/30 [00:03<00:05, 3.33it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.33it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.33it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.33it/s]
60%|██████ | 18/30 [00:05<00:03, 3.33it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.33it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.33it/s]
70%|███████ | 21/30 [00:06<00:02, 3.33it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.33it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.33it/s]
80%|████████ | 24/30 [00:07<00:01, 3.33it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.33it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.33it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.33it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.33it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]
30%|███ | 9/30 [00:02<00:06, 3.32it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]
40%|████ | 12/30 [00:03<00:05, 3.32it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]
60%|██████ | 18/30 [00:05<00:03, 3.32it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]
70%|███████ | 21/30 [00:06<00:02, 3.32it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]
80%|████████ | 24/30 [00:07<00:01, 3.32it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.32it/s]
7%|▋ | 2/30 [00:00<00:08, 3.33it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.33it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]
30%|███ | 9/30 [00:02<00:06, 3.32it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]
40%|████ | 12/30 [00:03<00:05, 3.32it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]
60%|██████ | 18/30 [00:05<00:03, 3.32it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]
70%|███████ | 21/30 [00:06<00:02, 3.32it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]
80%|████████ | 24/30 [00:07<00:01, 3.32it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.32it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]
30%|███ | 9/30 [00:02<00:06, 3.32it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]
40%|████ | 12/30 [00:03<00:05, 3.32it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]
60%|██████ | 18/30 [00:05<00:03, 3.32it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]
70%|███████ | 21/30 [00:06<00:02, 3.32it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]
80%|████████ | 24/30 [00:07<00:01, 3.32it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
0%| | 0/30 [00:00<?, ?it/s]
3%|▎ | 1/30 [00:00<00:08, 3.32it/s]
7%|▋ | 2/30 [00:00<00:08, 3.32it/s]
10%|█ | 3/30 [00:00<00:08, 3.32it/s]
13%|█▎ | 4/30 [00:01<00:07, 3.32it/s]
17%|█▋ | 5/30 [00:01<00:07, 3.32it/s]
20%|██ | 6/30 [00:01<00:07, 3.32it/s]
23%|██▎ | 7/30 [00:02<00:06, 3.32it/s]
27%|██▋ | 8/30 [00:02<00:06, 3.32it/s]
30%|███ | 9/30 [00:02<00:06, 3.32it/s]
33%|███▎ | 10/30 [00:03<00:06, 3.32it/s]
37%|███▋ | 11/30 [00:03<00:05, 3.32it/s]
40%|████ | 12/30 [00:03<00:05, 3.32it/s]
43%|████▎ | 13/30 [00:03<00:05, 3.32it/s]
47%|████▋ | 14/30 [00:04<00:04, 3.32it/s]
50%|█████ | 15/30 [00:04<00:04, 3.32it/s]
53%|█████▎ | 16/30 [00:04<00:04, 3.32it/s]
57%|█████▋ | 17/30 [00:05<00:03, 3.32it/s]
60%|██████ | 18/30 [00:05<00:03, 3.32it/s]
63%|██████▎ | 19/30 [00:05<00:03, 3.32it/s]
67%|██████▋ | 20/30 [00:06<00:03, 3.32it/s]
70%|███████ | 21/30 [00:06<00:02, 3.32it/s]
73%|███████▎ | 22/30 [00:06<00:02, 3.32it/s]
77%|███████▋ | 23/30 [00:06<00:02, 3.32it/s]
80%|████████ | 24/30 [00:07<00:01, 3.32it/s]
83%|████████▎ | 25/30 [00:07<00:01, 3.32it/s]
87%|████████▋ | 26/30 [00:07<00:01, 3.32it/s]
90%|█████████ | 27/30 [00:08<00:00, 3.32it/s]
93%|█████████▎| 28/30 [00:08<00:00, 3.32it/s]
97%|█████████▋| 29/30 [00:08<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
100%|██████████| 30/30 [00:09<00:00, 3.32it/s]
Decoding to pixels...: 0%| | 0/192 [00:00<?, ?frame/s]
Decoding to pixels...: 12%|█▎ | 24/192 [00:00<00:02, 70.65frame/s]
Decoding to pixels...: 25%|██▌ | 48/192 [00:00<00:01, 72.25frame/s]
Decoding to pixels...: 38%|███▊ | 72/192 [00:00<00:01, 73.05frame/s]
Decoding to pixels...: 50%|█████ | 96/192 [00:01<00:01, 73.43frame/s]
Decoding to pixels...: 62%|██████▎ | 120/192 [00:01<00:00, 73.42frame/s]
Decoding to pixels...: 75%|███████▌ | 144/192 [00:01<00:00, 73.43frame/s]
Decoding to pixels...: 88%|████████▊ | 168/192 [00:02<00:00, 73.62frame/s]
Decoding to pixels...: 100%|██████████| 192/192 [00:02<00:00, 73.75frame/s]
Decoding to pixels...: 100%|██████████| 192/192 [00:02<00:00, 73.36frame/s]
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil 56. 70.100 / 56. 70.100
libavcodec 58.134.100 / 58.134.100
libavformat 58. 76.100 / 58. 76.100
libavdevice 58. 13.100 / 58. 13.100
libavfilter 7.110.100 / 7.110.100
libswscale 5. 9.100 / 5. 9.100
libswresample 3. 9.100 / 3. 9.100
libpostproc 55. 9.100 / 55. 9.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from './output/A stormtrooper surfing on the ocean-a94b04b1.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2mp41
encoder : Lavf59.27.100
Duration: 00:00:12.00, start: 0.000000, bitrate: 1787 kb/s
Stream #0:0(und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 384x192 [SAR 1:1 DAR 2:1], 1786 kb/s, 16 fps, 16 tbr, 16384 tbn, 16 tbc (default)
Metadata:
handler_name : VideoHandler
vendor_id : [0][0][0][0]
Codec AVOption b (set bitrate (in bits/s)) specified for output file #0 (./output/A stormtrooper surfing on the ocean-vseq2vseq-a94b04b1_encoded.mp4) has not been used for any stream. The most likely reason is either wrong type (e.g. a video option with no video streams) or that it is a private option of some encoder which was not actually used for any stream.
Stream mapping:
Stream #0:0 -> #0:0 (mpeg4 (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 0x558de96b7c00] using SAR=1/1
[libx264 @ 0x558de96b7c00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512
[libx264 @ 0x558de96b7c00] profile High, level 1.2, 4:2:0, 8-bit
[libx264 @ 0x558de96b7c00] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=2 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=6 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=1 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=30 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to './output/A stormtrooper surfing on the ocean-vseq2vseq-a94b04b1_encoded.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2mp41
encoder : Lavf58.76.100
Stream #0:0(und): Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 384x192 [SAR 1:1 DAR 2:1], q=2-31, 16 fps, 16384 tbn (default)
Metadata:
handler_name : VideoHandler
vendor_id : [0][0][0][0]
encoder : Lavc58.134.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x
[mp4 @ 0x558de96b9080] Starting second pass: moving the moov atom to the beginning of the file
frame= 192 fps=0.0 q=-1.0 Lsize= 1228kB time=00:00:11.81 bitrate= 851.6kbits/s speed=32.5x
video:1225kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.252901%
[libx264 @ 0x558de96b7c00] frame I:5 Avg QP:23.87 size: 10294
[libx264 @ 0x558de96b7c00] frame P:48 Avg QP:26.31 size: 8452
[libx264 @ 0x558de96b7c00] frame B:139 Avg QP:27.31 size: 5729
[libx264 @ 0x558de96b7c00] consecutive B-frames: 2.6% 0.0% 7.8% 89.6%
[libx264 @ 0x558de96b7c00] mb I I16..4: 4.4% 89.8% 5.8%
[libx264 @ 0x558de96b7c00] mb P I16..4: 1.2% 59.6% 5.0% P16..4: 12.4% 14.8% 6.7% 0.0% 0.0% skip: 0.3%
[libx264 @ 0x558de96b7c00] mb B I16..4: 1.1% 28.3% 5.1% B16..8: 25.4% 21.1% 5.8% direct:10.7% skip: 2.5% L0:28.1% L1:19.0% BI:52.9%
[libx264 @ 0x558de96b7c00] 8x8 transform intra:85.6% inter:52.5%
[libx264 @ 0x558de96b7c00] coded y,uvDC,uvAC intra: 96.5% 75.8% 24.1% inter: 67.4% 38.8% 1.6%
[libx264 @ 0x558de96b7c00] i16 v,h,dc,p: 0% 48% 9% 43%
[libx264 @ 0x558de96b7c00] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 2% 43% 21% 4% 3% 1% 7% 2% 16%
[libx264 @ 0x558de96b7c00] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 5% 39% 11% 6% 5% 4% 9% 4% 16%
[libx264 @ 0x558de96b7c00] i8c dc,h,v,p: 39% 49% 6% 7%
[libx264 @ 0x558de96b7c00] Weighted P-Frames: Y:2.1% UV:0.0%
[libx264 @ 0x558de96b7c00] ref P L0: 71.6% 28.4%
[libx264 @ 0x558de96b7c00] ref B L0: 92.8% 7.2%
[libx264 @ 0x558de96b7c00] ref B L1: 98.2% 1.8%
[libx264 @ 0x558de96b7c00] kb/s:835.71
/src/output/A stormtrooper surfing on the ocean-vseq2vseq-06cd5f60_encoded.mp4