voodoohop/stable-diffusion-dance – Run with an API on Replicate

voodoohop / stable-diffusion-dance

Cold

Public
11 runs
L40S

Run with an API

Playground API Examples README Versions

Input

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

prompts

string

Shift + Return to add a new line

A painting of a moth
A painting of a killer dragonfly by paul klee, intricate detail
Two fishes talking to eachother in deep sea, art by hieronymus boschA painting of a moth
A painting of a killer dragonfly by paul klee, intricate detail
Two fishes talking to eachother in deep sea, art by hieronymus bosch

Default: "A painting of a moth\nA painting of a killer dragonfly by paul klee, intricate detail\nTwo fishes talking to eachother in deep sea, art by hieronymus bosch"

style_suffix

string

Shift + Return to add a new line

Style suffix to add to the prompt. This can be used to add the same style to each prompt.

Default: "by paul klee, intricate details"

audio_file

file

input audio file

prompt_scale

number

Determines influence of your prompt on generation.

Default: 15

random_seed

integer

Each seed generates a different image

Default: 13

diffusion_steps

integer

Number of diffusion steps. Higher steps could produce better results but will take longer to generate. Maximum 30 (using K-Euler-Diffusion).

Default: 20

audio_smoothing

number

Audio smoothing factor.

Default: 0.8

audio_noise_scale

number

Larger values mean audio will lead to bigger changes in the image.

Default: 0.3

audio_loudness_type

string

Type of loudness to use for audio. Options are 'rms' or 'peak'.

Default: "peak"

frame_rate

number

Frames per second for the generated video.

Default: 16

width

integer

Width of the generated image. The model was really only trained on 512x512 images. Other sizes tend to create less coherent images.

Default: 384

height

integer

Height of the generated image. The model was really only trained on 512x512 images. Other sizes tend to create less coherent images.

Default: 512

batch_size

integer

Number of images to generate at once. Higher batch sizes will generate images faster but will use more GPU memory i.e. not work depending on resolution.

Default: 24

frame_interpolation

boolean

Whether to interpolate between frames using FFMPEG or not.

Default: true

Run this model in Node.js with one line of code:

npx create-replicate --model=voodoohop/stable-diffusion-dance

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run voodoohop/stable-diffusion-dance using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "voodoohop/stable-diffusion-dance:2ea07a2bdff3ff5f02c8a91b71fa627786b243174ca4a9ee10a0b00bd5771890",
  {
    input: {
      width: 512,
      height: 512,
      prompts: "A painting of a moth\nA painting of a killer dragonfly by paul klee, intricate detail\nTwo fishes talking to eachother in deep sea, art by hieronymus bosch",
      audio_file: "https://replicate.delivery/pbxt/MjYAIYsg89ldJjFQtKgai1Tpl9urAqeCrx2PHJCemHO8r6iY/test1.mp3",
      batch_size: 24,
      frame_rate: 16,
      random_seed: 13,
      prompt_scale: 15,
      style_suffix: "by paul klee, intricate details",
      audio_smoothing: 0.8,
      diffusion_steps: 20,
      audio_noise_scale: 0.3,
      audio_loudness_type: "peak",
      frame_interpolation: true
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run voodoohop/stable-diffusion-dance using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "voodoohop/stable-diffusion-dance:2ea07a2bdff3ff5f02c8a91b71fa627786b243174ca4a9ee10a0b00bd5771890",
    input={
        "width": 512,
        "height": 512,
        "prompts": "A painting of a moth\nA painting of a killer dragonfly by paul klee, intricate detail\nTwo fishes talking to eachother in deep sea, art by hieronymus bosch",
        "audio_file": "https://replicate.delivery/pbxt/MjYAIYsg89ldJjFQtKgai1Tpl9urAqeCrx2PHJCemHO8r6iY/test1.mp3",
        "batch_size": 24,
        "frame_rate": 16,
        "random_seed": 13,
        "prompt_scale": 15,
        "style_suffix": "by paul klee, intricate details",
        "audio_smoothing": 0.8,
        "diffusion_steps": 20,
        "audio_noise_scale": 0.3,
        "audio_loudness_type": "peak",
        "frame_interpolation": True
    }
)

# The voodoohop/stable-diffusion-dance model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
    # https://replicate.com/voodoohop/stable-diffusion-dance/api#output-schema
    print(item)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run voodoohop/stable-diffusion-dance using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "2ea07a2bdff3ff5f02c8a91b71fa627786b243174ca4a9ee10a0b00bd5771890",
    "input": {
      "width": 512,
      "height": 512,
      "prompts": "A painting of a moth\\nA painting of a killer dragonfly by paul klee, intricate detail\\nTwo fishes talking to eachother in deep sea, art by hieronymus bosch",
      "audio_file": "https://replicate.delivery/pbxt/MjYAIYsg89ldJjFQtKgai1Tpl9urAqeCrx2PHJCemHO8r6iY/test1.mp3",
      "batch_size": 24,
      "frame_rate": 16,
      "random_seed": 13,
      "prompt_scale": 15,
      "style_suffix": "by paul klee, intricate details",
      "audio_smoothing": 0.8,
      "diffusion_steps": 20,
      "audio_noise_scale": 0.3,
      "audio_loudness_type": "peak",
      "frame_interpolation": true
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/voodoohop/stable-diffusion-dance@sha256:2ea07a2bdff3ff5f02c8a91b71fa627786b243174ca4a9ee10a0b00bd5771890 \
  -i 'width=512' \
  -i 'height=512' \
  -i $'prompts="A painting of a moth\\nA painting of a killer dragonfly by paul klee, intricate detail\\nTwo fishes talking to eachother in deep sea, art by hieronymus bosch"' \
  -i 'audio_file="https://replicate.delivery/pbxt/MjYAIYsg89ldJjFQtKgai1Tpl9urAqeCrx2PHJCemHO8r6iY/test1.mp3"' \
  -i 'batch_size=24' \
  -i 'frame_rate=16' \
  -i 'random_seed=13' \
  -i 'prompt_scale=15' \
  -i 'style_suffix="by paul klee, intricate details"' \
  -i 'audio_smoothing=0.8' \
  -i 'diffusion_steps=20' \
  -i 'audio_noise_scale=0.3' \
  -i 'audio_loudness_type="peak"' \
  -i 'frame_interpolation=true'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/voodoohop/stable-diffusion-dance@sha256:2ea07a2bdff3ff5f02c8a91b71fa627786b243174ca4a9ee10a0b00bd5771890
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "width": 512,
      "height": 512,
      "prompts": "A painting of a moth\\nA painting of a killer dragonfly by paul klee, intricate detail\\nTwo fishes talking to eachother in deep sea, art by hieronymus bosch",
      "audio_file": "https://replicate.delivery/pbxt/MjYAIYsg89ldJjFQtKgai1Tpl9urAqeCrx2PHJCemHO8r6iY/test1.mp3",
      "batch_size": 24,
      "frame_rate": 16,
      "random_seed": 13,
      "prompt_scale": 15,
      "style_suffix": "by paul klee, intricate details",
      "audio_smoothing": 0.8,
      "diffusion_steps": 20,
      "audio_noise_scale": 0.3,
      "audio_loudness_type": "peak",
      "frame_interpolation": true
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

{
  "completed_at": "2025-03-27T18:17:32.330591Z",
  "created_at": "2025-03-27T18:12:31.226000Z",
  "data_removed": false,
  "error": null,
  "id": "cs1za1a3f9rma0cnv37bzzkha4",
  "input": {
    "width": 512,
    "height": 512,
    "prompts": "A painting of a moth\nA painting of a killer dragonfly by paul klee, intricate detail\nTwo fishes talking to eachother in deep sea, art by hieronymus bosch",
    "audio_file": "https://replicate.delivery/pbxt/MjYAIYsg89ldJjFQtKgai1Tpl9urAqeCrx2PHJCemHO8r6iY/test1.mp3",
    "batch_size": 24,
    "frame_rate": 16,
    "random_seed": 13,
    "prompt_scale": 15,
    "style_suffix": "by paul klee, intricate details",
    "audio_smoothing": 0.8,
    "diffusion_steps": 20,
    "audio_noise_scale": 0.3,
    "audio_loudness_type": "peak",
    "frame_interpolation": true
  },
  "logs": "translated prompts ['A painting of a moth.by paul klee, intricate details', 'A painting of a moth.by paul klee, intricate details', 'A painting of a killer dragonfly by paul klee, intricate detail.by paul klee, intricate details', 'Two fishes talking to eachother in deep sea, art by hieronymus bosch.by paul klee, intricate details']\nusing audio file /tmp/tmph1pdxav8test1.mp3\nhop length 1378 audio length 132480 audio sr 22050\nlength of audio intensities 97\nnum frames per prompt 32\nGlobal seed set to 13\nembedding prompts\nprompt 0 shape torch.Size([1, 77, 768])\nlen smoothed_audio_intensities 97 len interpolated_prompts 96\ninterp prompts 0 shape torch.Size([1, 77, 768]) start_codes 0 shape torch.Size([1, 4, 64, 64])\ndata_batch torch.Size([24, 77, 768]) start_code_batchtorch.Size([24, 4, 64, 64])\nsigmas tensor([14.6090, 10.7477,  8.0787,  6.2059,  4.8573,  3.8654,  3.1229,  2.5581,\n2.1152,  1.7641,  1.4802,  1.2456,  1.0481,  0.8783,  0.7297,  0.5962,\n0.4736,  0.3552,  0.2322,  0.0313,  0.0000], device='cuda:0')\n  0%|          | 0/20 [00:00<?, ?it/s]\n  5%|▌         | 1/20 [00:01<00:27,  1.43s/it]\n 10%|█         | 2/20 [00:02<00:25,  1.40s/it]\n 15%|█▌        | 3/20 [00:04<00:24,  1.41s/it]\n 20%|██        | 4/20 [00:05<00:22,  1.42s/it]\n 25%|██▌       | 5/20 [00:07<00:21,  1.42s/it]\n 30%|███       | 6/20 [00:08<00:19,  1.43s/it]\n 35%|███▌      | 7/20 [00:09<00:18,  1.43s/it]\n 40%|████      | 8/20 [00:11<00:17,  1.43s/it]\n 45%|████▌     | 9/20 [00:12<00:15,  1.43s/it]\n 50%|█████     | 10/20 [00:14<00:14,  1.43s/it]\n 55%|█████▌    | 11/20 [00:15<00:12,  1.43s/it]\n 60%|██████    | 12/20 [00:17<00:11,  1.43s/it]\n 65%|██████▌   | 13/20 [00:18<00:10,  1.43s/it]\n 70%|███████   | 14/20 [00:19<00:08,  1.43s/it]\n 75%|███████▌  | 15/20 [00:21<00:07,  1.43s/it]\n 80%|████████  | 16/20 [00:22<00:05,  1.43s/it]\n 85%|████████▌ | 17/20 [00:24<00:04,  1.44s/it]\n 90%|█████████ | 18/20 [00:25<00:02,  1.44s/it]\n 95%|█████████▌| 19/20 [00:27<00:01,  1.44s/it]\n100%|██████████| 20/20 [00:28<00:00,  1.44s/it]\n100%|██████████| 20/20 [00:28<00:00,  1.43s/it]\nsamples_ddim torch.Size([24, 4, 64, 64])\nSaved ./outputs/00000.png\nSaved ./outputs/00001.png\nSaved ./outputs/00002.png\nSaved ./outputs/00003.png\nSaved ./outputs/00004.png\nSaved ./outputs/00005.png\nSaved ./outputs/00006.png\nSaved ./outputs/00007.png\nSaved ./outputs/00008.png\nSaved ./outputs/00009.png\nSaved ./outputs/00010.png\nSaved ./outputs/00011.png\nSaved ./outputs/00012.png\nSaved ./outputs/00013.png\nSaved ./outputs/00014.png\nSaved ./outputs/00015.png\nSaved ./outputs/00016.png\nSaved ./outputs/00017.png\nSaved ./outputs/00018.png\nSaved ./outputs/00019.png\nSaved ./outputs/00020.png\nSaved ./outputs/00021.png\nSaved ./outputs/00022.png\nSaved ./outputs/00023.png\ndata_batch torch.Size([24, 77, 768]) start_code_batch torch.Size([24, 4, 64, 64])\nsigmas tensor([14.6090, 10.7477,  8.0787,  6.2059,  4.8573,  3.8654,  3.1229,  2.5581,\n2.1152,  1.7641,  1.4802,  1.2456,  1.0481,  0.8783,  0.7297,  0.5962,\n0.4736,  0.3552,  0.2322,  0.0313,  0.0000], device='cuda:0')\n  0%|          | 0/20 [00:00<?, ?it/s]\n  5%|▌         | 1/20 [00:00<00:09,  1.99it/s]\n 10%|█         | 2/20 [00:01<00:18,  1.05s/it]\n 15%|█▌        | 3/20 [00:03<00:20,  1.23s/it]\n 20%|██        | 4/20 [00:04<00:20,  1.31s/it]\n 25%|██▌       | 5/20 [00:06<00:20,  1.36s/it]\n 30%|███       | 6/20 [00:07<00:19,  1.38s/it]\n 35%|███▌      | 7/20 [00:09<00:18,  1.40s/it]\n 40%|████      | 8/20 [00:10<00:16,  1.41s/it]\n 45%|████▌     | 9/20 [00:11<00:15,  1.42s/it]\n 50%|█████     | 10/20 [00:13<00:14,  1.43s/it]\n 55%|█████▌    | 11/20 [00:14<00:12,  1.43s/it]\n 60%|██████    | 12/20 [00:16<00:11,  1.43s/it]\n 65%|██████▌   | 13/20 [00:17<00:10,  1.44s/it]\n 70%|███████   | 14/20 [00:19<00:08,  1.44s/it]\n 75%|███████▌  | 15/20 [00:20<00:07,  1.44s/it]\n 80%|████████  | 16/20 [00:22<00:05,  1.44s/it]\n 85%|████████▌ | 17/20 [00:23<00:04,  1.44s/it]\n 90%|█████████ | 18/20 [00:24<00:02,  1.44s/it]\n 95%|█████████▌| 19/20 [00:26<00:01,  1.44s/it]\n100%|██████████| 20/20 [00:27<00:00,  1.44s/it]\n100%|██████████| 20/20 [00:27<00:00,  1.39s/it]\nsamples_ddim torch.Size([24, 4, 64, 64])\nSaved ./outputs/00024.png\nSaved ./outputs/00025.png\nSaved ./outputs/00026.png\nSaved ./outputs/00027.png\nSaved ./outputs/00028.png\nSaved ./outputs/00029.png\nSaved ./outputs/00030.png\nSaved ./outputs/00031.png\nSaved ./outputs/00032.png\nSaved ./outputs/00033.png\nSaved ./outputs/00034.png\nSaved ./outputs/00035.png\nSaved ./outputs/00036.png\nSaved ./outputs/00037.png\nSaved ./outputs/00038.png\nSaved ./outputs/00039.png\nSaved ./outputs/00040.png\nSaved ./outputs/00041.png\nSaved ./outputs/00042.png\nSaved ./outputs/00043.png\nSaved ./outputs/00044.png\nSaved ./outputs/00045.png\nSaved ./outputs/00046.png\nSaved ./outputs/00047.png\ndata_batch torch.Size([24, 77, 768]) start_code_batch torch.Size([24, 4, 64, 64])\nsigmas tensor([14.6090, 10.7477,  8.0787,  6.2059,  4.8573,  3.8654,  3.1229,  2.5581,\n2.1152,  1.7641,  1.4802,  1.2456,  1.0481,  0.8783,  0.7297,  0.5962,\n0.4736,  0.3552,  0.2322,  0.0313,  0.0000], device='cuda:0')\n  0%|          | 0/20 [00:00<?, ?it/s]\n  5%|▌         | 1/20 [00:00<00:09,  1.99it/s]\n 10%|█         | 2/20 [00:01<00:19,  1.06s/it]\n 15%|█▌        | 3/20 [00:03<00:20,  1.23s/it]\n 20%|██        | 4/20 [00:04<00:21,  1.32s/it]\n 25%|██▌       | 5/20 [00:06<00:20,  1.36s/it]\n 30%|███       | 6/20 [00:07<00:19,  1.39s/it]\n 35%|███▌      | 7/20 [00:09<00:18,  1.41s/it]\n 40%|████      | 8/20 [00:10<00:17,  1.42s/it]\n 45%|████▌     | 9/20 [00:12<00:15,  1.42s/it]\n 50%|█████     | 10/20 [00:13<00:14,  1.43s/it]\n 55%|█████▌    | 11/20 [00:14<00:12,  1.43s/it]\n 60%|██████    | 12/20 [00:16<00:11,  1.43s/it]\n 65%|██████▌   | 13/20 [00:17<00:10,  1.44s/it]\n 70%|███████   | 14/20 [00:19<00:08,  1.44s/it]\n 75%|███████▌  | 15/20 [00:20<00:07,  1.44s/it]\n 80%|████████  | 16/20 [00:22<00:05,  1.44s/it]\n 85%|████████▌ | 17/20 [00:23<00:04,  1.44s/it]\n 90%|█████████ | 18/20 [00:25<00:02,  1.44s/it]\n 95%|█████████▌| 19/20 [00:26<00:01,  1.44s/it]\n100%|██████████| 20/20 [00:27<00:00,  1.44s/it]\n100%|██████████| 20/20 [00:27<00:00,  1.39s/it]\nsamples_ddim torch.Size([24, 4, 64, 64])\nSaved ./outputs/00048.png\nSaved ./outputs/00049.png\nSaved ./outputs/00050.png\nSaved ./outputs/00051.png\nSaved ./outputs/00052.png\nSaved ./outputs/00053.png\nSaved ./outputs/00054.png\nSaved ./outputs/00055.png\nSaved ./outputs/00056.png\nSaved ./outputs/00057.png\nSaved ./outputs/00058.png\nSaved ./outputs/00059.png\nSaved ./outputs/00060.png\nSaved ./outputs/00061.png\nSaved ./outputs/00062.png\nSaved ./outputs/00063.png\nSaved ./outputs/00064.png\nSaved ./outputs/00065.png\nSaved ./outputs/00066.png\nSaved ./outputs/00067.png\nSaved ./outputs/00068.png\nSaved ./outputs/00069.png\nSaved ./outputs/00070.png\nSaved ./outputs/00071.png\ndata_batch torch.Size([24, 77, 768]) start_code_batch torch.Size([24, 4, 64, 64])\nsigmas tensor([14.6090, 10.7477,  8.0787,  6.2059,  4.8573,  3.8654,  3.1229,  2.5581,\n2.1152,  1.7641,  1.4802,  1.2456,  1.0481,  0.8783,  0.7297,  0.5962,\n0.4736,  0.3552,  0.2322,  0.0313,  0.0000], device='cuda:0')\n  0%|          | 0/20 [00:00<?, ?it/s]\n  5%|▌         | 1/20 [00:00<00:09,  1.98it/s]\n 10%|█         | 2/20 [00:01<00:19,  1.06s/it]\n 15%|█▌        | 3/20 [00:03<00:20,  1.23s/it]\n 20%|██        | 4/20 [00:04<00:21,  1.36s/it]\n 25%|██▌       | 5/20 [00:06<00:20,  1.37s/it]\n 30%|███       | 6/20 [00:07<00:19,  1.40s/it]\n 35%|███▌      | 7/20 [00:09<00:18,  1.41s/it]\n 40%|████      | 8/20 [00:10<00:17,  1.42s/it]\n 45%|████▌     | 9/20 [00:12<00:15,  1.43s/it]\n 50%|█████     | 10/20 [00:13<00:14,  1.43s/it]\n 55%|█████▌    | 11/20 [00:15<00:12,  1.44s/it]\n 60%|██████    | 12/20 [00:16<00:11,  1.44s/it]\n 65%|██████▌   | 13/20 [00:17<00:10,  1.44s/it]\n 70%|███████   | 14/20 [00:19<00:08,  1.44s/it]\n 75%|███████▌  | 15/20 [00:20<00:07,  1.44s/it]\n 80%|████████  | 16/20 [00:22<00:05,  1.44s/it]\n 85%|████████▌ | 17/20 [00:23<00:04,  1.44s/it]\n 90%|█████████ | 18/20 [00:25<00:02,  1.44s/it]\n 95%|█████████▌| 19/20 [00:26<00:01,  1.44s/it]\n100%|██████████| 20/20 [00:27<00:00,  1.44s/it]\n100%|██████████| 20/20 [00:27<00:00,  1.40s/it]\nsamples_ddim torch.Size([24, 4, 64, 64])\nSaved ./outputs/00072.png\nSaved ./outputs/00073.png\nSaved ./outputs/00074.png\nSaved ./outputs/00075.png\nSaved ./outputs/00076.png\nSaved ./outputs/00077.png\nSaved ./outputs/00078.png\nSaved ./outputs/00079.png\nSaved ./outputs/00080.png\nSaved ./outputs/00081.png\nSaved ./outputs/00082.png\nSaved ./outputs/00083.png\nSaved ./outputs/00084.png\nSaved ./outputs/00085.png\nSaved ./outputs/00086.png\nSaved ./outputs/00087.png\nSaved ./outputs/00088.png\nSaved ./outputs/00089.png\nSaved ./outputs/00090.png\nSaved ./outputs/00091.png\nSaved ./outputs/00092.png\nSaved ./outputs/00093.png\nSaved ./outputs/00094.png\nSaved ./outputs/00095.png\nYour samples have been saved to:\n./outputs\nEnjoy.\ntotal 61672\n-rw-r--r-- 1 root root 642004 Mar 27 18:15 00000.png\n-rw-r--r-- 1 root root 638277 Mar 27 18:15 00001.png\n-rw-r--r-- 1 root root 636290 Mar 27 18:15 00002.png\n-rw-r--r-- 1 root root 646528 Mar 27 18:15 00003.png\n-rw-r--r-- 1 root root 642303 Mar 27 18:15 00004.png\n-rw-r--r-- 1 root root 646229 Mar 27 18:15 00005.png\n-rw-r--r-- 1 root root 646045 Mar 27 18:15 00006.png\n-rw-r--r-- 1 root root 640138 Mar 27 18:15 00007.png\n-rw-r--r-- 1 root root 640645 Mar 27 18:15 00008.png\n-rw-r--r-- 1 root root 644376 Mar 27 18:15 00009.png\n-rw-r--r-- 1 root root 651647 Mar 27 18:15 00010.png\n-rw-r--r-- 1 root root 645823 Mar 27 18:15 00011.png\n-rw-r--r-- 1 root root 636216 Mar 27 18:15 00012.png\n-rw-r--r-- 1 root root 638321 Mar 27 18:15 00013.png\n-rw-r--r-- 1 root root 640819 Mar 27 18:15 00014.png\n-rw-r--r-- 1 root root 642209 Mar 27 18:15 00015.png\n-rw-r--r-- 1 root root 635924 Mar 27 18:15 00016.png\n-rw-r--r-- 1 root root 638007 Mar 27 18:15 00017.png\n-rw-r--r-- 1 root root 639980 Mar 27 18:15 00018.png\n-rw-r--r-- 1 root root 651785 Mar 27 18:15 00019.png\n-rw-r--r-- 1 root root 649632 Mar 27 18:15 00020.png\n-rw-r--r-- 1 root root 644949 Mar 27 18:15 00021.png\n-rw-r--r-- 1 root root 636635 Mar 27 18:15 00022.png\n-rw-r--r-- 1 root root 637092 Mar 27 18:15 00023.png\n-rw-r--r-- 1 root root 640738 Mar 27 18:16 00024.png\n-rw-r--r-- 1 root root 645466 Mar 27 18:16 00025.png\n-rw-r--r-- 1 root root 641979 Mar 27 18:16 00026.png\n-rw-r--r-- 1 root root 643876 Mar 27 18:16 00027.png\n-rw-r--r-- 1 root root 643556 Mar 27 18:16 00028.png\n-rw-r--r-- 1 root root 642177 Mar 27 18:16 00029.png\n-rw-r--r-- 1 root root 644385 Mar 27 18:16 00030.png\n-rw-r--r-- 1 root root 641750 Mar 27 18:16 00031.png\n-rw-r--r-- 1 root root 641641 Mar 27 18:16 00032.png\n-rw-r--r-- 1 root root 655825 Mar 27 18:16 00033.png\n-rw-r--r-- 1 root root 651429 Mar 27 18:16 00034.png\n-rw-r--r-- 1 root root 654648 Mar 27 18:16 00035.png\n-rw-r--r-- 1 root root 646665 Mar 27 18:16 00036.png\n-rw-r--r-- 1 root root 649182 Mar 27 18:16 00037.png\n-rw-r--r-- 1 root root 646929 Mar 27 18:16 00038.png\n-rw-r--r-- 1 root root 648801 Mar 27 18:16 00039.png\n-rw-r--r-- 1 root root 650807 Mar 27 18:16 00040.png\n-rw-r--r-- 1 root root 651238 Mar 27 18:16 00041.png\n-rw-r--r-- 1 root root 654080 Mar 27 18:16 00042.png\n-rw-r--r-- 1 root root 657997 Mar 27 18:16 00043.png\n-rw-r--r-- 1 root root 654062 Mar 27 18:16 00044.png\n-rw-r--r-- 1 root root 645044 Mar 27 18:16 00045.png\n-rw-r--r-- 1 root root 649169 Mar 27 18:16 00046.png\n-rw-r--r-- 1 root root 649032 Mar 27 18:16 00047.png\n-rw-r--r-- 1 root root 648941 Mar 27 18:16 00048.png\n-rw-r--r-- 1 root root 651319 Mar 27 18:16 00049.png\n-rw-r--r-- 1 root root 647694 Mar 27 18:16 00050.png\n-rw-r--r-- 1 root root 654670 Mar 27 18:16 00051.png\n-rw-r--r-- 1 root root 658213 Mar 27 18:16 00052.png\n-rw-r--r-- 1 root root 655096 Mar 27 18:16 00053.png\n-rw-r--r-- 1 root root 654868 Mar 27 18:16 00054.png\n-rw-r--r-- 1 root root 647661 Mar 27 18:16 00055.png\n-rw-r--r-- 1 root root 648491 Mar 27 18:16 00056.png\n-rw-r--r-- 1 root root 647378 Mar 27 18:16 00057.png\n-rw-r--r-- 1 root root 653648 Mar 27 18:16 00058.png\n-rw-r--r-- 1 root root 649479 Mar 27 18:16 00059.png\n-rw-r--r-- 1 root root 648430 Mar 27 18:16 00060.png\n-rw-r--r-- 1 root root 648655 Mar 27 18:16 00061.png\n-rw-r--r-- 1 root root 651449 Mar 27 18:16 00062.png\n-rw-r--r-- 1 root root 652229 Mar 27 18:16 00063.png\n-rw-r--r-- 1 root root 648212 Mar 27 18:16 00064.png\n-rw-r--r-- 1 root root 665119 Mar 27 18:16 00065.png\n-rw-r--r-- 1 root root 667312 Mar 27 18:16 00066.png\n-rw-r--r-- 1 root root 670765 Mar 27 18:16 00067.png\n-rw-r--r-- 1 root root 686186 Mar 27 18:16 00068.png\n-rw-r--r-- 1 root root 668374 Mar 27 18:16 00069.png\n-rw-r--r-- 1 root root 660704 Mar 27 18:16 00070.png\n-rw-r--r-- 1 root root 669603 Mar 27 18:16 00071.png\n-rw-r--r-- 1 root root 666823 Mar 27 18:17 00072.png\n-rw-r--r-- 1 root root 666856 Mar 27 18:17 00073.png\n-rw-r--r-- 1 root root 669827 Mar 27 18:17 00074.png\n-rw-r--r-- 1 root root 674255 Mar 27 18:17 00075.png\n-rw-r--r-- 1 root root 672226 Mar 27 18:17 00076.png\n-rw-r--r-- 1 root root 674705 Mar 27 18:17 00077.png\n-rw-r--r-- 1 root root 674792 Mar 27 18:17 00078.png\n-rw-r--r-- 1 root root 680698 Mar 27 18:17 00079.png\n-rw-r--r-- 1 root root 675547 Mar 27 18:17 00080.png\n-rw-r--r-- 1 root root 676059 Mar 27 18:17 00081.png\n-rw-r--r-- 1 root root 676981 Mar 27 18:17 00082.png\n-rw-r--r-- 1 root root 672135 Mar 27 18:17 00083.png\n-rw-r--r-- 1 root root 671898 Mar 27 18:17 00084.png\n-rw-r--r-- 1 root root 677357 Mar 27 18:17 00085.png\n-rw-r--r-- 1 root root 682207 Mar 27 18:17 00086.png\n-rw-r--r-- 1 root root 684609 Mar 27 18:17 00087.png\n-rw-r--r-- 1 root root 683231 Mar 27 18:17 00088.png\n-rw-r--r-- 1 root root 681440 Mar 27 18:17 00089.png\n-rw-r--r-- 1 root root 682773 Mar 27 18:17 00090.png\n-rw-r--r-- 1 root root 682412 Mar 27 18:17 00091.png\n-rw-r--r-- 1 root root 684271 Mar 27 18:17 00092.png\n-rw-r--r-- 1 root root 675812 Mar 27 18:17 00093.png\n-rw-r--r-- 1 root root 676336 Mar 27 18:17 00094.png\n-rw-r--r-- 1 root root 675458 Mar 27 18:17 00095.png\nThu Mar 27 18:17:28 2025\n+-----------------------------------------------------------------------------------------+\n| NVIDIA-SMI 550.144.03             Driver Version: 550.144.03     CUDA Version: 12.4     |\n|-----------------------------------------+------------------------+----------------------+\n| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |\n| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |\n|                                         |                        |               MIG M. |\n|=========================================+========================+======================|\n|   0  NVIDIA L40S                    On  |   00000000:C1:00.0 Off |                    0 |\n| N/A   64C    P0            127W /  350W |   43607MiB /  46068MiB |      0%      Default |\n|                                         |                        |                  N/A |\n+-----------------------------------------+------------------------+----------------------+\n+-----------------------------------------------------------------------------------------+\n| Processes:                                                                              |\n|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |\n|        ID   ID                                                               Usage      |\n|=========================================================================================|\n+-----------------------------------------------------------------------------------------+\ntotal time 139.44789123535156\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil      56. 70.100 / 56. 70.100\nlibavcodec     58.134.100 / 58.134.100\nlibavformat    58. 76.100 / 58. 76.100\nlibavdevice    58. 13.100 / 58. 13.100\nlibavfilter     7.110.100 /  7.110.100\nlibswscale      5.  9.100 /  5.  9.100\nlibswresample   3.  9.100 /  3.  9.100\nlibpostproc    55.  9.100 / 55.  9.100\n[image2 @ 0x645ff26b4a00] Pattern type 'glob_sequence' is deprecated: use pattern_type 'glob' instead\nInput #0, image2, from './outputs/%*.png':\nDuration: 00:00:03.84, start: 0.000000, bitrate: N/A\nStream #0:0: Video: png, rgb24(pc), 512x512, 25 fps, 25 tbr, 25 tbn, 25 tbc\n[mp3 @ 0x645ff26bba80] Estimating duration from bitrate, this may be inaccurate\nInput #1, mp3, from '/tmp/tmph1pdxav8test1.mp3':\nDuration: 00:00:06.01, start: 0.000000, bitrate: 320 kb/s\nStream #1:0: Audio: mp3, 44100 Hz, stereo, fltp, 320 kb/s\nStream mapping:\nStream #0:0 -> #0:0 (png (native) -> h264 (libx264))\nStream #1:0 -> #0:1 (mp3 (mp3float) -> aac (native))\nPress [q] to stop, [?] for help\n[image2 @ 0x645ff26b4a00] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)\n[libx264 @ 0x645ff26c2100] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512\n[libx264 @ 0x645ff26c2100] profile High, level 2.2, 4:2:0, 8-bit\n[libx264 @ 0x645ff26c2100] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=5 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=8 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=2 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=15 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=crf mbtree=1 crf=20.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to '/tmp/z_interpollation.mp4':\nMetadata:\nencoder         : Lavf58.76.100\nStream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 512x512, q=2-31, 16 fps, 16384 tbn\nMetadata:\nencoder         : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nStream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 128 kb/s\nMetadata:\nencoder         : Lavc58.134.100 aac\nframe=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x\nframe=   87 fps=0.0 q=24.0 size=    1024kB time=00:00:00.93 bitrate=8947.7kbits/s speed=1.76x\n[mp4 @ 0x645ff26c0f40] Starting second pass: moving the moov atom to the beginning of the file\nframe=   96 fps= 57 q=-1.0 Lsize=    7008kB time=00:00:05.99 bitrate=9583.0kbits/s speed=3.56x\nvideo:6906kB audio:97kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.070338%\n[libx264 @ 0x645ff26c2100] frame I:4     Avg QP:23.38  size:118358\n[libx264 @ 0x645ff26c2100] frame P:26    Avg QP:25.31  size: 91010\n[libx264 @ 0x645ff26c2100] frame B:66    Avg QP:26.27  size: 64109\n[libx264 @ 0x645ff26c2100] consecutive B-frames:  7.3%  0.0%  9.4% 83.3%\n[libx264 @ 0x645ff26c2100] mb I  I16..4:  0.0% 22.4% 77.5%\n[libx264 @ 0x645ff26c2100] mb P  I16..4:  0.8% 19.5% 23.3%  P16..4: 18.8% 22.6% 15.0%  0.0%  0.0%    skip: 0.0%\n[libx264 @ 0x645ff26c2100] mb B  I16..4:  0.3%  6.0%  4.6%  B16..8: 27.7% 22.9% 13.4%  direct:23.1%  skip: 2.0%  L0:31.9% L1:31.4% BI:36.6%\n[libx264 @ 0x645ff26c2100] 8x8 transform intra:44.1% inter:29.5%\n[libx264 @ 0x645ff26c2100] direct mvs  spatial:84.8% temporal:15.2%\n[libx264 @ 0x645ff26c2100] coded y,uvDC,uvAC intra: 99.9% 97.9% 90.1% inter: 93.4% 87.7% 31.8%\n[libx264 @ 0x645ff26c2100] i16 v,h,dc,p:  2%  9% 76% 14%\n[libx264 @ 0x645ff26c2100] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 14%  9% 29%  8%  7%  9%  6%  9%  9%\n[libx264 @ 0x645ff26c2100] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu:  8%  7% 17% 11% 11% 12% 10% 12% 12%\n[libx264 @ 0x645ff26c2100] i8c dc,h,v,p: 41% 20% 21% 18%\n[libx264 @ 0x645ff26c2100] Weighted P-Frames: Y:38.5% UV:38.5%\n[libx264 @ 0x645ff26c2100] ref P L0: 42.8% 17.6% 12.9%  9.9%  7.2%  9.7%\n[libx264 @ 0x645ff26c2100] ref B L0: 71.5% 19.1%  6.2%  3.1%\n[libx264 @ 0x645ff26c2100] ref B L1: 90.0% 10.0%\n[libx264 @ 0x645ff26c2100] kb/s:9427.79\n[aac @ 0x645ff26cf700] Qavg: 942.794\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil      56. 70.100 / 56. 70.100\nlibavcodec     58.134.100 / 58.134.100\nlibavformat    58. 76.100 / 58. 76.100\nlibavdevice    58. 13.100 / 58. 13.100\nlibavfilter     7.110.100 /  7.110.100\nlibswscale      5.  9.100 /  5.  9.100\nlibswresample   3.  9.100 /  3.  9.100\nlibpostproc    55.  9.100 / 55.  9.100\nInput #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/z_interpollation.mp4':\nMetadata:\nmajor_brand     : isom\nminor_version   : 512\ncompatible_brands: isomiso2avc1mp41\nencoder         : Lavf58.76.100\nDuration: 00:00:06.01, start: 0.000000, bitrate: 9553 kb/s\nStream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 512x512, 9428 kb/s, 16 fps, 16 tbr, 16384 tbn, 32 tbc (default)\nMetadata:\nhandler_name    : VideoHandler\nvendor_id       : [0][0][0][0]\nStream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 132 kb/s (default)\nMetadata:\nhandler_name    : SoundHandler\nvendor_id       : [0][0][0][0]\nMultiple -filter, -af or -vf options specified for stream 0, only the last option '-filter:v format=yuv420p' will be used.\nStream mapping:\nStream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))\nStream #0:1 -> #0:1 (aac (native) -> aac (native))\nPress [q] to stop, [?] for help\n[libx264 @ 0x5ec858f3e640] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512\n[libx264 @ 0x5ec858f3e640] profile High, level 2.2, 4:2:0, 8-bit\n[libx264 @ 0x5ec858f3e640] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=5 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=8 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=2 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=15 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=crf mbtree=1 crf=20.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to '/tmp/z_interpollation_60fps.mp4':\nMetadata:\nmajor_brand     : isom\nminor_version   : 512\ncompatible_brands: isomiso2avc1mp41\nencoder         : Lavf58.76.100\nStream #0:0(und): Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 512x512, q=2-31, 16 fps, 16384 tbn (default)\nMetadata:\nhandler_name    : VideoHandler\nvendor_id       : [0][0][0][0]\nencoder         : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nStream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 128 kb/s (default)\nMetadata:\nhandler_name    : SoundHandler\nvendor_id       : [0][0][0][0]\nencoder         : Lavc58.134.100 aac\nframe=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.88 bitrate=   0.4kbits/s speed=37.9x\nframe=   90 fps=0.0 q=24.0 size=    1280kB time=00:00:05.94 bitrate=1764.1kbits/s speed=11.2x\n[mp4 @ 0x5ec858f4b740] Starting second pass: moving the moov atom to the beginning of the file\nframe=   96 fps= 62 q=-1.0 Lsize=    6889kB time=00:00:05.99 bitrate=9419.7kbits/s speed=3.88x\nvideo:6785kB audio:98kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.071445%\n[libx264 @ 0x5ec858f3e640] frame I:4     Avg QP:23.33  size:117846\n[libx264 @ 0x5ec858f3e640] frame P:26    Avg QP:25.24  size: 89933\n[libx264 @ 0x5ec858f3e640] frame B:66    Avg QP:26.22  size: 62692\n[libx264 @ 0x5ec858f3e640] consecutive B-frames:  7.3%  0.0%  9.4% 83.3%\n[libx264 @ 0x5ec858f3e640] mb I  I16..4:  0.0% 21.7% 78.3%\n[libx264 @ 0x5ec858f3e640] mb P  I16..4:  0.9% 19.3% 24.2%  P16..4: 19.9% 20.3% 15.4%  0.0%  0.0%    skip: 0.0%\n[libx264 @ 0x5ec858f3e640] mb B  I16..4:  0.3%  5.8%  5.0%  B16..8: 28.1% 21.7% 13.9%  direct:22.5%  skip: 2.6%  L0:32.9% L1:32.8% BI:34.3%\n[libx264 @ 0x5ec858f3e640] 8x8 transform intra:42.5% inter:27.4%\n[libx264 @ 0x5ec858f3e640] direct mvs  spatial:84.8% temporal:15.2%\n[libx264 @ 0x5ec858f3e640] coded y,uvDC,uvAC intra: 99.9% 97.1% 86.0% inter: 92.4% 84.7% 28.7%\n[libx264 @ 0x5ec858f3e640] i16 v,h,dc,p:  2%  8% 73% 17%\n[libx264 @ 0x5ec858f3e640] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 13%  9% 29%  8%  7%  9%  7%  9%  9%\n[libx264 @ 0x5ec858f3e640] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu:  8%  7% 18% 11% 11% 12%  9% 12% 12%\n[libx264 @ 0x5ec858f3e640] i8c dc,h,v,p: 42% 20% 22% 16%\n[libx264 @ 0x5ec858f3e640] Weighted P-Frames: Y:38.5% UV:38.5%\n[libx264 @ 0x5ec858f3e640] ref P L0: 42.8% 17.3% 13.1%  9.8%  7.2%  9.8%\n[libx264 @ 0x5ec858f3e640] ref B L0: 71.6% 19.0%  6.2%  3.2%\n[libx264 @ 0x5ec858f3e640] ref B L1: 90.3%  9.7%\n[libx264 @ 0x5ec858f3e640] kb/s:9263.11\n[aac @ 0x5ec858f9c300] Qavg: 937.715",
  "metrics": {
    "predict_time": 142.95772694,
    "total_time": 301.104591
  },
  "output": [
    "https://replicate.delivery/xezq/M1lx4ec41gQ5OC3IJ4SdkWH0Dst5zFQrWpJNfBWAX3YXfo5oA/00023.png",
    "https://replicate.delivery/xezq/1zfDqTAtjST3SacHM49Q8h2Ngvd3td9iKfsfsg3v1b6vfRzRB/00047.png",
    "https://replicate.delivery/xezq/SBCy7888aiIOBN92KdFfw7hMMURksvHTZeGocvgt5BUYg0cUA/00071.png",
    "https://replicate.delivery/xezq/253qfHAhYGzRHiUyKd7kFDeZjdmKyaoSIdHePnPN8BBwBp5oA/00095.png",
    "https://replicate.delivery/xezq/8PZg0mGjDpKdAlCaNcsIIbdc9uBnzjtaZuj1enjaoSe6g0cUA/z_interpollation.mp4",
    "https://replicate.delivery/xezq/CWw5ldlcgnrCFNpiUtjofC2qbrhcM4Kb9idgQBS55lVeg0cUA/z_interpollation_60fps.mp4"
  ],
  "started_at": "2025-03-27T18:15:09.372864Z",
  "status": "succeeded",
  "urls": {
    "stream": "https://stream.replicate.com/v1/files/bcwr-vbken2xa3cxojcijgzbvtkwqzu7fjsbav5apti2ykhq64qbuavla",
    "get": "https://api.replicate.com/v1/predictions/cs1za1a3f9rma0cnv37bzzkha4",
    "cancel": "https://api.replicate.com/v1/predictions/cs1za1a3f9rma0cnv37bzzkha4/cancel"
  },
  "version": "2ea07a2bdff3ff5f02c8a91b71fa627786b243174ca4a9ee10a0b00bd5771890"
}

Generated in

2 minutes 23 seconds

Tweak it ShareReport

translated prompts ['A painting of a moth.by paul klee, intricate details', 'A painting of a moth.by paul klee, intricate details', 'A painting of a killer dragonfly by paul klee, intricate detail.by paul klee, intricate details', 'Two fishes talking to eachother in deep sea, art by hieronymus bosch.by paul klee, intricate details']
using audio file /tmp/tmph1pdxav8test1.mp3
hop length 1378 audio length 132480 audio sr 22050
length of audio intensities 97
num frames per prompt 32
Global seed set to 13
embedding prompts
prompt 0 shape torch.Size([1, 77, 768])
len smoothed_audio_intensities 97 len interpolated_prompts 96
interp prompts 0 shape torch.Size([1, 77, 768]) start_codes 0 shape torch.Size([1, 4, 64, 64])
data_batch torch.Size([24, 77, 768]) start_code_batchtorch.Size([24, 4, 64, 64])
sigmas tensor([14.6090, 10.7477,  8.0787,  6.2059,  4.8573,  3.8654,  3.1229,  2.5581,
2.1152,  1.7641,  1.4802,  1.2456,  1.0481,  0.8783,  0.7297,  0.5962,
0.4736,  0.3552,  0.2322,  0.0313,  0.0000], device='cuda:0')
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:01<00:27,  1.43s/it]
 10%|█         | 2/20 [00:02<00:25,  1.40s/it]
 15%|█▌        | 3/20 [00:04<00:24,  1.41s/it]
 20%|██        | 4/20 [00:05<00:22,  1.42s/it]
 25%|██▌       | 5/20 [00:07<00:21,  1.42s/it]
 30%|███       | 6/20 [00:08<00:19,  1.43s/it]
 35%|███▌      | 7/20 [00:09<00:18,  1.43s/it]
 40%|████      | 8/20 [00:11<00:17,  1.43s/it]
 45%|████▌     | 9/20 [00:12<00:15,  1.43s/it]
 50%|█████     | 10/20 [00:14<00:14,  1.43s/it]
 55%|█████▌    | 11/20 [00:15<00:12,  1.43s/it]
 60%|██████    | 12/20 [00:17<00:11,  1.43s/it]
 65%|██████▌   | 13/20 [00:18<00:10,  1.43s/it]
 70%|███████   | 14/20 [00:19<00:08,  1.43s/it]
 75%|███████▌  | 15/20 [00:21<00:07,  1.43s/it]
 80%|████████  | 16/20 [00:22<00:05,  1.43s/it]
 85%|████████▌ | 17/20 [00:24<00:04,  1.44s/it]
 90%|█████████ | 18/20 [00:25<00:02,  1.44s/it]
 95%|█████████▌| 19/20 [00:27<00:01,  1.44s/it]
100%|██████████| 20/20 [00:28<00:00,  1.44s/it]
100%|██████████| 20/20 [00:28<00:00,  1.43s/it]
samples_ddim torch.Size([24, 4, 64, 64])
Saved ./outputs/00000.png
Saved ./outputs/00001.png
Saved ./outputs/00002.png
Saved ./outputs/00003.png
Saved ./outputs/00004.png
Saved ./outputs/00005.png
Saved ./outputs/00006.png
Saved ./outputs/00007.png
Saved ./outputs/00008.png
Saved ./outputs/00009.png
Saved ./outputs/00010.png
Saved ./outputs/00011.png
Saved ./outputs/00012.png
Saved ./outputs/00013.png
Saved ./outputs/00014.png
Saved ./outputs/00015.png
Saved ./outputs/00016.png
Saved ./outputs/00017.png
Saved ./outputs/00018.png
Saved ./outputs/00019.png
Saved ./outputs/00020.png
Saved ./outputs/00021.png
Saved ./outputs/00022.png
Saved ./outputs/00023.png
data_batch torch.Size([24, 77, 768]) start_code_batch torch.Size([24, 4, 64, 64])
sigmas tensor([14.6090, 10.7477,  8.0787,  6.2059,  4.8573,  3.8654,  3.1229,  2.5581,
2.1152,  1.7641,  1.4802,  1.2456,  1.0481,  0.8783,  0.7297,  0.5962,
0.4736,  0.3552,  0.2322,  0.0313,  0.0000], device='cuda:0')
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:00<00:09,  1.99it/s]
 10%|█         | 2/20 [00:01<00:18,  1.05s/it]
 15%|█▌        | 3/20 [00:03<00:20,  1.23s/it]
 20%|██        | 4/20 [00:04<00:20,  1.31s/it]
 25%|██▌       | 5/20 [00:06<00:20,  1.36s/it]
 30%|███       | 6/20 [00:07<00:19,  1.38s/it]
 35%|███▌      | 7/20 [00:09<00:18,  1.40s/it]
 40%|████      | 8/20 [00:10<00:16,  1.41s/it]
 45%|████▌     | 9/20 [00:11<00:15,  1.42s/it]
 50%|█████     | 10/20 [00:13<00:14,  1.43s/it]
 55%|█████▌    | 11/20 [00:14<00:12,  1.43s/it]
 60%|██████    | 12/20 [00:16<00:11,  1.43s/it]
 65%|██████▌   | 13/20 [00:17<00:10,  1.44s/it]
 70%|███████   | 14/20 [00:19<00:08,  1.44s/it]
 75%|███████▌  | 15/20 [00:20<00:07,  1.44s/it]
 80%|████████  | 16/20 [00:22<00:05,  1.44s/it]
 85%|████████▌ | 17/20 [00:23<00:04,  1.44s/it]
 90%|█████████ | 18/20 [00:24<00:02,  1.44s/it]
 95%|█████████▌| 19/20 [00:26<00:01,  1.44s/it]
100%|██████████| 20/20 [00:27<00:00,  1.44s/it]
100%|██████████| 20/20 [00:27<00:00,  1.39s/it]
samples_ddim torch.Size([24, 4, 64, 64])
Saved ./outputs/00024.png
Saved ./outputs/00025.png
Saved ./outputs/00026.png
Saved ./outputs/00027.png
Saved ./outputs/00028.png
Saved ./outputs/00029.png
Saved ./outputs/00030.png
Saved ./outputs/00031.png
Saved ./outputs/00032.png
Saved ./outputs/00033.png
Saved ./outputs/00034.png
Saved ./outputs/00035.png
Saved ./outputs/00036.png
Saved ./outputs/00037.png
Saved ./outputs/00038.png
Saved ./outputs/00039.png
Saved ./outputs/00040.png
Saved ./outputs/00041.png
Saved ./outputs/00042.png
Saved ./outputs/00043.png
Saved ./outputs/00044.png
Saved ./outputs/00045.png
Saved ./outputs/00046.png
Saved ./outputs/00047.png
data_batch torch.Size([24, 77, 768]) start_code_batch torch.Size([24, 4, 64, 64])
sigmas tensor([14.6090, 10.7477,  8.0787,  6.2059,  4.8573,  3.8654,  3.1229,  2.5581,
2.1152,  1.7641,  1.4802,  1.2456,  1.0481,  0.8783,  0.7297,  0.5962,
0.4736,  0.3552,  0.2322,  0.0313,  0.0000], device='cuda:0')
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:00<00:09,  1.99it/s]
 10%|█         | 2/20 [00:01<00:19,  1.06s/it]
 15%|█▌        | 3/20 [00:03<00:20,  1.23s/it]
 20%|██        | 4/20 [00:04<00:21,  1.32s/it]
 25%|██▌       | 5/20 [00:06<00:20,  1.36s/it]
 30%|███       | 6/20 [00:07<00:19,  1.39s/it]
 35%|███▌      | 7/20 [00:09<00:18,  1.41s/it]
 40%|████      | 8/20 [00:10<00:17,  1.42s/it]
 45%|████▌     | 9/20 [00:12<00:15,  1.42s/it]
 50%|█████     | 10/20 [00:13<00:14,  1.43s/it]
 55%|█████▌    | 11/20 [00:14<00:12,  1.43s/it]
 60%|██████    | 12/20 [00:16<00:11,  1.43s/it]
 65%|██████▌   | 13/20 [00:17<00:10,  1.44s/it]
 70%|███████   | 14/20 [00:19<00:08,  1.44s/it]
 75%|███████▌  | 15/20 [00:20<00:07,  1.44s/it]
 80%|████████  | 16/20 [00:22<00:05,  1.44s/it]
 85%|████████▌ | 17/20 [00:23<00:04,  1.44s/it]
 90%|█████████ | 18/20 [00:25<00:02,  1.44s/it]
 95%|█████████▌| 19/20 [00:26<00:01,  1.44s/it]
100%|██████████| 20/20 [00:27<00:00,  1.44s/it]
100%|██████████| 20/20 [00:27<00:00,  1.39s/it]
samples_ddim torch.Size([24, 4, 64, 64])
Saved ./outputs/00048.png
Saved ./outputs/00049.png
Saved ./outputs/00050.png
Saved ./outputs/00051.png
Saved ./outputs/00052.png
Saved ./outputs/00053.png
Saved ./outputs/00054.png
Saved ./outputs/00055.png
Saved ./outputs/00056.png
Saved ./outputs/00057.png
Saved ./outputs/00058.png
Saved ./outputs/00059.png
Saved ./outputs/00060.png
Saved ./outputs/00061.png
Saved ./outputs/00062.png
Saved ./outputs/00063.png
Saved ./outputs/00064.png
Saved ./outputs/00065.png
Saved ./outputs/00066.png
Saved ./outputs/00067.png
Saved ./outputs/00068.png
Saved ./outputs/00069.png
Saved ./outputs/00070.png
Saved ./outputs/00071.png
data_batch torch.Size([24, 77, 768]) start_code_batch torch.Size([24, 4, 64, 64])
sigmas tensor([14.6090, 10.7477,  8.0787,  6.2059,  4.8573,  3.8654,  3.1229,  2.5581,
2.1152,  1.7641,  1.4802,  1.2456,  1.0481,  0.8783,  0.7297,  0.5962,
0.4736,  0.3552,  0.2322,  0.0313,  0.0000], device='cuda:0')
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:00<00:09,  1.98it/s]
 10%|█         | 2/20 [00:01<00:19,  1.06s/it]
 15%|█▌        | 3/20 [00:03<00:20,  1.23s/it]
 20%|██        | 4/20 [00:04<00:21,  1.36s/it]
 25%|██▌       | 5/20 [00:06<00:20,  1.37s/it]
 30%|███       | 6/20 [00:07<00:19,  1.40s/it]
 35%|███▌      | 7/20 [00:09<00:18,  1.41s/it]
 40%|████      | 8/20 [00:10<00:17,  1.42s/it]
 45%|████▌     | 9/20 [00:12<00:15,  1.43s/it]
 50%|█████     | 10/20 [00:13<00:14,  1.43s/it]
 55%|█████▌    | 11/20 [00:15<00:12,  1.44s/it]
 60%|██████    | 12/20 [00:16<00:11,  1.44s/it]
 65%|██████▌   | 13/20 [00:17<00:10,  1.44s/it]
 70%|███████   | 14/20 [00:19<00:08,  1.44s/it]
 75%|███████▌  | 15/20 [00:20<00:07,  1.44s/it]
 80%|████████  | 16/20 [00:22<00:05,  1.44s/it]
 85%|████████▌ | 17/20 [00:23<00:04,  1.44s/it]
 90%|█████████ | 18/20 [00:25<00:02,  1.44s/it]
 95%|█████████▌| 19/20 [00:26<00:01,  1.44s/it]
100%|██████████| 20/20 [00:27<00:00,  1.44s/it]
100%|██████████| 20/20 [00:27<00:00,  1.40s/it]
samples_ddim torch.Size([24, 4, 64, 64])
Saved ./outputs/00072.png
Saved ./outputs/00073.png
Saved ./outputs/00074.png
Saved ./outputs/00075.png
Saved ./outputs/00076.png
Saved ./outputs/00077.png
Saved ./outputs/00078.png
Saved ./outputs/00079.png
Saved ./outputs/00080.png
Saved ./outputs/00081.png
Saved ./outputs/00082.png
Saved ./outputs/00083.png
Saved ./outputs/00084.png
Saved ./outputs/00085.png
Saved ./outputs/00086.png
Saved ./outputs/00087.png
Saved ./outputs/00088.png
Saved ./outputs/00089.png
Saved ./outputs/00090.png
Saved ./outputs/00091.png
Saved ./outputs/00092.png
Saved ./outputs/00093.png
Saved ./outputs/00094.png
Saved ./outputs/00095.png
Your samples have been saved to:
./outputs
Enjoy.
total 61672
-rw-r--r-- 1 root root 642004 Mar 27 18:15 00000.png
-rw-r--r-- 1 root root 638277 Mar 27 18:15 00001.png
-rw-r--r-- 1 root root 636290 Mar 27 18:15 00002.png
-rw-r--r-- 1 root root 646528 Mar 27 18:15 00003.png
-rw-r--r-- 1 root root 642303 Mar 27 18:15 00004.png
-rw-r--r-- 1 root root 646229 Mar 27 18:15 00005.png
-rw-r--r-- 1 root root 646045 Mar 27 18:15 00006.png
-rw-r--r-- 1 root root 640138 Mar 27 18:15 00007.png
-rw-r--r-- 1 root root 640645 Mar 27 18:15 00008.png
-rw-r--r-- 1 root root 644376 Mar 27 18:15 00009.png
-rw-r--r-- 1 root root 651647 Mar 27 18:15 00010.png
-rw-r--r-- 1 root root 645823 Mar 27 18:15 00011.png
-rw-r--r-- 1 root root 636216 Mar 27 18:15 00012.png
-rw-r--r-- 1 root root 638321 Mar 27 18:15 00013.png
-rw-r--r-- 1 root root 640819 Mar 27 18:15 00014.png
-rw-r--r-- 1 root root 642209 Mar 27 18:15 00015.png
-rw-r--r-- 1 root root 635924 Mar 27 18:15 00016.png
-rw-r--r-- 1 root root 638007 Mar 27 18:15 00017.png
-rw-r--r-- 1 root root 639980 Mar 27 18:15 00018.png
-rw-r--r-- 1 root root 651785 Mar 27 18:15 00019.png
-rw-r--r-- 1 root root 649632 Mar 27 18:15 00020.png
-rw-r--r-- 1 root root 644949 Mar 27 18:15 00021.png
-rw-r--r-- 1 root root 636635 Mar 27 18:15 00022.png
-rw-r--r-- 1 root root 637092 Mar 27 18:15 00023.png
-rw-r--r-- 1 root root 640738 Mar 27 18:16 00024.png
-rw-r--r-- 1 root root 645466 Mar 27 18:16 00025.png
-rw-r--r-- 1 root root 641979 Mar 27 18:16 00026.png
-rw-r--r-- 1 root root 643876 Mar 27 18:16 00027.png
-rw-r--r-- 1 root root 643556 Mar 27 18:16 00028.png
-rw-r--r-- 1 root root 642177 Mar 27 18:16 00029.png
-rw-r--r-- 1 root root 644385 Mar 27 18:16 00030.png
-rw-r--r-- 1 root root 641750 Mar 27 18:16 00031.png
-rw-r--r-- 1 root root 641641 Mar 27 18:16 00032.png
-rw-r--r-- 1 root root 655825 Mar 27 18:16 00033.png
-rw-r--r-- 1 root root 651429 Mar 27 18:16 00034.png
-rw-r--r-- 1 root root 654648 Mar 27 18:16 00035.png
-rw-r--r-- 1 root root 646665 Mar 27 18:16 00036.png
-rw-r--r-- 1 root root 649182 Mar 27 18:16 00037.png
-rw-r--r-- 1 root root 646929 Mar 27 18:16 00038.png
-rw-r--r-- 1 root root 648801 Mar 27 18:16 00039.png
-rw-r--r-- 1 root root 650807 Mar 27 18:16 00040.png
-rw-r--r-- 1 root root 651238 Mar 27 18:16 00041.png
-rw-r--r-- 1 root root 654080 Mar 27 18:16 00042.png
-rw-r--r-- 1 root root 657997 Mar 27 18:16 00043.png
-rw-r--r-- 1 root root 654062 Mar 27 18:16 00044.png
-rw-r--r-- 1 root root 645044 Mar 27 18:16 00045.png
-rw-r--r-- 1 root root 649169 Mar 27 18:16 00046.png
-rw-r--r-- 1 root root 649032 Mar 27 18:16 00047.png
-rw-r--r-- 1 root root 648941 Mar 27 18:16 00048.png
-rw-r--r-- 1 root root 651319 Mar 27 18:16 00049.png
-rw-r--r-- 1 root root 647694 Mar 27 18:16 00050.png
-rw-r--r-- 1 root root 654670 Mar 27 18:16 00051.png
-rw-r--r-- 1 root root 658213 Mar 27 18:16 00052.png
-rw-r--r-- 1 root root 655096 Mar 27 18:16 00053.png
-rw-r--r-- 1 root root 654868 Mar 27 18:16 00054.png
-rw-r--r-- 1 root root 647661 Mar 27 18:16 00055.png
-rw-r--r-- 1 root root 648491 Mar 27 18:16 00056.png
-rw-r--r-- 1 root root 647378 Mar 27 18:16 00057.png
-rw-r--r-- 1 root root 653648 Mar 27 18:16 00058.png
-rw-r--r-- 1 root root 649479 Mar 27 18:16 00059.png
-rw-r--r-- 1 root root 648430 Mar 27 18:16 00060.png
-rw-r--r-- 1 root root 648655 Mar 27 18:16 00061.png
-rw-r--r-- 1 root root 651449 Mar 27 18:16 00062.png
-rw-r--r-- 1 root root 652229 Mar 27 18:16 00063.png
-rw-r--r-- 1 root root 648212 Mar 27 18:16 00064.png
-rw-r--r-- 1 root root 665119 Mar 27 18:16 00065.png
-rw-r--r-- 1 root root 667312 Mar 27 18:16 00066.png
-rw-r--r-- 1 root root 670765 Mar 27 18:16 00067.png
-rw-r--r-- 1 root root 686186 Mar 27 18:16 00068.png
-rw-r--r-- 1 root root 668374 Mar 27 18:16 00069.png
-rw-r--r-- 1 root root 660704 Mar 27 18:16 00070.png
-rw-r--r-- 1 root root 669603 Mar 27 18:16 00071.png
-rw-r--r-- 1 root root 666823 Mar 27 18:17 00072.png
-rw-r--r-- 1 root root 666856 Mar 27 18:17 00073.png
-rw-r--r-- 1 root root 669827 Mar 27 18:17 00074.png
-rw-r--r-- 1 root root 674255 Mar 27 18:17 00075.png
-rw-r--r-- 1 root root 672226 Mar 27 18:17 00076.png
-rw-r--r-- 1 root root 674705 Mar 27 18:17 00077.png
-rw-r--r-- 1 root root 674792 Mar 27 18:17 00078.png
-rw-r--r-- 1 root root 680698 Mar 27 18:17 00079.png
-rw-r--r-- 1 root root 675547 Mar 27 18:17 00080.png
-rw-r--r-- 1 root root 676059 Mar 27 18:17 00081.png
-rw-r--r-- 1 root root 676981 Mar 27 18:17 00082.png
-rw-r--r-- 1 root root 672135 Mar 27 18:17 00083.png
-rw-r--r-- 1 root root 671898 Mar 27 18:17 00084.png
-rw-r--r-- 1 root root 677357 Mar 27 18:17 00085.png
-rw-r--r-- 1 root root 682207 Mar 27 18:17 00086.png
-rw-r--r-- 1 root root 684609 Mar 27 18:17 00087.png
-rw-r--r-- 1 root root 683231 Mar 27 18:17 00088.png
-rw-r--r-- 1 root root 681440 Mar 27 18:17 00089.png
-rw-r--r-- 1 root root 682773 Mar 27 18:17 00090.png
-rw-r--r-- 1 root root 682412 Mar 27 18:17 00091.png
-rw-r--r-- 1 root root 684271 Mar 27 18:17 00092.png
-rw-r--r-- 1 root root 675812 Mar 27 18:17 00093.png
-rw-r--r-- 1 root root 676336 Mar 27 18:17 00094.png
-rw-r--r-- 1 root root 675458 Mar 27 18:17 00095.png
Thu Mar 27 18:17:28 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.144.03             Driver Version: 550.144.03     CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA L40S                    On  |   00000000:C1:00.0 Off |                    0 |
| N/A   64C    P0            127W /  350W |   43607MiB /  46068MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
+-----------------------------------------------------------------------------------------+
total time 139.44789123535156
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
[image2 @ 0x645ff26b4a00] Pattern type 'glob_sequence' is deprecated: use pattern_type 'glob' instead
Input #0, image2, from './outputs/%*.png':
Duration: 00:00:03.84, start: 0.000000, bitrate: N/A
Stream #0:0: Video: png, rgb24(pc), 512x512, 25 fps, 25 tbr, 25 tbn, 25 tbc
[mp3 @ 0x645ff26bba80] Estimating duration from bitrate, this may be inaccurate
Input #1, mp3, from '/tmp/tmph1pdxav8test1.mp3':
Duration: 00:00:06.01, start: 0.000000, bitrate: 320 kb/s
Stream #1:0: Audio: mp3, 44100 Hz, stereo, fltp, 320 kb/s
Stream mapping:
Stream #0:0 -> #0:0 (png (native) -> h264 (libx264))
Stream #1:0 -> #0:1 (mp3 (mp3float) -> aac (native))
Press [q] to stop, [?] for help
[image2 @ 0x645ff26b4a00] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)
[libx264 @ 0x645ff26c2100] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512
[libx264 @ 0x645ff26c2100] profile High, level 2.2, 4:2:0, 8-bit
[libx264 @ 0x645ff26c2100] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=5 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=8 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=2 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=15 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=crf mbtree=1 crf=20.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to '/tmp/z_interpollation.mp4':
Metadata:
encoder         : Lavf58.76.100
Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 512x512, q=2-31, 16 fps, 16384 tbn
Metadata:
encoder         : Lavc58.134.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 128 kb/s
Metadata:
encoder         : Lavc58.134.100 aac
frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x
frame=   87 fps=0.0 q=24.0 size=    1024kB time=00:00:00.93 bitrate=8947.7kbits/s speed=1.76x
[mp4 @ 0x645ff26c0f40] Starting second pass: moving the moov atom to the beginning of the file
frame=   96 fps= 57 q=-1.0 Lsize=    7008kB time=00:00:05.99 bitrate=9583.0kbits/s speed=3.56x
video:6906kB audio:97kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.070338%
[libx264 @ 0x645ff26c2100] frame I:4     Avg QP:23.38  size:118358
[libx264 @ 0x645ff26c2100] frame P:26    Avg QP:25.31  size: 91010
[libx264 @ 0x645ff26c2100] frame B:66    Avg QP:26.27  size: 64109
[libx264 @ 0x645ff26c2100] consecutive B-frames:  7.3%  0.0%  9.4% 83.3%
[libx264 @ 0x645ff26c2100] mb I  I16..4:  0.0% 22.4% 77.5%
[libx264 @ 0x645ff26c2100] mb P  I16..4:  0.8% 19.5% 23.3%  P16..4: 18.8% 22.6% 15.0%  0.0%  0.0%    skip: 0.0%
[libx264 @ 0x645ff26c2100] mb B  I16..4:  0.3%  6.0%  4.6%  B16..8: 27.7% 22.9% 13.4%  direct:23.1%  skip: 2.0%  L0:31.9% L1:31.4% BI:36.6%
[libx264 @ 0x645ff26c2100] 8x8 transform intra:44.1% inter:29.5%
[libx264 @ 0x645ff26c2100] direct mvs  spatial:84.8% temporal:15.2%
[libx264 @ 0x645ff26c2100] coded y,uvDC,uvAC intra: 99.9% 97.9% 90.1% inter: 93.4% 87.7% 31.8%
[libx264 @ 0x645ff26c2100] i16 v,h,dc,p:  2%  9% 76% 14%
[libx264 @ 0x645ff26c2100] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 14%  9% 29%  8%  7%  9%  6%  9%  9%
[libx264 @ 0x645ff26c2100] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu:  8%  7% 17% 11% 11% 12% 10% 12% 12%
[libx264 @ 0x645ff26c2100] i8c dc,h,v,p: 41% 20% 21% 18%
[libx264 @ 0x645ff26c2100] Weighted P-Frames: Y:38.5% UV:38.5%
[libx264 @ 0x645ff26c2100] ref P L0: 42.8% 17.6% 12.9%  9.9%  7.2%  9.7%
[libx264 @ 0x645ff26c2100] ref B L0: 71.5% 19.1%  6.2%  3.1%
[libx264 @ 0x645ff26c2100] ref B L1: 90.0% 10.0%
[libx264 @ 0x645ff26c2100] kb/s:9427.79
[aac @ 0x645ff26cf700] Qavg: 942.794
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/z_interpollation.mp4':
Metadata:
major_brand     : isom
minor_version   : 512
compatible_brands: isomiso2avc1mp41
encoder         : Lavf58.76.100
Duration: 00:00:06.01, start: 0.000000, bitrate: 9553 kb/s
Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 512x512, 9428 kb/s, 16 fps, 16 tbr, 16384 tbn, 32 tbc (default)
Metadata:
handler_name    : VideoHandler
vendor_id       : [0][0][0][0]
Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 132 kb/s (default)
Metadata:
handler_name    : SoundHandler
vendor_id       : [0][0][0][0]
Multiple -filter, -af or -vf options specified for stream 0, only the last option '-filter:v format=yuv420p' will be used.
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
Stream #0:1 -> #0:1 (aac (native) -> aac (native))
Press [q] to stop, [?] for help
[libx264 @ 0x5ec858f3e640] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512
[libx264 @ 0x5ec858f3e640] profile High, level 2.2, 4:2:0, 8-bit
[libx264 @ 0x5ec858f3e640] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=5 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=8 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=2 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=15 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=crf mbtree=1 crf=20.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to '/tmp/z_interpollation_60fps.mp4':
Metadata:
major_brand     : isom
minor_version   : 512
compatible_brands: isomiso2avc1mp41
encoder         : Lavf58.76.100
Stream #0:0(und): Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 512x512, q=2-31, 16 fps, 16384 tbn (default)
Metadata:
handler_name    : VideoHandler
vendor_id       : [0][0][0][0]
encoder         : Lavc58.134.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 128 kb/s (default)
Metadata:
handler_name    : SoundHandler
vendor_id       : [0][0][0][0]
encoder         : Lavc58.134.100 aac
frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.88 bitrate=   0.4kbits/s speed=37.9x
frame=   90 fps=0.0 q=24.0 size=    1280kB time=00:00:05.94 bitrate=1764.1kbits/s speed=11.2x
[mp4 @ 0x5ec858f4b740] Starting second pass: moving the moov atom to the beginning of the file
frame=   96 fps= 62 q=-1.0 Lsize=    6889kB time=00:00:05.99 bitrate=9419.7kbits/s speed=3.88x
video:6785kB audio:98kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.071445%
[libx264 @ 0x5ec858f3e640] frame I:4     Avg QP:23.33  size:117846
[libx264 @ 0x5ec858f3e640] frame P:26    Avg QP:25.24  size: 89933
[libx264 @ 0x5ec858f3e640] frame B:66    Avg QP:26.22  size: 62692
[libx264 @ 0x5ec858f3e640] consecutive B-frames:  7.3%  0.0%  9.4% 83.3%
[libx264 @ 0x5ec858f3e640] mb I  I16..4:  0.0% 21.7% 78.3%
[libx264 @ 0x5ec858f3e640] mb P  I16..4:  0.9% 19.3% 24.2%  P16..4: 19.9% 20.3% 15.4%  0.0%  0.0%    skip: 0.0%
[libx264 @ 0x5ec858f3e640] mb B  I16..4:  0.3%  5.8%  5.0%  B16..8: 28.1% 21.7% 13.9%  direct:22.5%  skip: 2.6%  L0:32.9% L1:32.8% BI:34.3%
[libx264 @ 0x5ec858f3e640] 8x8 transform intra:42.5% inter:27.4%
[libx264 @ 0x5ec858f3e640] direct mvs  spatial:84.8% temporal:15.2%
[libx264 @ 0x5ec858f3e640] coded y,uvDC,uvAC intra: 99.9% 97.1% 86.0% inter: 92.4% 84.7% 28.7%
[libx264 @ 0x5ec858f3e640] i16 v,h,dc,p:  2%  8% 73% 17%
[libx264 @ 0x5ec858f3e640] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 13%  9% 29%  8%  7%  9%  7%  9%  9%
[libx264 @ 0x5ec858f3e640] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu:  8%  7% 18% 11% 11% 12%  9% 12% 12%
[libx264 @ 0x5ec858f3e640] i8c dc,h,v,p: 42% 20% 22% 16%
[libx264 @ 0x5ec858f3e640] Weighted P-Frames: Y:38.5% UV:38.5%
[libx264 @ 0x5ec858f3e640] ref P L0: 42.8% 17.3% 13.1%  9.8%  7.2%  9.8%
[libx264 @ 0x5ec858f3e640] ref B L0: 71.6% 19.0%  6.2%  3.2%
[libx264 @ 0x5ec858f3e640] ref B L1: 90.3%  9.7%
[libx264 @ 0x5ec858f3e640] kb/s:9263.11
[aac @ 0x5ec858f9c300] Qavg: 937.715

Examples

View more examples

Run time and cost

This model runs on Nvidia L40S GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

This model doesn't have a readme.