chigozienri/posy-motion-extraction – Run with an API on Replicate

chigozienri / posy-motion-extraction

Extracts motion from video

Cold

Public
187 runs
CPU
GitHub
Paper

Run with an API

Playground API Examples README Versions

Input

input_video

*file

Input video

frames_offset

integer

Frames to offset video by for motion extraction. Don't see any motion? Try increasing the number of frames.

Default: 2

fixed_mode

boolean

Enable fixed mode. Will ignore frames_offset, and use comparison_frame instead

Default: false

comparison_frame

integer

Frame number to compare to for fixed_mode. Note that this is 1-indexed, so the first frame is 1, not 0.

Default: 1

color_delay_mode

boolean

Enable color delay mode. Will ignore frames_offset and comparison_frame, and use red_offset, green_offset, and blue_offset instead

Default: false

red_offset

integer

Number of frames to delay red channel for color_delay_mode

Default: 0

green_offset

integer

Number of frames to delay green channel for color_delay_mode

Default: 5

blue_offset

integer

Number of frames to delay blue channel for color_delay_mode

Default: 10

Run this model in Node.js with one line of code:

npx create-replicate --model=chigozienri/posy-motion-extraction

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run chigozienri/posy-motion-extraction using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "chigozienri/posy-motion-extraction:1d2c864e303415f1d0998d9285a355aa66b3482cd89ef9f5b97379551ac60693",
  {
    input: {
      fixed_mode: false,
      red_offset: 0,
      blue_offset: 2,
      input_video: "https://replicate.delivery/pbxt/JzvlNz3waztrUWfTbhprxZYynxqiLvDyjI8019gUeZ16P9Gw/birds.mp4",
      green_offset: 1,
      frames_offset: 2,
      color_delay_mode: false,
      comparison_frame: 1
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run chigozienri/posy-motion-extraction using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "chigozienri/posy-motion-extraction:1d2c864e303415f1d0998d9285a355aa66b3482cd89ef9f5b97379551ac60693",
    input={
        "fixed_mode": False,
        "red_offset": 0,
        "blue_offset": 2,
        "input_video": "https://replicate.delivery/pbxt/JzvlNz3waztrUWfTbhprxZYynxqiLvDyjI8019gUeZ16P9Gw/birds.mp4",
        "green_offset": 1,
        "frames_offset": 2,
        "color_delay_mode": False,
        "comparison_frame": 1
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run chigozienri/posy-motion-extraction using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "chigozienri/posy-motion-extraction:1d2c864e303415f1d0998d9285a355aa66b3482cd89ef9f5b97379551ac60693",
    "input": {
      "fixed_mode": false,
      "red_offset": 0,
      "blue_offset": 2,
      "input_video": "https://replicate.delivery/pbxt/JzvlNz3waztrUWfTbhprxZYynxqiLvDyjI8019gUeZ16P9Gw/birds.mp4",
      "green_offset": 1,
      "frames_offset": 2,
      "color_delay_mode": false,
      "comparison_frame": 1
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

{
  "completed_at": "2023-12-05T21:35:01.972478Z",
  "created_at": "2023-12-05T21:34:26.270990Z",
  "data_removed": false,
  "error": null,
  "id": "xhv2sqjbn6lpmc4nf26qnvvp4e",
  "input": {
    "red_offset": 0,
    "blue_offset": 2,
    "input_video": "https://replicate.delivery/pbxt/JzvlNz3waztrUWfTbhprxZYynxqiLvDyjI8019gUeZ16P9Gw/birds.mp4",
    "green_offset": 1,
    "frames_offset": 2,
    "color_delay_mode": false
  },
  "logs": "ffmpeg version 5.1.4-0+deb12u1 Copyright (c) 2000-2023 the FFmpeg developers\nbuilt with gcc 12 (Debian 12.2.0-14)\nconfiguration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared\nlibavutil      57. 28.100 / 57. 28.100\nlibavcodec     59. 37.100 / 59. 37.100\nlibavformat    59. 27.100 / 59. 27.100\nlibavdevice    59.  7.100 / 59.  7.100\nlibavfilter     8. 44.100 /  8. 44.100\nlibswscale      6.  7.100 /  6.  7.100\nlibswresample   4.  7.100 /  4.  7.100\nlibpostproc    56.  6.100 / 56.  6.100\nInput #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/tmp47deo1dy/tmp8lgh5ct7birds.mp4':\nMetadata:\nmajor_brand     : mp42\nminor_version   : 0\ncompatible_brands: isommp42\ncreation_time   : 2022-12-11T06:20:51.000000Z\nDuration: 00:00:20.06, start: 0.000000, bitrate: 2190 kb/s\nStream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 2059 kb/s, 29.97 fps, 29.97 tbr, 30k tbn (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nStream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nStream mapping:\nStream #0:0 -> #0:0 (h264 (native) -> png (native))\nPress [q] to stop, [?] for help\nOutput #0, image2, to '/tmp/tmp.coyXXpgvyg/input_%03d.png':\nMetadata:\nmajor_brand     : mp42\nminor_version   : 0\ncompatible_brands: isommp42\nencoder         : Lavf59.27.100\nStream #0:0(und): Video: png, rgb24(pc, gbr/bt709/bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 29.97 fps, 29.97 tbn (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nencoder         : Lavc59.37.100 png\nframe=    1 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x\nframe=   35 fps=0.0 q=-0.0 size=N/A time=00:00:00.90 bitrate=N/A speed=1.61x\nframe=   66 fps= 62 q=-0.0 size=N/A time=00:00:01.93 bitrate=N/A speed=1.83x\nframe=   95 fps= 61 q=-0.0 size=N/A time=00:00:02.90 bitrate=N/A speed=1.86x\nframe=  128 fps= 62 q=-0.0 size=N/A time=00:00:04.00 bitrate=N/A speed=1.93x\nframe=  161 fps= 62 q=-0.0 size=N/A time=00:00:05.10 bitrate=N/A speed=1.97x\nframe=  190 fps= 61 q=-0.0 size=N/A time=00:00:06.07 bitrate=N/A speed=1.96x\nframe=  222 fps= 61 q=-0.0 size=N/A time=00:00:07.14 bitrate=N/A speed=1.96x\nframe=  253 fps= 61 q=-0.0 size=N/A time=00:00:08.17 bitrate=N/A speed=1.96x\nframe=  284 fps= 61 q=-0.0 size=N/A time=00:00:09.20 bitrate=N/A speed=1.97x\nframe=  315 fps= 61 q=-0.0 size=N/A time=00:00:10.24 bitrate=N/A speed=1.98x\nframe=  347 fps= 61 q=-0.0 size=N/A time=00:00:11.31 bitrate=N/A speed=1.99x\nframe=  379 fps= 61 q=-0.0 size=N/A time=00:00:12.37 bitrate=N/A speed=   2x\nframe=  409 fps= 61 q=-0.0 size=N/A time=00:00:13.38 bitrate=N/A speed=   2x\nframe=  441 fps= 61 q=-0.0 size=N/A time=00:00:14.44 bitrate=N/A speed=2.01x\nframe=  473 fps= 61 q=-0.0 size=N/A time=00:00:15.51 bitrate=N/A speed=2.01x\nframe=  503 fps= 61 q=-0.0 size=N/A time=00:00:16.51 bitrate=N/A speed=   2x\nframe=  535 fps= 61 q=-0.0 size=N/A time=00:00:17.58 bitrate=N/A speed=2.01x\nframe=  566 fps= 61 q=-0.0 size=N/A time=00:00:18.61 bitrate=N/A speed=2.01x\nframe=  596 fps= 61 q=-0.0 size=N/A time=00:00:19.61 bitrate=N/A speed=   2x\nframe=  601 fps= 60 q=-0.0 Lsize=N/A time=00:00:20.05 bitrate=N/A speed=2.02x\nvideo:410339kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nffmpeg version 5.1.4-0+deb12u1 Copyright (c) 2000-2023 the FFmpeg developers\nbuilt with gcc 12 (Debian 12.2.0-14)\nconfiguration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared\nlibavutil      57. 28.100 / 57. 28.100\nlibavcodec     59. 37.100 / 59. 37.100\nlibavformat    59. 27.100 / 59. 27.100\nlibavdevice    59.  7.100 / 59.  7.100\nlibavfilter     8. 44.100 /  8. 44.100\nlibswscale      6.  7.100 /  6.  7.100\nlibswresample   4.  7.100 /  4.  7.100\nlibpostproc    56.  6.100 / 56.  6.100\nInput #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/tmp47deo1dy/tmp8lgh5ct7birds.mp4':\nMetadata:\nmajor_brand     : mp42\nminor_version   : 0\ncompatible_brands: isommp42\ncreation_time   : 2022-12-11T06:20:51.000000Z\nDuration: 00:00:20.06, start: 0.000000, bitrate: 2190 kb/s\nStream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 2059 kb/s, 29.97 fps, 29.97 tbr, 30k tbn (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nStream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nStream mapping:\nStream #0:0 -> #0:0 (h264 (native) -> png (native))\nPress [q] to stop, [?] for help\nOutput #0, image2, to '/tmp/tmp.coyXXpgvyg/inverted_halfopacity_%03d.png':\nMetadata:\nmajor_brand     : mp42\nminor_version   : 0\ncompatible_brands: isommp42\nencoder         : Lavf59.27.100\nStream #0:0(und): Video: png, rgba(pc, gbr/bt709/bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 29.97 fps, 29.97 tbn (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nencoder         : Lavc59.37.100 png\nframe=    1 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x\nframe=   22 fps=0.0 q=-0.0 size=N/A time=00:00:00.46 bitrate=N/A speed=0.847x\nframe=   42 fps= 40 q=-0.0 size=N/A time=00:00:01.13 bitrate=N/A speed=1.07x\nframe=   61 fps= 39 q=-0.0 size=N/A time=00:00:01.76 bitrate=N/A speed=1.13x\nframe=   80 fps= 38 q=-0.0 size=N/A time=00:00:02.40 bitrate=N/A speed=1.16x\nframe=   99 fps= 38 q=-0.0 size=N/A time=00:00:03.03 bitrate=N/A speed=1.17x\nframe=  117 fps= 38 q=-0.0 size=N/A time=00:00:03.63 bitrate=N/A speed=1.17x\nframe=  138 fps= 38 q=-0.0 size=N/A time=00:00:04.33 bitrate=N/A speed= 1.2x\nframe=  158 fps= 38 q=-0.0 size=N/A time=00:00:05.00 bitrate=N/A speed=1.21x\nframe=  178 fps= 38 q=-0.0 size=N/A time=00:00:05.67 bitrate=N/A speed=1.22x\nframe=  197 fps= 38 q=-0.0 size=N/A time=00:00:06.30 bitrate=N/A speed=1.21x\nframe=  216 fps= 38 q=-0.0 size=N/A time=00:00:06.94 bitrate=N/A speed=1.21x\nframe=  238 fps= 38 q=-0.0 size=N/A time=00:00:07.67 bitrate=N/A speed=1.22x\nframe=  254 fps= 37 q=-0.0 size=N/A time=00:00:08.20 bitrate=N/A speed=1.21x\nframe=  277 fps= 38 q=-0.0 size=N/A time=00:00:08.97 bitrate=N/A speed=1.23x\nframe=  296 fps= 38 q=-0.0 size=N/A time=00:00:09.60 bitrate=N/A speed=1.23x\nframe=  316 fps= 38 q=-0.0 size=N/A time=00:00:10.27 bitrate=N/A speed=1.23x\nframe=  334 fps= 38 q=-0.0 size=N/A time=00:00:10.87 bitrate=N/A speed=1.23x\nframe=  354 fps= 38 q=-0.0 size=N/A time=00:00:11.54 bitrate=N/A speed=1.24x\nframe=  375 fps= 38 q=-0.0 size=N/A time=00:00:12.24 bitrate=N/A speed=1.24x\nframe=  395 fps= 38 q=-0.0 size=N/A time=00:00:12.91 bitrate=N/A speed=1.24x\nframe=  415 fps= 38 q=-0.0 size=N/A time=00:00:13.58 bitrate=N/A speed=1.25x\nframe=  436 fps= 38 q=-0.0 size=N/A time=00:00:14.28 bitrate=N/A speed=1.25x\nframe=  457 fps= 38 q=-0.0 size=N/A time=00:00:14.98 bitrate=N/A speed=1.25x\nframe=  477 fps= 38 q=-0.0 size=N/A time=00:00:15.64 bitrate=N/A speed=1.25x\nframe=  495 fps= 38 q=-0.0 size=N/A time=00:00:16.24 bitrate=N/A speed=1.25x\nframe=  514 fps= 38 q=-0.0 size=N/A time=00:00:16.88 bitrate=N/A speed=1.25x\nframe=  534 fps= 38 q=-0.0 size=N/A time=00:00:17.55 bitrate=N/A speed=1.25x\nframe=  552 fps= 38 q=-0.0 size=N/A time=00:00:18.15 bitrate=N/A speed=1.24x\nframe=  574 fps= 38 q=-0.0 size=N/A time=00:00:18.88 bitrate=N/A speed=1.25x\nframe=  593 fps= 38 q=-0.0 size=N/A time=00:00:19.51 bitrate=N/A speed=1.25x\nframe=  601 fps= 38 q=-0.0 Lsize=N/A time=00:00:20.05 bitrate=N/A speed=1.26x\nvideo:437606kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nffmpeg version 5.1.4-0+deb12u1 Copyright (c) 2000-2023 the FFmpeg developers\nbuilt with gcc 12 (Debian 12.2.0-14)\nconfiguration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared\nlibavutil      57. 28.100 / 57. 28.100\nlibavcodec     59. 37.100 / 59. 37.100\nlibavformat    59. 27.100 / 59. 27.100\nlibavdevice    59.  7.100 / 59.  7.100\nlibavfilter     8. 44.100 /  8. 44.100\nlibswscale      6.  7.100 /  6.  7.100\nlibswresample   4.  7.100 /  4.  7.100\nlibpostproc    56.  6.100 / 56.  6.100\nInput #0, image2, from '/tmp/tmp.coyXXpgvyg/input_%03d.png':\nDuration: 00:00:24.04, start: 0.000000, bitrate: N/A\nStream #0:0: Video: png, rgb24(pc), 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 25 tbn\nInput #1, image2, from '/tmp/tmp.coyXXpgvyg/inverted_halfopacity_%03d.png':\nDuration: 00:00:24.00, start: 0.000000, bitrate: N/A\nStream #1:0: Video: png, rgba(pc), 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 25 tbn\nInput #2, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/tmp47deo1dy/tmp8lgh5ct7birds.mp4':\nMetadata:\nmajor_brand     : mp42\nminor_version   : 0\ncompatible_brands: isommp42\ncreation_time   : 2022-12-11T06:20:51.000000Z\nDuration: 00:00:20.06, start: 0.000000, bitrate: 2190 kb/s\nStream #2:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 2059 kb/s, 29.97 fps, 29.97 tbr, 30k tbn (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nStream #2:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nStream mapping:\nStream #0:0 (png) -> overlay\nStream #1:0 (png) -> overlay\noverlay:default -> Stream #0:0 (libx264)\nStream #2:1 -> #0:1 (copy)\nPress [q] to stop, [?] for help\n[image2 @ 0x5b990451ecc0] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)\n[image2 @ 0x5b9904523280] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)\n[libx264 @ 0x5b99046ce340] using SAR=1/1\n[libx264 @ 0x5b99046ce340] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x5b99046ce340] profile Constrained Baseline, level 3.1, 4:2:0, 8-bit\n[libx264 @ 0x5b99046ce340] 264 - core 164 r3095 baee400 - H.264/MPEG-4 AVC codec - Copyleft 2003-2022 - http://www.videolan.org/x264.html - options: cabac=0 ref=1 deblock=0:0:0 analyse=0:0 me=dia subme=0 psy=1 psy_rd=1.00:0.00 mixed_ref=0 me_range=16 chroma_me=1 trellis=0 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=0 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=0 keyint=250 keyint_min=25 scenecut=0 intra_refresh=0 rc=crf mbtree=0 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=0\nOutput #0, mp4, to '/tmp/tmp47deo1dy/output.mp4':\nMetadata:\nencoder         : Lavf59.27.100\nStream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 25 fps, 12800 tbn\nMetadata:\nencoder         : Lavc59.37.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nStream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)\nMetadata:\ncreation_time   : 2022-12-11T06:20:51.000000Z\nhandler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.\nvendor_id       : [0][0][0][0]\nframe=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x\nframe=   24 fps=0.0 q=22.0 size=       0kB time=00:00:00.40 bitrate=   1.0kbits/s speed=0.675x\nframe=   63 fps= 58 q=22.0 size=     768kB time=00:00:01.96 bitrate=3210.0kbits/s speed=1.79x\nframe=  101 fps= 63 q=23.0 size=    1536kB time=00:00:03.50 bitrate=3588.9kbits/s speed=2.19x\nframe=  138 fps= 65 q=22.0 size=    2304kB time=00:00:04.96 bitrate=3798.4kbits/s speed=2.36x\nframe=  177 fps= 68 q=23.0 size=    3072kB time=00:00:06.54 bitrate=3843.3kbits/s speed=2.51x\nframe=  215 fps= 69 q=22.0 size=    3840kB time=00:00:08.04 bitrate=3912.6kbits/s speed=2.58x\nframe=  253 fps= 70 q=20.0 size=    4608kB time=00:00:09.56 bitrate=3945.9kbits/s speed=2.65x\nframe=  290 fps= 70 q=23.0 size=    5376kB time=00:00:11.05 bitrate=3984.6kbits/s speed=2.69x\nframe=  329 fps= 71 q=22.0 size=    6144kB time=00:00:12.60 bitrate=3991.9kbits/s speed=2.73x\nframe=  370 fps= 72 q=23.0 size=    6656kB time=00:00:14.24 bitrate=3829.1kbits/s speed=2.78x\nframe=  409 fps= 73 q=23.0 size=    7424kB time=00:00:15.80 bitrate=3849.2kbits/s speed=2.81x\nframe=  447 fps= 73 q=23.0 size=    8192kB time=00:00:17.32 bitrate=3874.2kbits/s speed=2.83x\nframe=  487 fps= 73 q=24.0 size=    8960kB time=00:00:18.92 bitrate=3878.7kbits/s speed=2.85x\nframe=  526 fps= 74 q=23.0 size=    9728kB time=00:00:20.48 bitrate=3891.2kbits/s speed=2.87x\nframe=  566 fps= 74 q=22.0 size=    9728kB time=00:00:22.08 bitrate=3609.2kbits/s speed=2.89x\nframe=  601 fps= 75 q=-1.0 Lsize=   11963kB time=00:00:24.00 bitrate=4083.3kbits/s speed=2.98x\nvideo:11635kB audio:313kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.120162%\n[libx264 @ 0x5b99046ce340] frame I:3     Avg QP:20.33  size: 22274\n[libx264 @ 0x5b99046ce340] frame P:598   Avg QP:22.83  size: 19811\n[libx264 @ 0x5b99046ce340] mb I  I16..4: 100.0%  0.0%  0.0%\n[libx264 @ 0x5b99046ce340] mb P  I16..4: 18.8%  0.0%  0.0%  P16..4: 12.8%  0.0%  0.0%  0.0%  0.0%    skip:68.5%\n[libx264 @ 0x5b99046ce340] coded y,uvDC,uvAC intra: 46.5% 43.5% 25.1% inter: 9.7% 10.0% 4.3%\n[libx264 @ 0x5b99046ce340] i16 v,h,dc,p: 46% 31% 14%  9%\n[libx264 @ 0x5b99046ce340] i8c dc,h,v,p: 48% 28% 18%  5%\n[libx264 @ 0x5b99046ce340] kb/s:3964.59",
  "metrics": {
    "predict_time": 35.685892,
    "total_time": 35.701488
  },
  "output": "https://replicate.delivery/pbxt/b2zoyhWgEH6BGdfEUaDT0HkX81qbG3tt27wMZYUYou7CTqfRA/output.mp4",
  "started_at": "2023-12-05T21:34:26.286586Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/xhv2sqjbn6lpmc4nf26qnvvp4e",
    "cancel": "https://api.replicate.com/v1/predictions/xhv2sqjbn6lpmc4nf26qnvvp4e/cancel"
  },
  "version": "8499ec8fa334edc818d2ad4a5250b123469ed8e422ec64309a75fe5e7c896f20"
}

Generated in

35.7 seconds

Tweak itReport

ffmpeg version 5.1.4-0+deb12u1 Copyright (c) 2000-2023 the FFmpeg developers
built with gcc 12 (Debian 12.2.0-14)
configuration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared
libavutil      57. 28.100 / 57. 28.100
libavcodec     59. 37.100 / 59. 37.100
libavformat    59. 27.100 / 59. 27.100
libavdevice    59.  7.100 / 59.  7.100
libavfilter     8. 44.100 /  8. 44.100
libswscale      6.  7.100 /  6.  7.100
libswresample   4.  7.100 /  4.  7.100
libpostproc    56.  6.100 / 56.  6.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/tmp47deo1dy/tmp8lgh5ct7birds.mp4':
Metadata:
major_brand     : mp42
minor_version   : 0
compatible_brands: isommp42
creation_time   : 2022-12-11T06:20:51.000000Z
Duration: 00:00:20.06, start: 0.000000, bitrate: 2190 kb/s
Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 2059 kb/s, 29.97 fps, 29.97 tbr, 30k tbn (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> png (native))
Press [q] to stop, [?] for help
Output #0, image2, to '/tmp/tmp.coyXXpgvyg/input_%03d.png':
Metadata:
major_brand     : mp42
minor_version   : 0
compatible_brands: isommp42
encoder         : Lavf59.27.100
Stream #0:0(und): Video: png, rgb24(pc, gbr/bt709/bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 29.97 fps, 29.97 tbn (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
encoder         : Lavc59.37.100 png
frame=    1 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x
frame=   35 fps=0.0 q=-0.0 size=N/A time=00:00:00.90 bitrate=N/A speed=1.61x
frame=   66 fps= 62 q=-0.0 size=N/A time=00:00:01.93 bitrate=N/A speed=1.83x
frame=   95 fps= 61 q=-0.0 size=N/A time=00:00:02.90 bitrate=N/A speed=1.86x
frame=  128 fps= 62 q=-0.0 size=N/A time=00:00:04.00 bitrate=N/A speed=1.93x
frame=  161 fps= 62 q=-0.0 size=N/A time=00:00:05.10 bitrate=N/A speed=1.97x
frame=  190 fps= 61 q=-0.0 size=N/A time=00:00:06.07 bitrate=N/A speed=1.96x
frame=  222 fps= 61 q=-0.0 size=N/A time=00:00:07.14 bitrate=N/A speed=1.96x
frame=  253 fps= 61 q=-0.0 size=N/A time=00:00:08.17 bitrate=N/A speed=1.96x
frame=  284 fps= 61 q=-0.0 size=N/A time=00:00:09.20 bitrate=N/A speed=1.97x
frame=  315 fps= 61 q=-0.0 size=N/A time=00:00:10.24 bitrate=N/A speed=1.98x
frame=  347 fps= 61 q=-0.0 size=N/A time=00:00:11.31 bitrate=N/A speed=1.99x
frame=  379 fps= 61 q=-0.0 size=N/A time=00:00:12.37 bitrate=N/A speed=   2x
frame=  409 fps= 61 q=-0.0 size=N/A time=00:00:13.38 bitrate=N/A speed=   2x
frame=  441 fps= 61 q=-0.0 size=N/A time=00:00:14.44 bitrate=N/A speed=2.01x
frame=  473 fps= 61 q=-0.0 size=N/A time=00:00:15.51 bitrate=N/A speed=2.01x
frame=  503 fps= 61 q=-0.0 size=N/A time=00:00:16.51 bitrate=N/A speed=   2x
frame=  535 fps= 61 q=-0.0 size=N/A time=00:00:17.58 bitrate=N/A speed=2.01x
frame=  566 fps= 61 q=-0.0 size=N/A time=00:00:18.61 bitrate=N/A speed=2.01x
frame=  596 fps= 61 q=-0.0 size=N/A time=00:00:19.61 bitrate=N/A speed=   2x
frame=  601 fps= 60 q=-0.0 Lsize=N/A time=00:00:20.05 bitrate=N/A speed=2.02x
video:410339kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 5.1.4-0+deb12u1 Copyright (c) 2000-2023 the FFmpeg developers
built with gcc 12 (Debian 12.2.0-14)
configuration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared
libavutil      57. 28.100 / 57. 28.100
libavcodec     59. 37.100 / 59. 37.100
libavformat    59. 27.100 / 59. 27.100
libavdevice    59.  7.100 / 59.  7.100
libavfilter     8. 44.100 /  8. 44.100
libswscale      6.  7.100 /  6.  7.100
libswresample   4.  7.100 /  4.  7.100
libpostproc    56.  6.100 / 56.  6.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/tmp47deo1dy/tmp8lgh5ct7birds.mp4':
Metadata:
major_brand     : mp42
minor_version   : 0
compatible_brands: isommp42
creation_time   : 2022-12-11T06:20:51.000000Z
Duration: 00:00:20.06, start: 0.000000, bitrate: 2190 kb/s
Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 2059 kb/s, 29.97 fps, 29.97 tbr, 30k tbn (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> png (native))
Press [q] to stop, [?] for help
Output #0, image2, to '/tmp/tmp.coyXXpgvyg/inverted_halfopacity_%03d.png':
Metadata:
major_brand     : mp42
minor_version   : 0
compatible_brands: isommp42
encoder         : Lavf59.27.100
Stream #0:0(und): Video: png, rgba(pc, gbr/bt709/bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 29.97 fps, 29.97 tbn (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
encoder         : Lavc59.37.100 png
frame=    1 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x
frame=   22 fps=0.0 q=-0.0 size=N/A time=00:00:00.46 bitrate=N/A speed=0.847x
frame=   42 fps= 40 q=-0.0 size=N/A time=00:00:01.13 bitrate=N/A speed=1.07x
frame=   61 fps= 39 q=-0.0 size=N/A time=00:00:01.76 bitrate=N/A speed=1.13x
frame=   80 fps= 38 q=-0.0 size=N/A time=00:00:02.40 bitrate=N/A speed=1.16x
frame=   99 fps= 38 q=-0.0 size=N/A time=00:00:03.03 bitrate=N/A speed=1.17x
frame=  117 fps= 38 q=-0.0 size=N/A time=00:00:03.63 bitrate=N/A speed=1.17x
frame=  138 fps= 38 q=-0.0 size=N/A time=00:00:04.33 bitrate=N/A speed= 1.2x
frame=  158 fps= 38 q=-0.0 size=N/A time=00:00:05.00 bitrate=N/A speed=1.21x
frame=  178 fps= 38 q=-0.0 size=N/A time=00:00:05.67 bitrate=N/A speed=1.22x
frame=  197 fps= 38 q=-0.0 size=N/A time=00:00:06.30 bitrate=N/A speed=1.21x
frame=  216 fps= 38 q=-0.0 size=N/A time=00:00:06.94 bitrate=N/A speed=1.21x
frame=  238 fps= 38 q=-0.0 size=N/A time=00:00:07.67 bitrate=N/A speed=1.22x
frame=  254 fps= 37 q=-0.0 size=N/A time=00:00:08.20 bitrate=N/A speed=1.21x
frame=  277 fps= 38 q=-0.0 size=N/A time=00:00:08.97 bitrate=N/A speed=1.23x
frame=  296 fps= 38 q=-0.0 size=N/A time=00:00:09.60 bitrate=N/A speed=1.23x
frame=  316 fps= 38 q=-0.0 size=N/A time=00:00:10.27 bitrate=N/A speed=1.23x
frame=  334 fps= 38 q=-0.0 size=N/A time=00:00:10.87 bitrate=N/A speed=1.23x
frame=  354 fps= 38 q=-0.0 size=N/A time=00:00:11.54 bitrate=N/A speed=1.24x
frame=  375 fps= 38 q=-0.0 size=N/A time=00:00:12.24 bitrate=N/A speed=1.24x
frame=  395 fps= 38 q=-0.0 size=N/A time=00:00:12.91 bitrate=N/A speed=1.24x
frame=  415 fps= 38 q=-0.0 size=N/A time=00:00:13.58 bitrate=N/A speed=1.25x
frame=  436 fps= 38 q=-0.0 size=N/A time=00:00:14.28 bitrate=N/A speed=1.25x
frame=  457 fps= 38 q=-0.0 size=N/A time=00:00:14.98 bitrate=N/A speed=1.25x
frame=  477 fps= 38 q=-0.0 size=N/A time=00:00:15.64 bitrate=N/A speed=1.25x
frame=  495 fps= 38 q=-0.0 size=N/A time=00:00:16.24 bitrate=N/A speed=1.25x
frame=  514 fps= 38 q=-0.0 size=N/A time=00:00:16.88 bitrate=N/A speed=1.25x
frame=  534 fps= 38 q=-0.0 size=N/A time=00:00:17.55 bitrate=N/A speed=1.25x
frame=  552 fps= 38 q=-0.0 size=N/A time=00:00:18.15 bitrate=N/A speed=1.24x
frame=  574 fps= 38 q=-0.0 size=N/A time=00:00:18.88 bitrate=N/A speed=1.25x
frame=  593 fps= 38 q=-0.0 size=N/A time=00:00:19.51 bitrate=N/A speed=1.25x
frame=  601 fps= 38 q=-0.0 Lsize=N/A time=00:00:20.05 bitrate=N/A speed=1.26x
video:437606kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 5.1.4-0+deb12u1 Copyright (c) 2000-2023 the FFmpeg developers
built with gcc 12 (Debian 12.2.0-14)
configuration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared
libavutil      57. 28.100 / 57. 28.100
libavcodec     59. 37.100 / 59. 37.100
libavformat    59. 27.100 / 59. 27.100
libavdevice    59.  7.100 / 59.  7.100
libavfilter     8. 44.100 /  8. 44.100
libswscale      6.  7.100 /  6.  7.100
libswresample   4.  7.100 /  4.  7.100
libpostproc    56.  6.100 / 56.  6.100
Input #0, image2, from '/tmp/tmp.coyXXpgvyg/input_%03d.png':
Duration: 00:00:24.04, start: 0.000000, bitrate: N/A
Stream #0:0: Video: png, rgb24(pc), 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 25 tbn
Input #1, image2, from '/tmp/tmp.coyXXpgvyg/inverted_halfopacity_%03d.png':
Duration: 00:00:24.00, start: 0.000000, bitrate: N/A
Stream #1:0: Video: png, rgba(pc), 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 25 tbn
Input #2, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/tmp47deo1dy/tmp8lgh5ct7birds.mp4':
Metadata:
major_brand     : mp42
minor_version   : 0
compatible_brands: isommp42
creation_time   : 2022-12-11T06:20:51.000000Z
Duration: 00:00:20.06, start: 0.000000, bitrate: 2190 kb/s
Stream #2:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 2059 kb/s, 29.97 fps, 29.97 tbr, 30k tbn (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
Stream #2:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
Stream mapping:
Stream #0:0 (png) -> overlay
Stream #1:0 (png) -> overlay
overlay:default -> Stream #0:0 (libx264)
Stream #2:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
[image2 @ 0x5b990451ecc0] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)
[image2 @ 0x5b9904523280] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)
[libx264 @ 0x5b99046ce340] using SAR=1/1
[libx264 @ 0x5b99046ce340] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x5b99046ce340] profile Constrained Baseline, level 3.1, 4:2:0, 8-bit
[libx264 @ 0x5b99046ce340] 264 - core 164 r3095 baee400 - H.264/MPEG-4 AVC codec - Copyleft 2003-2022 - http://www.videolan.org/x264.html - options: cabac=0 ref=1 deblock=0:0:0 analyse=0:0 me=dia subme=0 psy=1 psy_rd=1.00:0.00 mixed_ref=0 me_range=16 chroma_me=1 trellis=0 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=0 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=0 keyint=250 keyint_min=25 scenecut=0 intra_refresh=0 rc=crf mbtree=0 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=0
Output #0, mp4, to '/tmp/tmp47deo1dy/output.mp4':
Metadata:
encoder         : Lavf59.27.100
Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 25 fps, 12800 tbn
Metadata:
encoder         : Lavc59.37.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
Metadata:
creation_time   : 2022-12-11T06:20:51.000000Z
handler_name    : ISO Media file produced by Google Inc. Created on: 12/10/2022.
vendor_id       : [0][0][0][0]
frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x
frame=   24 fps=0.0 q=22.0 size=       0kB time=00:00:00.40 bitrate=   1.0kbits/s speed=0.675x
frame=   63 fps= 58 q=22.0 size=     768kB time=00:00:01.96 bitrate=3210.0kbits/s speed=1.79x
frame=  101 fps= 63 q=23.0 size=    1536kB time=00:00:03.50 bitrate=3588.9kbits/s speed=2.19x
frame=  138 fps= 65 q=22.0 size=    2304kB time=00:00:04.96 bitrate=3798.4kbits/s speed=2.36x
frame=  177 fps= 68 q=23.0 size=    3072kB time=00:00:06.54 bitrate=3843.3kbits/s speed=2.51x
frame=  215 fps= 69 q=22.0 size=    3840kB time=00:00:08.04 bitrate=3912.6kbits/s speed=2.58x
frame=  253 fps= 70 q=20.0 size=    4608kB time=00:00:09.56 bitrate=3945.9kbits/s speed=2.65x
frame=  290 fps= 70 q=23.0 size=    5376kB time=00:00:11.05 bitrate=3984.6kbits/s speed=2.69x
frame=  329 fps= 71 q=22.0 size=    6144kB time=00:00:12.60 bitrate=3991.9kbits/s speed=2.73x
frame=  370 fps= 72 q=23.0 size=    6656kB time=00:00:14.24 bitrate=3829.1kbits/s speed=2.78x
frame=  409 fps= 73 q=23.0 size=    7424kB time=00:00:15.80 bitrate=3849.2kbits/s speed=2.81x
frame=  447 fps= 73 q=23.0 size=    8192kB time=00:00:17.32 bitrate=3874.2kbits/s speed=2.83x
frame=  487 fps= 73 q=24.0 size=    8960kB time=00:00:18.92 bitrate=3878.7kbits/s speed=2.85x
frame=  526 fps= 74 q=23.0 size=    9728kB time=00:00:20.48 bitrate=3891.2kbits/s speed=2.87x
frame=  566 fps= 74 q=22.0 size=    9728kB time=00:00:22.08 bitrate=3609.2kbits/s speed=2.89x
frame=  601 fps= 75 q=-1.0 Lsize=   11963kB time=00:00:24.00 bitrate=4083.3kbits/s speed=2.98x
video:11635kB audio:313kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.120162%
[libx264 @ 0x5b99046ce340] frame I:3     Avg QP:20.33  size: 22274
[libx264 @ 0x5b99046ce340] frame P:598   Avg QP:22.83  size: 19811
[libx264 @ 0x5b99046ce340] mb I  I16..4: 100.0%  0.0%  0.0%
[libx264 @ 0x5b99046ce340] mb P  I16..4: 18.8%  0.0%  0.0%  P16..4: 12.8%  0.0%  0.0%  0.0%  0.0%    skip:68.5%
[libx264 @ 0x5b99046ce340] coded y,uvDC,uvAC intra: 46.5% 43.5% 25.1% inter: 9.7% 10.0% 4.3%
[libx264 @ 0x5b99046ce340] i16 v,h,dc,p: 46% 31% 14%  9%
[libx264 @ 0x5b99046ce340] i8c dc,h,v,p: 48% 28% 18%  5%
[libx264 @ 0x5b99046ce340] kb/s:3964.59

This output was created using a different version of the model, chigozienri/posy-motion-extraction:8499ec8f.

Examples

View more examples

Run time and cost

This model costs approximately $0.0052 to run on Replicate, or 192 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on CPU hardware. Predictions typically complete within 52 seconds. The predict time for this model varies significantly based on the inputs.

Readme

https://github.com/chigozienri/cog-posy-motion-extraction