lucataco / depth-anything-video
Depth Anything on full video files
Prediction
lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6dIDp7dd25rbq6envjxwd4pvynqsnaStatusSucceededSourceWebHardwareT4Total durationCreatedInput
- video
- encoder
- vits
{ "video": "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", "encoder": "vits" }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", { input: { video: "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", encoder: "vits" } } ); // To access the file URL: console.log(output.url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", input={ "video": "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", "encoder": "vits" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", "input": { "video": "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", "encoder": "vits" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-02-09T19:32:37.056153Z", "created_at": "2024-02-09T19:32:19.403468Z", "data_removed": false, "error": null, "id": "p7dd25rbq6envjxwd4pvynqsna", "input": { "video": "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", "encoder": "vits" }, "logs": "Processing /tmp/tmp8libbdowdolphins.mp4\n/root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset\nwarnings.warn(\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil 56. 70.100 / 56. 70.100\nlibavcodec 58.134.100 / 58.134.100\nlibavformat 58. 76.100 / 58. 76.100\nlibavdevice 58. 13.100 / 58. 13.100\nlibavfilter 7.110.100 / 7.110.100\nlibswscale 5. 9.100 / 5. 9.100\nlibswresample 3. 9.100 / 3. 9.100\nlibpostproc 55. 9.100 / 55. 9.100\nInput #0, image2, from '/tmp/frames/depth-%d.png':\nDuration: 00:00:02.36, start: 0.000000, bitrate: N/A\nStream #0:0: Video: png, rgb24(pc), 960x540, 25 fps, 25 tbr, 25 tbn, 25 tbc\nStream mapping:\nStream #0:0 -> #0:0 (png (native) -> h264 (libx264))\nPress [q] to stop, [?] for help\n[libx264 @ 0x5a7ad75f8400] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x5a7ad75f8400] profile High, level 3.1, 4:2:0, 8-bit\n[libx264 @ 0x5a7ad75f8400] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to '/tmp/output.mp4':\nMetadata:\nencoder : Lavf58.76.100\nStream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 960x540, q=2-31, 24 fps, 12288 tbn\nMetadata:\nencoder : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nframe= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 27 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 59 fps= 51 q=30.0 size= 0kB time=00:00:00.00 bitrate=4740.7kbits/s speed=6.98e-05x\nframe= 59 fps= 35 q=-1.0 Lsize= 332kB time=00:00:02.33 bitrate=1167.3kbits/s speed=1.39x\nvideo:331kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.455267%\n[libx264 @ 0x5a7ad75f8400] frame I:1 Avg QP:24.65 size: 11663\n[libx264 @ 0x5a7ad75f8400] frame P:20 Avg QP:27.02 size: 7248\n[libx264 @ 0x5a7ad75f8400] frame B:38 Avg QP:28.37 size: 4779\n[libx264 @ 0x5a7ad75f8400] consecutive B-frames: 8.5% 13.6% 10.2% 67.8%\n[libx264 @ 0x5a7ad75f8400] mb I I16..4: 30.2% 59.3% 10.5%\n[libx264 @ 0x5a7ad75f8400] mb P I16..4: 18.4% 17.8% 2.9% P16..4: 20.2% 5.7% 1.5% 0.0% 0.0% skip:33.5%\n[libx264 @ 0x5a7ad75f8400] mb B I16..4: 5.5% 4.6% 0.6% B16..8: 29.4% 7.3% 1.1% direct: 1.6% skip:50.0% L0:50.4% L1:45.0% BI: 4.6%\n[libx264 @ 0x5a7ad75f8400] 8x8 transform intra:45.7% inter:73.0%\n[libx264 @ 0x5a7ad75f8400] coded y,uvDC,uvAC intra: 13.0% 54.6% 17.0% inter: 7.8% 14.0% 1.9%\n[libx264 @ 0x5a7ad75f8400] i16 v,h,dc,p: 9% 44% 5% 42%\n[libx264 @ 0x5a7ad75f8400] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 16% 29% 38% 3% 3% 2% 5% 1% 3%\n[libx264 @ 0x5a7ad75f8400] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 14% 27% 38% 3% 3% 2% 6% 2% 4%\n[libx264 @ 0x5a7ad75f8400] i8c dc,h,v,p: 35% 41% 9% 15%\n[libx264 @ 0x5a7ad75f8400] Weighted P-Frames: Y:0.0% UV:0.0%\n[libx264 @ 0x5a7ad75f8400] ref P L0: 56.7% 7.0% 24.7% 11.7%\n[libx264 @ 0x5a7ad75f8400] ref B L0: 80.3% 16.2% 3.5%\n[libx264 @ 0x5a7ad75f8400] ref B L1: 92.4% 7.6%\n[libx264 @ 0x5a7ad75f8400] kb/s:1100.69", "metrics": { "predict_time": 17.636859, "total_time": 17.652685 }, "output": "https://replicate.delivery/pbxt/cbA6jk39GnJ5F9a70DTRhdFc30ZFNT89iBIREfMuBgWqfCVSA/output.mp4", "started_at": "2024-02-09T19:32:19.419294Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/p7dd25rbq6envjxwd4pvynqsna", "cancel": "https://api.replicate.com/v1/predictions/p7dd25rbq6envjxwd4pvynqsna/cancel" }, "version": "9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d" }Generated inProcessing /tmp/tmp8libbdowdolphins.mp4 /root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset warnings.warn( ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers built with gcc 11 (Ubuntu 11.2.0-19ubuntu1) configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 70.100 / 56. 70.100 libavcodec 58.134.100 / 58.134.100 libavformat 58. 76.100 / 58. 76.100 libavdevice 58. 13.100 / 58. 13.100 libavfilter 7.110.100 / 7.110.100 libswscale 5. 9.100 / 5. 9.100 libswresample 3. 9.100 / 3. 9.100 libpostproc 55. 9.100 / 55. 9.100 Input #0, image2, from '/tmp/frames/depth-%d.png': Duration: 00:00:02.36, start: 0.000000, bitrate: N/A Stream #0:0: Video: png, rgb24(pc), 960x540, 25 fps, 25 tbr, 25 tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (png (native) -> h264 (libx264)) Press [q] to stop, [?] for help [libx264 @ 0x5a7ad75f8400] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 [libx264 @ 0x5a7ad75f8400] profile High, level 3.1, 4:2:0, 8-bit [libx264 @ 0x5a7ad75f8400] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/tmp/output.mp4': Metadata: encoder : Lavf58.76.100 Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 960x540, q=2-31, 24 fps, 12288 tbn Metadata: encoder : Lavc58.134.100 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 27 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 59 fps= 51 q=30.0 size= 0kB time=00:00:00.00 bitrate=4740.7kbits/s speed=6.98e-05x frame= 59 fps= 35 q=-1.0 Lsize= 332kB time=00:00:02.33 bitrate=1167.3kbits/s speed=1.39x video:331kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.455267% [libx264 @ 0x5a7ad75f8400] frame I:1 Avg QP:24.65 size: 11663 [libx264 @ 0x5a7ad75f8400] frame P:20 Avg QP:27.02 size: 7248 [libx264 @ 0x5a7ad75f8400] frame B:38 Avg QP:28.37 size: 4779 [libx264 @ 0x5a7ad75f8400] consecutive B-frames: 8.5% 13.6% 10.2% 67.8% [libx264 @ 0x5a7ad75f8400] mb I I16..4: 30.2% 59.3% 10.5% [libx264 @ 0x5a7ad75f8400] mb P I16..4: 18.4% 17.8% 2.9% P16..4: 20.2% 5.7% 1.5% 0.0% 0.0% skip:33.5% [libx264 @ 0x5a7ad75f8400] mb B I16..4: 5.5% 4.6% 0.6% B16..8: 29.4% 7.3% 1.1% direct: 1.6% skip:50.0% L0:50.4% L1:45.0% BI: 4.6% [libx264 @ 0x5a7ad75f8400] 8x8 transform intra:45.7% inter:73.0% [libx264 @ 0x5a7ad75f8400] coded y,uvDC,uvAC intra: 13.0% 54.6% 17.0% inter: 7.8% 14.0% 1.9% [libx264 @ 0x5a7ad75f8400] i16 v,h,dc,p: 9% 44% 5% 42% [libx264 @ 0x5a7ad75f8400] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 16% 29% 38% 3% 3% 2% 5% 1% 3% [libx264 @ 0x5a7ad75f8400] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 14% 27% 38% 3% 3% 2% 6% 2% 4% [libx264 @ 0x5a7ad75f8400] i8c dc,h,v,p: 35% 41% 9% 15% [libx264 @ 0x5a7ad75f8400] Weighted P-Frames: Y:0.0% UV:0.0% [libx264 @ 0x5a7ad75f8400] ref P L0: 56.7% 7.0% 24.7% 11.7% [libx264 @ 0x5a7ad75f8400] ref B L0: 80.3% 16.2% 3.5% [libx264 @ 0x5a7ad75f8400] ref B L1: 92.4% 7.6% [libx264 @ 0x5a7ad75f8400] kb/s:1100.69Prediction
lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6dIDhon62ijbdcxlogdvv72v7ki47yStatusSucceededSourceWebHardwareT4Total durationCreatedInput
- video
- encoder
- vits
{ "video": "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", "encoder": "vits" }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", { input: { video: "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", encoder: "vits" } } ); // To access the file URL: console.log(output.url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", input={ "video": "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", "encoder": "vits" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", "input": { "video": "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", "encoder": "vits" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-02-09T19:33:02.073286Z", "created_at": "2024-02-09T19:32:42.455003Z", "data_removed": false, "error": null, "id": "hon62ijbdcxlogdvv72v7ki47y", "input": { "video": "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", "encoder": "vits" }, "logs": "Processing /tmp/tmp4y6zrp4wrollercoaster.mp4\n/root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset\nwarnings.warn(\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil 56. 70.100 / 56. 70.100\nlibavcodec 58.134.100 / 58.134.100\nlibavformat 58. 76.100 / 58. 76.100\nlibavdevice 58. 13.100 / 58. 13.100\nlibavfilter 7.110.100 / 7.110.100\nlibswscale 5. 9.100 / 5. 9.100\nlibswresample 3. 9.100 / 3. 9.100\nlibpostproc 55. 9.100 / 55. 9.100\nInput #0, image2, from '/tmp/frames/depth-%d.png':\nDuration: 00:00:02.80, start: 0.000000, bitrate: N/A\nStream #0:0: Video: png, rgb24(pc), 960x540, 25 fps, 25 tbr, 25 tbn, 25 tbc\nStream mapping:\nStream #0:0 -> #0:0 (png (native) -> h264 (libx264))\nPress [q] to stop, [?] for help\n[libx264 @ 0x56de205032c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x56de205032c0] profile High, level 3.1, 4:2:0, 8-bit\n[libx264 @ 0x56de205032c0] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to '/tmp/output.mp4':\nMetadata:\nencoder : Lavf58.76.100\nStream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 960x540, q=2-31, 24 fps, 12288 tbn\nMetadata:\nencoder : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nframe= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 51 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 70 fps= 55 q=-1.0 Lsize= 1075kB time=00:00:02.79 bitrate=3153.4kbits/s speed=2.19x\nvideo:1073kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.156088%\n[libx264 @ 0x56de205032c0] frame I:1 Avg QP:27.39 size: 29933\n[libx264 @ 0x56de205032c0] frame P:18 Avg QP:31.32 size: 21204\n[libx264 @ 0x56de205032c0] frame B:51 Avg QP:33.84 size: 13460\n[libx264 @ 0x56de205032c0] consecutive B-frames: 2.9% 0.0% 0.0% 97.1%\n[libx264 @ 0x56de205032c0] mb I I16..4: 20.7% 45.9% 33.4%\n[libx264 @ 0x56de205032c0] mb P I16..4: 2.5% 9.1% 9.7% P16..4: 10.3% 12.2% 8.1% 0.0% 0.0% skip:48.1%\n[libx264 @ 0x56de205032c0] mb B I16..4: 1.4% 1.8% 1.5% B16..8: 16.9% 16.3% 8.3% direct: 2.5% skip:51.3% L0:47.1% L1:44.4% BI: 8.5%\n[libx264 @ 0x56de205032c0] 8x8 transform intra:41.7% inter:21.1%\n[libx264 @ 0x56de205032c0] coded y,uvDC,uvAC intra: 35.7% 67.4% 53.5% inter: 17.1% 22.0% 7.0%\n[libx264 @ 0x56de205032c0] i16 v,h,dc,p: 43% 29% 9% 19%\n[libx264 @ 0x56de205032c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 24% 15% 45% 2% 3% 4% 3% 2% 2%\n[libx264 @ 0x56de205032c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 30% 18% 30% 3% 4% 4% 6% 3% 3%\n[libx264 @ 0x56de205032c0] i8c dc,h,v,p: 44% 23% 28% 5%\n[libx264 @ 0x56de205032c0] Weighted P-Frames: Y:50.0% UV:38.9%\n[libx264 @ 0x56de205032c0] ref P L0: 46.7% 7.7% 21.8% 16.6% 7.2%\n[libx264 @ 0x56de205032c0] ref B L0: 78.2% 17.3% 4.5%\n[libx264 @ 0x56de205032c0] ref B L1: 85.8% 14.2%\n[libx264 @ 0x56de205032c0] kb/s:3011.79", "metrics": { "predict_time": 19.598379, "total_time": 19.618283 }, "output": "https://replicate.delivery/pbxt/Y3pgBbUUi4YONd1Pd6F8pYvSX3WHCsLKzCbX3VAmiVd7vQlE/output.mp4", "started_at": "2024-02-09T19:32:42.474907Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/hon62ijbdcxlogdvv72v7ki47y", "cancel": "https://api.replicate.com/v1/predictions/hon62ijbdcxlogdvv72v7ki47y/cancel" }, "version": "9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d" }Generated inProcessing /tmp/tmp4y6zrp4wrollercoaster.mp4 /root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset warnings.warn( ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers built with gcc 11 (Ubuntu 11.2.0-19ubuntu1) configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 70.100 / 56. 70.100 libavcodec 58.134.100 / 58.134.100 libavformat 58. 76.100 / 58. 76.100 libavdevice 58. 13.100 / 58. 13.100 libavfilter 7.110.100 / 7.110.100 libswscale 5. 9.100 / 5. 9.100 libswresample 3. 9.100 / 3. 9.100 libpostproc 55. 9.100 / 55. 9.100 Input #0, image2, from '/tmp/frames/depth-%d.png': Duration: 00:00:02.80, start: 0.000000, bitrate: N/A Stream #0:0: Video: png, rgb24(pc), 960x540, 25 fps, 25 tbr, 25 tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (png (native) -> h264 (libx264)) Press [q] to stop, [?] for help [libx264 @ 0x56de205032c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 [libx264 @ 0x56de205032c0] profile High, level 3.1, 4:2:0, 8-bit [libx264 @ 0x56de205032c0] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/tmp/output.mp4': Metadata: encoder : Lavf58.76.100 Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 960x540, q=2-31, 24 fps, 12288 tbn Metadata: encoder : Lavc58.134.100 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 51 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 70 fps= 55 q=-1.0 Lsize= 1075kB time=00:00:02.79 bitrate=3153.4kbits/s speed=2.19x video:1073kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.156088% [libx264 @ 0x56de205032c0] frame I:1 Avg QP:27.39 size: 29933 [libx264 @ 0x56de205032c0] frame P:18 Avg QP:31.32 size: 21204 [libx264 @ 0x56de205032c0] frame B:51 Avg QP:33.84 size: 13460 [libx264 @ 0x56de205032c0] consecutive B-frames: 2.9% 0.0% 0.0% 97.1% [libx264 @ 0x56de205032c0] mb I I16..4: 20.7% 45.9% 33.4% [libx264 @ 0x56de205032c0] mb P I16..4: 2.5% 9.1% 9.7% P16..4: 10.3% 12.2% 8.1% 0.0% 0.0% skip:48.1% [libx264 @ 0x56de205032c0] mb B I16..4: 1.4% 1.8% 1.5% B16..8: 16.9% 16.3% 8.3% direct: 2.5% skip:51.3% L0:47.1% L1:44.4% BI: 8.5% [libx264 @ 0x56de205032c0] 8x8 transform intra:41.7% inter:21.1% [libx264 @ 0x56de205032c0] coded y,uvDC,uvAC intra: 35.7% 67.4% 53.5% inter: 17.1% 22.0% 7.0% [libx264 @ 0x56de205032c0] i16 v,h,dc,p: 43% 29% 9% 19% [libx264 @ 0x56de205032c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 24% 15% 45% 2% 3% 4% 3% 2% 2% [libx264 @ 0x56de205032c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 30% 18% 30% 3% 4% 4% 6% 3% 3% [libx264 @ 0x56de205032c0] i8c dc,h,v,p: 44% 23% 28% 5% [libx264 @ 0x56de205032c0] Weighted P-Frames: Y:50.0% UV:38.9% [libx264 @ 0x56de205032c0] ref P L0: 46.7% 7.7% 21.8% 16.6% 7.2% [libx264 @ 0x56de205032c0] ref B L0: 78.2% 17.3% 4.5% [libx264 @ 0x56de205032c0] ref B L1: 85.8% 14.2% [libx264 @ 0x56de205032c0] kb/s:3011.79Prediction
lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6dIDnzv2anzboxw3fqqq6o27chmr2iStatusSucceededSourceWebHardwareT4Total durationCreatedInput
- video
- encoder
- vits
{ "video": "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", "encoder": "vits" }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", { input: { video: "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", encoder: "vits" } } ); // To access the file URL: console.log(output.url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", input={ "video": "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", "encoder": "vits" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", "input": { "video": "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", "encoder": "vits" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-02-09T19:33:50.579000Z", "created_at": "2024-02-09T19:33:10.749181Z", "data_removed": false, "error": null, "id": "nzv2anzboxw3fqqq6o27chmr2i", "input": { "video": "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", "encoder": "vits" }, "logs": "Processing /tmp/tmprjza_xe3seasnake.mp4\n/root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset\nwarnings.warn(\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil 56. 70.100 / 56. 70.100\nlibavcodec 58.134.100 / 58.134.100\nlibavformat 58. 76.100 / 58. 76.100\nlibavdevice 58. 13.100 / 58. 13.100\nlibavfilter 7.110.100 / 7.110.100\nlibswscale 5. 9.100 / 5. 9.100\nlibswresample 3. 9.100 / 3. 9.100\nlibpostproc 55. 9.100 / 55. 9.100\nInput #0, image2, from '/tmp/frames/depth-%d.png':\nDuration: 00:00:03.20, start: 0.000000, bitrate: N/A\nStream #0:0: Video: png, rgb24(pc), 1920x1080, 25 fps, 25 tbr, 25 tbn, 25 tbc\nStream mapping:\nStream #0:0 -> #0:0 (png (native) -> h264 (libx264))\nPress [q] to stop, [?] for help\n[libx264 @ 0x5699dd544380] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x5699dd544380] profile High, level 4.0, 4:2:0, 8-bit\n[libx264 @ 0x5699dd544380] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to '/tmp/output.mp4':\nMetadata:\nencoder : Lavf58.76.100\nStream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 1920x1080, q=2-31, 24 fps, 12288 tbn\nMetadata:\nencoder : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nframe= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 19 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 38 fps= 36 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 47 fps= 26 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 62 fps= 26 q=30.0 size= 0kB time=00:00:00.12 bitrate= 3.1kbits/s speed=0.0532x\nframe= 71 fps= 25 q=30.0 size= 0kB time=00:00:00.50 bitrate= 0.8kbits/s speed=0.174x\nframe= 80 fps= 16 q=-1.0 Lsize= 809kB time=00:00:03.20 bitrate=2066.3kbits/s speed=0.624x\nvideo:808kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.210413%\n[libx264 @ 0x5699dd544380] frame I:7 Avg QP:20.24 size: 19880\n[libx264 @ 0x5699dd544380] frame P:27 Avg QP:22.87 size: 12204\n[libx264 @ 0x5699dd544380] frame B:46 Avg QP:23.17 size: 7774\n[libx264 @ 0x5699dd544380] consecutive B-frames: 18.8% 7.5% 18.8% 55.0%\n[libx264 @ 0x5699dd544380] mb I I16..4: 51.2% 48.3% 0.4%\n[libx264 @ 0x5699dd544380] mb P I16..4: 21.2% 14.5% 0.0% P16..4: 38.0% 1.9% 0.7% 0.0% 0.0% skip:23.8%\n[libx264 @ 0x5699dd544380] mb B I16..4: 3.4% 2.7% 0.0% B16..8: 40.0% 1.7% 0.0% direct: 1.2% skip:51.0% L0:48.0% L1:51.5% BI: 0.5%\n[libx264 @ 0x5699dd544380] 8x8 transform intra:43.9% inter:99.8%\n[libx264 @ 0x5699dd544380] coded y,uvDC,uvAC intra: 6.1% 41.7% 2.9% inter: 2.4% 9.4% 0.0%\n[libx264 @ 0x5699dd544380] i16 v,h,dc,p: 7% 55% 4% 34%\n[libx264 @ 0x5699dd544380] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 16% 23% 43% 2% 5% 3% 5% 1% 2%\n[libx264 @ 0x5699dd544380] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 17% 20% 46% 2% 8% 2% 4% 1% 1%\n[libx264 @ 0x5699dd544380] i8c dc,h,v,p: 36% 45% 7% 13%\n[libx264 @ 0x5699dd544380] Weighted P-Frames: Y:22.2% UV:22.2%\n[libx264 @ 0x5699dd544380] ref P L0: 51.4% 0.7% 29.0% 13.6% 5.3%\n[libx264 @ 0x5699dd544380] ref B L0: 74.8% 20.4% 4.8%\n[libx264 @ 0x5699dd544380] ref B L1: 89.6% 10.4%\n[libx264 @ 0x5699dd544380] kb/s:1983.01", "metrics": { "predict_time": 39.808361, "total_time": 39.829819 }, "output": "https://replicate.delivery/pbxt/PpitTafTW43vek69S9KyZHtG2VbAPRVWcLLZsczjT5EeAGqkA/output.mp4", "started_at": "2024-02-09T19:33:10.770639Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/nzv2anzboxw3fqqq6o27chmr2i", "cancel": "https://api.replicate.com/v1/predictions/nzv2anzboxw3fqqq6o27chmr2i/cancel" }, "version": "9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d" }Generated inProcessing /tmp/tmprjza_xe3seasnake.mp4 /root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset warnings.warn( ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers built with gcc 11 (Ubuntu 11.2.0-19ubuntu1) configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 70.100 / 56. 70.100 libavcodec 58.134.100 / 58.134.100 libavformat 58. 76.100 / 58. 76.100 libavdevice 58. 13.100 / 58. 13.100 libavfilter 7.110.100 / 7.110.100 libswscale 5. 9.100 / 5. 9.100 libswresample 3. 9.100 / 3. 9.100 libpostproc 55. 9.100 / 55. 9.100 Input #0, image2, from '/tmp/frames/depth-%d.png': Duration: 00:00:03.20, start: 0.000000, bitrate: N/A Stream #0:0: Video: png, rgb24(pc), 1920x1080, 25 fps, 25 tbr, 25 tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (png (native) -> h264 (libx264)) Press [q] to stop, [?] for help [libx264 @ 0x5699dd544380] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 [libx264 @ 0x5699dd544380] profile High, level 4.0, 4:2:0, 8-bit [libx264 @ 0x5699dd544380] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/tmp/output.mp4': Metadata: encoder : Lavf58.76.100 Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 1920x1080, q=2-31, 24 fps, 12288 tbn Metadata: encoder : Lavc58.134.100 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 19 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 38 fps= 36 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 47 fps= 26 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 62 fps= 26 q=30.0 size= 0kB time=00:00:00.12 bitrate= 3.1kbits/s speed=0.0532x frame= 71 fps= 25 q=30.0 size= 0kB time=00:00:00.50 bitrate= 0.8kbits/s speed=0.174x frame= 80 fps= 16 q=-1.0 Lsize= 809kB time=00:00:03.20 bitrate=2066.3kbits/s speed=0.624x video:808kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.210413% [libx264 @ 0x5699dd544380] frame I:7 Avg QP:20.24 size: 19880 [libx264 @ 0x5699dd544380] frame P:27 Avg QP:22.87 size: 12204 [libx264 @ 0x5699dd544380] frame B:46 Avg QP:23.17 size: 7774 [libx264 @ 0x5699dd544380] consecutive B-frames: 18.8% 7.5% 18.8% 55.0% [libx264 @ 0x5699dd544380] mb I I16..4: 51.2% 48.3% 0.4% [libx264 @ 0x5699dd544380] mb P I16..4: 21.2% 14.5% 0.0% P16..4: 38.0% 1.9% 0.7% 0.0% 0.0% skip:23.8% [libx264 @ 0x5699dd544380] mb B I16..4: 3.4% 2.7% 0.0% B16..8: 40.0% 1.7% 0.0% direct: 1.2% skip:51.0% L0:48.0% L1:51.5% BI: 0.5% [libx264 @ 0x5699dd544380] 8x8 transform intra:43.9% inter:99.8% [libx264 @ 0x5699dd544380] coded y,uvDC,uvAC intra: 6.1% 41.7% 2.9% inter: 2.4% 9.4% 0.0% [libx264 @ 0x5699dd544380] i16 v,h,dc,p: 7% 55% 4% 34% [libx264 @ 0x5699dd544380] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 16% 23% 43% 2% 5% 3% 5% 1% 2% [libx264 @ 0x5699dd544380] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 17% 20% 46% 2% 8% 2% 4% 1% 1% [libx264 @ 0x5699dd544380] i8c dc,h,v,p: 36% 45% 7% 13% [libx264 @ 0x5699dd544380] Weighted P-Frames: Y:22.2% UV:22.2% [libx264 @ 0x5699dd544380] ref P L0: 51.4% 0.7% 29.0% 13.6% 5.3% [libx264 @ 0x5699dd544380] ref B L0: 74.8% 20.4% 4.8% [libx264 @ 0x5699dd544380] ref B L1: 89.6% 10.4% [libx264 @ 0x5699dd544380] kb/s:1983.01Prediction
lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6dIDmu3vjujb3wv7scsnu4ju6pulqiStatusSucceededSourceWebHardwareT4Total durationCreatedInput
- video
- encoder
- vitb
{ "video": "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", "encoder": "vitb" }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", { input: { video: "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", encoder: "vitb" } } ); // To access the file URL: console.log(output.url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", input={ "video": "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", "encoder": "vitb" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", "input": { "video": "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", "encoder": "vitb" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-02-09T19:34:55.505789Z", "created_at": "2024-02-09T19:34:27.685767Z", "data_removed": false, "error": null, "id": "mu3vjujb3wv7scsnu4ju6pulqi", "input": { "video": "https://replicate.delivery/pbxt/KNKNfiWzJU5YxaSIsrJKBllp1TgjtvQ9urLNlN1biczFBPpe/dolphins.mp4", "encoder": "vitb" }, "logs": "config.json: 0%| | 0.00/957 [00:00<?, ?B/s]\nconfig.json: 100%|██████████| 957/957 [00:00<00:00, 3.27MB/s]\nmodel.safetensors: 0%| | 0.00/390M [00:00<?, ?B/s]\nmodel.safetensors: 3%|▎ | 10.5M/390M [00:00<00:09, 41.1MB/s]\nmodel.safetensors: 8%|▊ | 31.5M/390M [00:00<00:03, 99.6MB/s]\nmodel.safetensors: 13%|█▎ | 52.4M/390M [00:00<00:02, 134MB/s] \nmodel.safetensors: 19%|█▉ | 73.4M/390M [00:00<00:02, 156MB/s]\nmodel.safetensors: 24%|██▍ | 94.4M/390M [00:00<00:01, 172MB/s]\nmodel.safetensors: 30%|██▉ | 115M/390M [00:00<00:01, 182MB/s] \nmodel.safetensors: 35%|███▍ | 136M/390M [00:00<00:01, 188MB/s]\nmodel.safetensors: 43%|████▎ | 168M/390M [00:01<00:01, 196MB/s]\nmodel.safetensors: 48%|████▊ | 189M/390M [00:01<00:01, 197MB/s]\nmodel.safetensors: 54%|█████▍ | 210M/390M [00:01<00:00, 199MB/s]\nmodel.safetensors: 59%|█████▉ | 231M/390M [00:01<00:00, 201MB/s]\nmodel.safetensors: 65%|██████▍ | 252M/390M [00:01<00:00, 201MB/s]\nmodel.safetensors: 70%|██████▉ | 273M/390M [00:01<00:00, 202MB/s]\nmodel.safetensors: 75%|███████▌ | 294M/390M [00:01<00:00, 202MB/s]\nmodel.safetensors: 81%|████████ | 315M/390M [00:01<00:00, 203MB/s]\nmodel.safetensors: 86%|████████▌ | 336M/390M [00:01<00:00, 202MB/s]\nmodel.safetensors: 94%|█████████▍| 367M/390M [00:02<00:00, 205MB/s]\nmodel.safetensors: 100%|█████████▉| 388M/390M [00:02<00:00, 204MB/s]\nmodel.safetensors: 100%|██████████| 390M/390M [00:02<00:00, 183MB/s]\npreprocessor_config.json: 0%| | 0.00/437 [00:00<?, ?B/s]\npreprocessor_config.json: 100%|██████████| 437/437 [00:00<00:00, 1.54MB/s]\nProcessing /tmp/tmp690qt00ldolphins.mp4\n/root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset\nwarnings.warn(\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil 56. 70.100 / 56. 70.100\nlibavcodec 58.134.100 / 58.134.100\nlibavformat 58. 76.100 / 58. 76.100\nlibavdevice 58. 13.100 / 58. 13.100\nlibavfilter 7.110.100 / 7.110.100\nlibswscale 5. 9.100 / 5. 9.100\nlibswresample 3. 9.100 / 3. 9.100\nlibpostproc 55. 9.100 / 55. 9.100\nInput #0, image2, from '/tmp/frames/depth-%d.png':\nDuration: 00:00:02.36, start: 0.000000, bitrate: N/A\nStream #0:0: Video: png, rgb24(pc), 960x540, 25 fps, 25 tbr, 25 tbn, 25 tbc\nStream mapping:\nStream #0:0 -> #0:0 (png (native) -> h264 (libx264))\nPress [q] to stop, [?] for help\n[libx264 @ 0x5cd2892848c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x5cd2892848c0] profile High, level 3.1, 4:2:0, 8-bit\n[libx264 @ 0x5cd2892848c0] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to '/tmp/output.mp4':\nMetadata:\nencoder : Lavf58.76.100\nStream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 960x540, q=2-31, 24 fps, 12288 tbn\nMetadata:\nencoder : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nframe= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 47 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 59 fps= 52 q=-1.0 Lsize= 315kB time=00:00:02.33 bitrate=1105.2kbits/s speed=2.04x\nvideo:313kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.473455%\n[libx264 @ 0x5cd2892848c0] frame I:1 Avg QP:23.28 size: 11106\n[libx264 @ 0x5cd2892848c0] frame P:19 Avg QP:27.36 size: 7259\n[libx264 @ 0x5cd2892848c0] frame B:39 Avg QP:28.73 size: 4388\n[libx264 @ 0x5cd2892848c0] consecutive B-frames: 6.8% 6.8% 25.4% 61.0%\n[libx264 @ 0x5cd2892848c0] mb I I16..4: 53.7% 35.3% 10.9%\n[libx264 @ 0x5cd2892848c0] mb P I16..4: 17.0% 17.2% 3.6% P16..4: 19.7% 5.2% 1.6% 0.0% 0.0% skip:35.7%\n[libx264 @ 0x5cd2892848c0] mb B I16..4: 4.7% 3.6% 0.5% B16..8: 29.4% 6.8% 1.1% direct: 1.3% skip:52.6% L0:46.5% L1:48.7% BI: 4.8%\n[libx264 @ 0x5cd2892848c0] 8x8 transform intra:43.3% inter:71.5%\n[libx264 @ 0x5cd2892848c0] coded y,uvDC,uvAC intra: 13.5% 54.1% 17.9% inter: 6.8% 12.5% 1.6%\n[libx264 @ 0x5cd2892848c0] i16 v,h,dc,p: 11% 45% 5% 39%\n[libx264 @ 0x5cd2892848c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 13% 32% 37% 3% 3% 2% 5% 1% 3%\n[libx264 @ 0x5cd2892848c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 14% 30% 38% 3% 3% 2% 6% 1% 4%\n[libx264 @ 0x5cd2892848c0] i8c dc,h,v,p: 33% 42% 10% 15%\n[libx264 @ 0x5cd2892848c0] Weighted P-Frames: Y:10.5% UV:5.3%\n[libx264 @ 0x5cd2892848c0] ref P L0: 60.3% 7.2% 19.7% 11.0% 1.8%\n[libx264 @ 0x5cd2892848c0] ref B L0: 83.2% 13.0% 3.8%\n[libx264 @ 0x5cd2892848c0] ref B L1: 94.3% 5.7%\n[libx264 @ 0x5cd2892848c0] kb/s:1041.82", "metrics": { "predict_time": 27.803402, "total_time": 27.820022 }, "output": "https://replicate.delivery/pbxt/9tgdk8kQT9JBF5Yt4iT1hpUu207Tyw8f9wOqy2fYM12fCGqkA/output.mp4", "started_at": "2024-02-09T19:34:27.702387Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/mu3vjujb3wv7scsnu4ju6pulqi", "cancel": "https://api.replicate.com/v1/predictions/mu3vjujb3wv7scsnu4ju6pulqi/cancel" }, "version": "9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d" }Generated inconfig.json: 0%| | 0.00/957 [00:00<?, ?B/s] config.json: 100%|██████████| 957/957 [00:00<00:00, 3.27MB/s] model.safetensors: 0%| | 0.00/390M [00:00<?, ?B/s] model.safetensors: 3%|▎ | 10.5M/390M [00:00<00:09, 41.1MB/s] model.safetensors: 8%|▊ | 31.5M/390M [00:00<00:03, 99.6MB/s] model.safetensors: 13%|█▎ | 52.4M/390M [00:00<00:02, 134MB/s] model.safetensors: 19%|█▉ | 73.4M/390M [00:00<00:02, 156MB/s] model.safetensors: 24%|██▍ | 94.4M/390M [00:00<00:01, 172MB/s] model.safetensors: 30%|██▉ | 115M/390M [00:00<00:01, 182MB/s] model.safetensors: 35%|███▍ | 136M/390M [00:00<00:01, 188MB/s] model.safetensors: 43%|████▎ | 168M/390M [00:01<00:01, 196MB/s] model.safetensors: 48%|████▊ | 189M/390M [00:01<00:01, 197MB/s] model.safetensors: 54%|█████▍ | 210M/390M [00:01<00:00, 199MB/s] model.safetensors: 59%|█████▉ | 231M/390M [00:01<00:00, 201MB/s] model.safetensors: 65%|██████▍ | 252M/390M [00:01<00:00, 201MB/s] model.safetensors: 70%|██████▉ | 273M/390M [00:01<00:00, 202MB/s] model.safetensors: 75%|███████▌ | 294M/390M [00:01<00:00, 202MB/s] model.safetensors: 81%|████████ | 315M/390M [00:01<00:00, 203MB/s] model.safetensors: 86%|████████▌ | 336M/390M [00:01<00:00, 202MB/s] model.safetensors: 94%|█████████▍| 367M/390M [00:02<00:00, 205MB/s] model.safetensors: 100%|█████████▉| 388M/390M [00:02<00:00, 204MB/s] model.safetensors: 100%|██████████| 390M/390M [00:02<00:00, 183MB/s] preprocessor_config.json: 0%| | 0.00/437 [00:00<?, ?B/s] preprocessor_config.json: 100%|██████████| 437/437 [00:00<00:00, 1.54MB/s] Processing /tmp/tmp690qt00ldolphins.mp4 /root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset warnings.warn( ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers built with gcc 11 (Ubuntu 11.2.0-19ubuntu1) configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 70.100 / 56. 70.100 libavcodec 58.134.100 / 58.134.100 libavformat 58. 76.100 / 58. 76.100 libavdevice 58. 13.100 / 58. 13.100 libavfilter 7.110.100 / 7.110.100 libswscale 5. 9.100 / 5. 9.100 libswresample 3. 9.100 / 3. 9.100 libpostproc 55. 9.100 / 55. 9.100 Input #0, image2, from '/tmp/frames/depth-%d.png': Duration: 00:00:02.36, start: 0.000000, bitrate: N/A Stream #0:0: Video: png, rgb24(pc), 960x540, 25 fps, 25 tbr, 25 tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (png (native) -> h264 (libx264)) Press [q] to stop, [?] for help [libx264 @ 0x5cd2892848c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 [libx264 @ 0x5cd2892848c0] profile High, level 3.1, 4:2:0, 8-bit [libx264 @ 0x5cd2892848c0] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/tmp/output.mp4': Metadata: encoder : Lavf58.76.100 Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 960x540, q=2-31, 24 fps, 12288 tbn Metadata: encoder : Lavc58.134.100 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 47 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 59 fps= 52 q=-1.0 Lsize= 315kB time=00:00:02.33 bitrate=1105.2kbits/s speed=2.04x video:313kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.473455% [libx264 @ 0x5cd2892848c0] frame I:1 Avg QP:23.28 size: 11106 [libx264 @ 0x5cd2892848c0] frame P:19 Avg QP:27.36 size: 7259 [libx264 @ 0x5cd2892848c0] frame B:39 Avg QP:28.73 size: 4388 [libx264 @ 0x5cd2892848c0] consecutive B-frames: 6.8% 6.8% 25.4% 61.0% [libx264 @ 0x5cd2892848c0] mb I I16..4: 53.7% 35.3% 10.9% [libx264 @ 0x5cd2892848c0] mb P I16..4: 17.0% 17.2% 3.6% P16..4: 19.7% 5.2% 1.6% 0.0% 0.0% skip:35.7% [libx264 @ 0x5cd2892848c0] mb B I16..4: 4.7% 3.6% 0.5% B16..8: 29.4% 6.8% 1.1% direct: 1.3% skip:52.6% L0:46.5% L1:48.7% BI: 4.8% [libx264 @ 0x5cd2892848c0] 8x8 transform intra:43.3% inter:71.5% [libx264 @ 0x5cd2892848c0] coded y,uvDC,uvAC intra: 13.5% 54.1% 17.9% inter: 6.8% 12.5% 1.6% [libx264 @ 0x5cd2892848c0] i16 v,h,dc,p: 11% 45% 5% 39% [libx264 @ 0x5cd2892848c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 13% 32% 37% 3% 3% 2% 5% 1% 3% [libx264 @ 0x5cd2892848c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 14% 30% 38% 3% 3% 2% 6% 1% 4% [libx264 @ 0x5cd2892848c0] i8c dc,h,v,p: 33% 42% 10% 15% [libx264 @ 0x5cd2892848c0] Weighted P-Frames: Y:10.5% UV:5.3% [libx264 @ 0x5cd2892848c0] ref P L0: 60.3% 7.2% 19.7% 11.0% 1.8% [libx264 @ 0x5cd2892848c0] ref B L0: 83.2% 13.0% 3.8% [libx264 @ 0x5cd2892848c0] ref B L1: 94.3% 5.7% [libx264 @ 0x5cd2892848c0] kb/s:1041.82Prediction
lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6dID72d3ppbbrswoqpirkvwl65gnkuStatusSucceededSourceWebHardwareT4Total durationCreatedInput
- video
- encoder
- vitb
{ "video": "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", "encoder": "vitb" }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", { input: { video: "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", encoder: "vitb" } } ); // To access the file URL: console.log(output.url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", input={ "video": "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", "encoder": "vitb" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", "input": { "video": "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", "encoder": "vitb" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-02-09T19:37:24.166246Z", "created_at": "2024-02-09T19:36:53.301190Z", "data_removed": false, "error": null, "id": "72d3ppbbrswoqpirkvwl65gnku", "input": { "video": "https://replicate.delivery/pbxt/KNKO2ZLl2i3M3uU2oRHYLuVlJ4yLxKhy9gur8v2eb2PijXZE/rollercoaster.mp4", "encoder": "vitb" }, "logs": "Processing /tmp/tmpj_4n2hkyrollercoaster.mp4\n/root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset\nwarnings.warn(\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil 56. 70.100 / 56. 70.100\nlibavcodec 58.134.100 / 58.134.100\nlibavformat 58. 76.100 / 58. 76.100\nlibavdevice 58. 13.100 / 58. 13.100\nlibavfilter 7.110.100 / 7.110.100\nlibswscale 5. 9.100 / 5. 9.100\nlibswresample 3. 9.100 / 3. 9.100\nlibpostproc 55. 9.100 / 55. 9.100\nInput #0, image2, from '/tmp/frames/depth-%d.png':\nDuration: 00:00:02.80, start: 0.000000, bitrate: N/A\nStream #0:0: Video: png, rgb24(pc), 960x540, 25 fps, 25 tbr, 25 tbn, 25 tbc\nStream mapping:\nStream #0:0 -> #0:0 (png (native) -> h264 (libx264))\nPress [q] to stop, [?] for help\n[libx264 @ 0x5bf52022a600] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x5bf52022a600] profile High, level 3.1, 4:2:0, 8-bit\n[libx264 @ 0x5bf52022a600] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to '/tmp/output.mp4':\nMetadata:\nencoder : Lavf58.76.100\nStream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 960x540, q=2-31, 24 fps, 12288 tbn\nMetadata:\nencoder : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nframe= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 48 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 70 fps= 57 q=-1.0 Lsize= 994kB time=00:00:02.79 bitrate=2916.2kbits/s speed=2.27x\nvideo:992kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.167229%\n[libx264 @ 0x5bf52022a600] frame I:1 Avg QP:28.33 size: 29222\n[libx264 @ 0x5bf52022a600] frame P:18 Avg QP:30.92 size: 20176\n[libx264 @ 0x5bf52022a600] frame B:51 Avg QP:33.59 size: 12214\n[libx264 @ 0x5bf52022a600] consecutive B-frames: 2.9% 0.0% 0.0% 97.1%\n[libx264 @ 0x5bf52022a600] mb I I16..4: 12.3% 54.8% 32.9%\n[libx264 @ 0x5bf52022a600] mb P I16..4: 2.5% 9.0% 9.7% P16..4: 10.7% 12.1% 7.5% 0.0% 0.0% skip:48.6%\n[libx264 @ 0x5bf52022a600] mb B I16..4: 1.3% 1.5% 1.3% B16..8: 18.2% 16.0% 7.7% direct: 2.5% skip:51.5% L0:48.2% L1:43.6% BI: 8.1%\n[libx264 @ 0x5bf52022a600] 8x8 transform intra:42.5% inter:21.8%\n[libx264 @ 0x5bf52022a600] coded y,uvDC,uvAC intra: 33.5% 64.7% 50.9% inter: 15.8% 20.0% 5.6%\n[libx264 @ 0x5bf52022a600] i16 v,h,dc,p: 44% 31% 11% 14%\n[libx264 @ 0x5bf52022a600] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 27% 21% 40% 2% 2% 3% 3% 2% 2%\n[libx264 @ 0x5bf52022a600] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 31% 16% 31% 3% 4% 4% 6% 3% 3%\n[libx264 @ 0x5bf52022a600] i8c dc,h,v,p: 45% 21% 29% 5%\n[libx264 @ 0x5bf52022a600] Weighted P-Frames: Y:44.4% UV:44.4%\n[libx264 @ 0x5bf52022a600] ref P L0: 49.6% 8.1% 20.2% 16.2% 5.9%\n[libx264 @ 0x5bf52022a600] ref B L0: 78.1% 17.9% 4.0%\n[libx264 @ 0x5bf52022a600] ref B L1: 87.3% 12.7%\n[libx264 @ 0x5bf52022a600] kb/s:2784.78", "metrics": { "predict_time": 30.84621, "total_time": 30.865056 }, "output": "https://replicate.delivery/pbxt/yTQmZcgWENbfX6vB3lcj16nrPubnDvP8opF8OGuj2Fn5hhKJA/output.mp4", "started_at": "2024-02-09T19:36:53.320036Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/72d3ppbbrswoqpirkvwl65gnku", "cancel": "https://api.replicate.com/v1/predictions/72d3ppbbrswoqpirkvwl65gnku/cancel" }, "version": "9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d" }Generated inProcessing /tmp/tmpj_4n2hkyrollercoaster.mp4 /root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset warnings.warn( ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers built with gcc 11 (Ubuntu 11.2.0-19ubuntu1) configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 70.100 / 56. 70.100 libavcodec 58.134.100 / 58.134.100 libavformat 58. 76.100 / 58. 76.100 libavdevice 58. 13.100 / 58. 13.100 libavfilter 7.110.100 / 7.110.100 libswscale 5. 9.100 / 5. 9.100 libswresample 3. 9.100 / 3. 9.100 libpostproc 55. 9.100 / 55. 9.100 Input #0, image2, from '/tmp/frames/depth-%d.png': Duration: 00:00:02.80, start: 0.000000, bitrate: N/A Stream #0:0: Video: png, rgb24(pc), 960x540, 25 fps, 25 tbr, 25 tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (png (native) -> h264 (libx264)) Press [q] to stop, [?] for help [libx264 @ 0x5bf52022a600] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 [libx264 @ 0x5bf52022a600] profile High, level 3.1, 4:2:0, 8-bit [libx264 @ 0x5bf52022a600] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/tmp/output.mp4': Metadata: encoder : Lavf58.76.100 Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 960x540, q=2-31, 24 fps, 12288 tbn Metadata: encoder : Lavc58.134.100 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 48 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 70 fps= 57 q=-1.0 Lsize= 994kB time=00:00:02.79 bitrate=2916.2kbits/s speed=2.27x video:992kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.167229% [libx264 @ 0x5bf52022a600] frame I:1 Avg QP:28.33 size: 29222 [libx264 @ 0x5bf52022a600] frame P:18 Avg QP:30.92 size: 20176 [libx264 @ 0x5bf52022a600] frame B:51 Avg QP:33.59 size: 12214 [libx264 @ 0x5bf52022a600] consecutive B-frames: 2.9% 0.0% 0.0% 97.1% [libx264 @ 0x5bf52022a600] mb I I16..4: 12.3% 54.8% 32.9% [libx264 @ 0x5bf52022a600] mb P I16..4: 2.5% 9.0% 9.7% P16..4: 10.7% 12.1% 7.5% 0.0% 0.0% skip:48.6% [libx264 @ 0x5bf52022a600] mb B I16..4: 1.3% 1.5% 1.3% B16..8: 18.2% 16.0% 7.7% direct: 2.5% skip:51.5% L0:48.2% L1:43.6% BI: 8.1% [libx264 @ 0x5bf52022a600] 8x8 transform intra:42.5% inter:21.8% [libx264 @ 0x5bf52022a600] coded y,uvDC,uvAC intra: 33.5% 64.7% 50.9% inter: 15.8% 20.0% 5.6% [libx264 @ 0x5bf52022a600] i16 v,h,dc,p: 44% 31% 11% 14% [libx264 @ 0x5bf52022a600] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 27% 21% 40% 2% 2% 3% 3% 2% 2% [libx264 @ 0x5bf52022a600] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 31% 16% 31% 3% 4% 4% 6% 3% 3% [libx264 @ 0x5bf52022a600] i8c dc,h,v,p: 45% 21% 29% 5% [libx264 @ 0x5bf52022a600] Weighted P-Frames: Y:44.4% UV:44.4% [libx264 @ 0x5bf52022a600] ref P L0: 49.6% 8.1% 20.2% 16.2% 5.9% [libx264 @ 0x5bf52022a600] ref B L0: 78.1% 17.9% 4.0% [libx264 @ 0x5bf52022a600] ref B L1: 87.3% 12.7% [libx264 @ 0x5bf52022a600] kb/s:2784.78Prediction
lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6dIDwbin35rbxqujcv2gr2badydlfmStatusSucceededSourceWebHardwareT4Total durationCreatedInput
- video
- encoder
- vitb
{ "video": "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", "encoder": "vitb" }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", { input: { video: "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", encoder: "vitb" } } ); // To access the file URL: console.log(output.url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", input={ "video": "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", "encoder": "vitb" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Run lucataco/depth-anything-video using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "lucataco/depth-anything-video:9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d", "input": { "video": "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", "encoder": "vitb" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-02-09T19:38:36.178086Z", "created_at": "2024-02-09T19:37:36.331824Z", "data_removed": false, "error": null, "id": "wbin35rbxqujcv2gr2badydlfm", "input": { "video": "https://replicate.delivery/pbxt/KNKOSnn6o2d9gTnx7zyZotBxiRvLhbPd76FDSSSxW5fOJ8az/seasnake.mp4", "encoder": "vitb" }, "logs": "Processing /tmp/tmp8j6j_kh5seasnake.mp4\n/root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset\nwarnings.warn(\nffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers\nbuilt with gcc 11 (Ubuntu 11.2.0-19ubuntu1)\nconfiguration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\nlibavutil 56. 70.100 / 56. 70.100\nlibavcodec 58.134.100 / 58.134.100\nlibavformat 58. 76.100 / 58. 76.100\nlibavdevice 58. 13.100 / 58. 13.100\nlibavfilter 7.110.100 / 7.110.100\nlibswscale 5. 9.100 / 5. 9.100\nlibswresample 3. 9.100 / 3. 9.100\nlibpostproc 55. 9.100 / 55. 9.100\nInput #0, image2, from '/tmp/frames/depth-%d.png':\nDuration: 00:00:03.20, start: 0.000000, bitrate: N/A\nStream #0:0: Video: png, rgb24(pc), 1920x1080, 25 fps, 25 tbr, 25 tbn, 25 tbc\nStream mapping:\nStream #0:0 -> #0:0 (png (native) -> h264 (libx264))\nPress [q] to stop, [?] for help\n[libx264 @ 0x5afb640f0600] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x5afb640f0600] profile High, level 4.0, 4:2:0, 8-bit\n[libx264 @ 0x5afb640f0600] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\nOutput #0, mp4, to '/tmp/output.mp4':\nMetadata:\nencoder : Lavf58.76.100\nStream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 1920x1080, q=2-31, 24 fps, 12288 tbn\nMetadata:\nencoder : Lavc58.134.100 libx264\nSide data:\ncpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A\nframe= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 17 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 37 fps= 34 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 47 fps= 25 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x\nframe= 63 fps= 26 q=30.0 size= 0kB time=00:00:00.16 bitrate= 2.3kbits/s speed=0.0692x\nframe= 72 fps= 24 q=30.0 size= 0kB time=00:00:00.54 bitrate= 0.7kbits/s speed=0.183x\nframe= 80 fps= 15 q=-1.0 Lsize= 799kB time=00:00:03.20 bitrate=2039.3kbits/s speed=0.614x\nvideo:797kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.208296%\n[libx264 @ 0x5afb640f0600] frame I:5 Avg QP:20.42 size: 20012\n[libx264 @ 0x5afb640f0600] frame P:31 Avg QP:22.79 size: 12698\n[libx264 @ 0x5afb640f0600] frame B:44 Avg QP:23.05 size: 7313\n[libx264 @ 0x5afb640f0600] consecutive B-frames: 22.5% 7.5% 15.0% 55.0%\n[libx264 @ 0x5afb640f0600] mb I I16..4: 45.4% 54.2% 0.3%\n[libx264 @ 0x5afb640f0600] mb P I16..4: 23.1% 20.7% 0.0% P16..4: 33.5% 1.6% 0.5% 0.0% 0.0% skip:20.6%\n[libx264 @ 0x5afb640f0600] mb B I16..4: 3.1% 2.5% 0.0% B16..8: 38.4% 1.5% 0.0% direct: 1.5% skip:52.9% L0:49.6% L1:49.7% BI: 0.6%\n[libx264 @ 0x5afb640f0600] 8x8 transform intra:48.6% inter:99.7%\n[libx264 @ 0x5afb640f0600] coded y,uvDC,uvAC intra: 5.4% 38.5% 2.5% inter: 2.4% 10.9% 0.0%\n[libx264 @ 0x5afb640f0600] i16 v,h,dc,p: 7% 55% 4% 33%\n[libx264 @ 0x5afb640f0600] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 19% 22% 42% 2% 5% 3% 5% 1% 1%\n[libx264 @ 0x5afb640f0600] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 17% 18% 45% 3% 9% 3% 3% 1% 1%\n[libx264 @ 0x5afb640f0600] i8c dc,h,v,p: 39% 43% 8% 11%\n[libx264 @ 0x5afb640f0600] Weighted P-Frames: Y:38.7% UV:38.7%\n[libx264 @ 0x5afb640f0600] ref P L0: 51.5% 0.8% 30.6% 12.4% 4.7%\n[libx264 @ 0x5afb640f0600] ref B L0: 78.7% 16.8% 4.6%\n[libx264 @ 0x5afb640f0600] ref B L1: 91.5% 8.5%\n[libx264 @ 0x5afb640f0600] kb/s:1957.10", "metrics": { "predict_time": 59.830725, "total_time": 59.846262 }, "output": "https://replicate.delivery/pbxt/KflwHrjRUgW5FKM07OnfMqfwfij8cRAiiNe2n3t0UgfwOxQlE/output.mp4", "started_at": "2024-02-09T19:37:36.347361Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/wbin35rbxqujcv2gr2badydlfm", "cancel": "https://api.replicate.com/v1/predictions/wbin35rbxqujcv2gr2badydlfm/cancel" }, "version": "9143691405afc64c7952499a1e81e3f779535a8916c8da7154a9995f145d5e6d" }Generated inProcessing /tmp/tmp8j6j_kh5seasnake.mp4 /root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/transformers/pipelines/base.py:1123: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to maximize efficiency please use a dataset warnings.warn( ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers built with gcc 11 (Ubuntu 11.2.0-19ubuntu1) configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 70.100 / 56. 70.100 libavcodec 58.134.100 / 58.134.100 libavformat 58. 76.100 / 58. 76.100 libavdevice 58. 13.100 / 58. 13.100 libavfilter 7.110.100 / 7.110.100 libswscale 5. 9.100 / 5. 9.100 libswresample 3. 9.100 / 3. 9.100 libpostproc 55. 9.100 / 55. 9.100 Input #0, image2, from '/tmp/frames/depth-%d.png': Duration: 00:00:03.20, start: 0.000000, bitrate: N/A Stream #0:0: Video: png, rgb24(pc), 1920x1080, 25 fps, 25 tbr, 25 tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (png (native) -> h264 (libx264)) Press [q] to stop, [?] for help [libx264 @ 0x5afb640f0600] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 [libx264 @ 0x5afb640f0600] profile High, level 4.0, 4:2:0, 8-bit [libx264 @ 0x5afb640f0600] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=25.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/tmp/output.mp4': Metadata: encoder : Lavf58.76.100 Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 1920x1080, q=2-31, 24 fps, 12288 tbn Metadata: encoder : Lavc58.134.100 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 17 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 37 fps= 34 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 47 fps= 25 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 63 fps= 26 q=30.0 size= 0kB time=00:00:00.16 bitrate= 2.3kbits/s speed=0.0692x frame= 72 fps= 24 q=30.0 size= 0kB time=00:00:00.54 bitrate= 0.7kbits/s speed=0.183x frame= 80 fps= 15 q=-1.0 Lsize= 799kB time=00:00:03.20 bitrate=2039.3kbits/s speed=0.614x video:797kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.208296% [libx264 @ 0x5afb640f0600] frame I:5 Avg QP:20.42 size: 20012 [libx264 @ 0x5afb640f0600] frame P:31 Avg QP:22.79 size: 12698 [libx264 @ 0x5afb640f0600] frame B:44 Avg QP:23.05 size: 7313 [libx264 @ 0x5afb640f0600] consecutive B-frames: 22.5% 7.5% 15.0% 55.0% [libx264 @ 0x5afb640f0600] mb I I16..4: 45.4% 54.2% 0.3% [libx264 @ 0x5afb640f0600] mb P I16..4: 23.1% 20.7% 0.0% P16..4: 33.5% 1.6% 0.5% 0.0% 0.0% skip:20.6% [libx264 @ 0x5afb640f0600] mb B I16..4: 3.1% 2.5% 0.0% B16..8: 38.4% 1.5% 0.0% direct: 1.5% skip:52.9% L0:49.6% L1:49.7% BI: 0.6% [libx264 @ 0x5afb640f0600] 8x8 transform intra:48.6% inter:99.7% [libx264 @ 0x5afb640f0600] coded y,uvDC,uvAC intra: 5.4% 38.5% 2.5% inter: 2.4% 10.9% 0.0% [libx264 @ 0x5afb640f0600] i16 v,h,dc,p: 7% 55% 4% 33% [libx264 @ 0x5afb640f0600] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 19% 22% 42% 2% 5% 3% 5% 1% 1% [libx264 @ 0x5afb640f0600] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 17% 18% 45% 3% 9% 3% 3% 1% 1% [libx264 @ 0x5afb640f0600] i8c dc,h,v,p: 39% 43% 8% 11% [libx264 @ 0x5afb640f0600] Weighted P-Frames: Y:38.7% UV:38.7% [libx264 @ 0x5afb640f0600] ref P L0: 51.5% 0.8% 30.6% 12.4% 4.7% [libx264 @ 0x5afb640f0600] ref B L0: 78.7% 16.8% 4.6% [libx264 @ 0x5afb640f0600] ref B L1: 91.5% 8.5% [libx264 @ 0x5afb640f0600] kb/s:1957.10
Want to make some of these yourself?
Run this model
