Starting prediction... Saved input image to: /src/tmp_path/input_image.png Converted and saved audio to: /src/tmp_path/input_audio.wav Preprocessing image... /root/.pyenv/versions/3.11.10/lib/python3.11/site-packages/torch/functional.py:507: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3549.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] Face detection result: 1 face(s) found Using original image for processing (no face detected) Generating talking face animation... 0%| | 0/186 [00:00 #0:0 (h264 (native) -> h264 (libx264)) Stream #1:0 -> #0:1 (pcm_s16le (native) -> aac (native)) Press [q] to stop, [?] for help [libx264 @ 0x5e6466012380] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512 [libx264 @ 0x5e6466012380] profile High, level 3.1, 4:2:0, 8-bit [libx264 @ 0x5e6466012380] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=15 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=18.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/src/res_path/output.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf58.76.100 Stream #0:0(und): Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 512x896, q=2-31, 25 fps, 12800 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] encoder : Lavc58.134.100 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 128 kb/s Metadata: encoder : Lavc58.134.100 aac frame= 1 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x frame= 158 fps=0.0 q=23.0 size= 768kB time=00:00:03.84 bitrate=1638.5kbits/s speed=7.38x frame= 284 fps=275 q=23.0 size= 1536kB time=00:00:08.88 bitrate=1417.0kbits/s speed=8.59x frame= 371 fps=243 q=-1.0 Lsize= 2834kB time=00:00:14.83 bitrate=1564.8kbits/s speed=9.72x video:2587kB audio:234kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.479172% [libx264 @ 0x5e6466012380] frame I:2 Avg QP:15.30 size: 76896 [libx264 @ 0x5e6466012380] frame P:100 Avg QP:17.22 size: 19413 [libx264 @ 0x5e6466012380] frame B:269 Avg QP:23.10 size: 2057 [libx264 @ 0x5e6466012380] consecutive B-frames: 1.1% 5.9% 2.4% 90.6% [libx264 @ 0x5e6466012380] mb I I16..4: 1.6% 64.5% 33.8% [libx264 @ 0x5e6466012380] mb P I16..4: 0.0% 0.7% 0.4% P16..4: 31.4% 28.0% 20.0% 0.0% 0.0% skip:19.4% [libx264 @ 0x5e6466012380] mb B I16..4: 0.0% 0.0% 0.0% B16..8: 35.5% 4.3% 1.1% direct: 1.1% skip:58.0% L0:35.6% L1:53.4% BI:11.0% [libx264 @ 0x5e6466012380] 8x8 transform intra:63.6% inter:59.4% [libx264 @ 0x5e6466012380] coded y,uvDC,uvAC intra: 93.5% 93.0% 69.6% inter: 15.9% 13.3% 0.6% [libx264 @ 0x5e6466012380] i16 v,h,dc,p: 7% 17% 23% 53% [libx264 @ 0x5e6466012380] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 12% 10% 7% 10% 11% 9% 14% 9% [libx264 @ 0x5e6466012380] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 17% 11% 7% 6% 17% 13% 12% 10% 7% [libx264 @ 0x5e6466012380] i8c dc,h,v,p: 41% 21% 24% 14% [libx264 @ 0x5e6466012380] Weighted P-Frames: Y:13.0% UV:6.0% [libx264 @ 0x5e6466012380] ref P L0: 61.9% 21.7% 13.1% 3.0% 0.3% [libx264 @ 0x5e6466012380] ref B L0: 94.9% 4.4% 0.7% [libx264 @ 0x5e6466012380] ref B L1: 97.8% 2.2% [libx264 @ 0x5e6466012380] kb/s:1427.75 [aac @ 0x5e6466014240] Qavg: 186.558 Video generation complete Total prediction time: 395.92 seconds

Examples

Run time and cost

Readme