chenxwh
/
video-retalking
Audio-based Lip Synchronization for Talking Head Video
Prediction
chenxwh/video-retalking:db5a650cIDdkmwymlbchvurk4pboar4y2cmqStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", "input_audio": "https://replicate.delivery/pbxt/JzGoIBEVNhTQxnXOKkQW0wiMtParwh7wCXTJNpVu9evPXu1O/sample-0.mp3" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", input_audio: "https://replicate.delivery/pbxt/JzGoIBEVNhTQxnXOKkQW0wiMtParwh7wCXTJNpVu9evPXu1O/sample-0.mp3" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", "input_audio": "https://replicate.delivery/pbxt/JzGoIBEVNhTQxnXOKkQW0wiMtParwh7wCXTJNpVu9evPXu1O/sample-0.mp3" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", "input_audio": "https://replicate.delivery/pbxt/JzGoIBEVNhTQxnXOKkQW0wiMtParwh7wCXTJNpVu9evPXu1O/sample-0.mp3" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2023-12-04T00:58:29.318989Z", "created_at": "2023-12-04T00:54:36.106482Z", "data_removed": false, "error": null, "id": "dkmwymlbchvurk4pboar4y2cmq", "input": { "face": "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", "input_audio": "https://replicate.delivery/pbxt/JzGoIBEVNhTQxnXOKkQW0wiMtParwh7wCXTJNpVu9evPXu1O/sample-0.mp3" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/135 [00:00<?, ?it/s]\nlandmark Det:: 1%| | 1/135 [00:09<20:45, 9.29s/it]\nlandmark Det:: 1%|▏ | 2/135 [00:16<17:57, 8.10s/it]\nlandmark Det:: 6%|▌ | 8/135 [00:16<02:52, 1.35s/it]\nlandmark Det:: 11%|█ | 15/135 [00:16<01:09, 1.74it/s]\nlandmark Det:: 16%|█▋ | 22/135 [00:16<00:36, 3.12it/s]\nlandmark Det:: 21%|██▏ | 29/135 [00:16<00:21, 4.98it/s]\nlandmark Det:: 27%|██▋ | 36/135 [00:17<00:13, 7.45it/s]\nlandmark Det:: 32%|███▏ | 43/135 [00:17<00:08, 10.65it/s]\nlandmark Det:: 37%|███▋ | 50/135 [00:17<00:05, 14.67it/s]\nlandmark Det:: 42%|████▏ | 57/135 [00:17<00:03, 19.52it/s]\nlandmark Det:: 47%|████▋ | 64/135 [00:17<00:02, 24.63it/s]\nlandmark Det:: 53%|█████▎ | 71/135 [00:17<00:02, 30.36it/s]\nlandmark Det:: 58%|█████▊ | 78/135 [00:17<00:01, 36.19it/s]\nlandmark Det:: 63%|██████▎ | 85/135 [00:17<00:01, 41.84it/s]\nlandmark Det:: 68%|██████▊ | 92/135 [00:17<00:00, 46.88it/s]\nlandmark Det:: 73%|███████▎ | 99/135 [00:18<00:00, 51.19it/s]\nlandmark Det:: 79%|███████▊ | 106/135 [00:18<00:00, 54.74it/s]\nlandmark Det:: 84%|████████▎ | 113/135 [00:18<00:00, 57.35it/s]\nlandmark Det:: 89%|████████▉ | 120/135 [00:18<00:00, 58.30it/s]\nlandmark Det:: 94%|█████████▍| 127/135 [00:18<00:00, 59.06it/s]\nlandmark Det:: 99%|█████████▉| 134/135 [00:18<00:00, 60.85it/s]\nlandmark Det:: 100%|██████████| 135/135 [00:18<00:00, 7.24it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/135 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 1%| | 1/135 [00:00<00:30, 4.38it/s]\n[Step 2] 3DMM Extraction In Video:: 10%|█ | 14/135 [00:00<00:02, 51.43it/s]\n[Step 2] 3DMM Extraction In Video:: 20%|██ | 27/135 [00:00<00:01, 78.60it/s]\n[Step 2] 3DMM Extraction In Video:: 30%|██▉ | 40/135 [00:00<00:00, 95.36it/s]\n[Step 2] 3DMM Extraction In Video:: 39%|███▉ | 53/135 [00:00<00:00, 106.15it/s]\n[Step 2] 3DMM Extraction In Video:: 49%|████▉ | 66/135 [00:00<00:00, 112.44it/s]\n[Step 2] 3DMM Extraction In Video:: 59%|█████▊ | 79/135 [00:00<00:00, 113.09it/s]\n[Step 2] 3DMM Extraction In Video:: 68%|██████▊ | 92/135 [00:00<00:00, 117.69it/s]\n[Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 105/135 [00:01<00:00, 121.00it/s]\n[Step 2] 3DMM Extraction In Video:: 87%|████████▋ | 118/135 [00:01<00:00, 122.95it/s]\n[Step 2] 3DMM Extraction In Video:: 97%|█████████▋| 131/135 [00:01<00:00, 124.10it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 135/135 [00:01<00:00, 104.36it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/135 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 1%| | 1/135 [00:00<00:50, 2.63it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 3/135 [00:00<00:20, 6.34it/s]\n[Step 3] Stabilize the expression In Video:: 4%|▎ | 5/135 [00:00<00:15, 8.57it/s]\n[Step 3] Stabilize the expression In Video:: 5%|▌ | 7/135 [00:00<00:12, 9.99it/s]\n[Step 3] Stabilize the expression In Video:: 7%|▋ | 9/135 [00:01<00:11, 10.92it/s]\n[Step 3] Stabilize the expression In Video:: 8%|▊ | 11/135 [00:01<00:10, 11.52it/s]\n[Step 3] Stabilize the expression In Video:: 10%|▉ | 13/135 [00:01<00:10, 11.94it/s]\n[Step 3] Stabilize the expression In Video:: 11%|█ | 15/135 [00:01<00:09, 12.22it/s]\n[Step 3] Stabilize the expression In Video:: 13%|█▎ | 17/135 [00:01<00:09, 12.41it/s]\n[Step 3] Stabilize the expression In Video:: 14%|█▍ | 19/135 [00:01<00:09, 12.50it/s]\n[Step 3] Stabilize the expression In Video:: 16%|█▌ | 21/135 [00:01<00:09, 12.56it/s]\n[Step 3] Stabilize the expression In Video:: 17%|█▋ | 23/135 [00:02<00:08, 12.63it/s]\n[Step 3] Stabilize the expression In Video:: 19%|█▊ | 25/135 [00:02<00:08, 12.66it/s]\n[Step 3] Stabilize the expression In Video:: 20%|██ | 27/135 [00:02<00:08, 12.64it/s]\n[Step 3] Stabilize the expression In Video:: 21%|██▏ | 29/135 [00:02<00:08, 12.66it/s]\n[Step 3] Stabilize the expression In Video:: 23%|██▎ | 31/135 [00:02<00:08, 12.51it/s]\n[Step 3] Stabilize the expression In Video:: 24%|██▍ | 33/135 [00:02<00:08, 12.41it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▌ | 35/135 [00:03<00:08, 12.46it/s]\n[Step 3] Stabilize the expression In Video:: 27%|██▋ | 37/135 [00:03<00:07, 12.56it/s]\n[Step 3] Stabilize the expression In Video:: 29%|██▉ | 39/135 [00:03<00:07, 12.66it/s]\n[Step 3] Stabilize the expression In Video:: 30%|███ | 41/135 [00:03<00:07, 12.74it/s]\n[Step 3] Stabilize the expression In Video:: 32%|███▏ | 43/135 [00:03<00:07, 12.77it/s]\n[Step 3] Stabilize the expression In Video:: 33%|███▎ | 45/135 [00:03<00:07, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 35%|███▍ | 47/135 [00:03<00:06, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 36%|███▋ | 49/135 [00:04<00:06, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 51/135 [00:04<00:06, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 39%|███▉ | 53/135 [00:04<00:06, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 41%|████ | 55/135 [00:04<00:06, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 42%|████▏ | 57/135 [00:04<00:06, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 44%|████▎ | 59/135 [00:04<00:05, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 45%|████▌ | 61/135 [00:05<00:05, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 47%|████▋ | 63/135 [00:05<00:05, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 48%|████▊ | 65/135 [00:05<00:05, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 50%|████▉ | 67/135 [00:05<00:05, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 51%|█████ | 69/135 [00:05<00:05, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 53%|█████▎ | 71/135 [00:05<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▍ | 73/135 [00:06<00:04, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 56%|█████▌ | 75/135 [00:06<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 57%|█████▋ | 77/135 [00:06<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 59%|█████▊ | 79/135 [00:06<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 60%|██████ | 81/135 [00:06<00:04, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 61%|██████▏ | 83/135 [00:06<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 63%|██████▎ | 85/135 [00:06<00:03, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 64%|██████▍ | 87/135 [00:07<00:03, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▌ | 89/135 [00:07<00:03, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 67%|██████▋ | 91/135 [00:07<00:03, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 69%|██████▉ | 93/135 [00:07<00:03, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 70%|███████ | 95/135 [00:07<00:03, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 72%|███████▏ | 97/135 [00:07<00:02, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 73%|███████▎ | 99/135 [00:08<00:02, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 75%|███████▍ | 101/135 [00:08<00:02, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 76%|███████▋ | 103/135 [00:08<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 78%|███████▊ | 105/135 [00:08<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 79%|███████▉ | 107/135 [00:08<00:02, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 81%|████████ | 109/135 [00:08<00:02, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 111/135 [00:08<00:01, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 84%|████████▎ | 113/135 [00:09<00:01, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 85%|████████▌ | 115/135 [00:09<00:01, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 87%|████████▋ | 117/135 [00:09<00:01, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 88%|████████▊ | 119/135 [00:09<00:01, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 90%|████████▉ | 121/135 [00:09<00:01, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 91%|█████████ | 123/135 [00:09<00:00, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 93%|█████████▎| 125/135 [00:10<00:00, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 94%|█████████▍| 127/135 [00:10<00:00, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 96%|█████████▌| 129/135 [00:10<00:00, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 97%|█████████▋| 131/135 [00:10<00:00, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 99%|█████████▊| 133/135 [00:10<00:00, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 135/135 [00:10<00:00, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 135/135 [00:10<00:00, 12.48it/s]\n[Step 4] Load audio; Length of mel chunks: 220\n[Step 5] Reference Enhancement: 0%| | 0/135 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/135 [00:01<03:45, 1.68s/it]\n[Step 5] Reference Enhancement: 1%|▏ | 2/135 [00:01<01:44, 1.28it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 3/135 [00:01<01:04, 2.04it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 4/135 [00:02<00:46, 2.83it/s]\n[Step 5] Reference Enhancement: 4%|▎ | 5/135 [00:02<00:36, 3.59it/s]\n[Step 5] Reference Enhancement: 4%|▍ | 6/135 [00:02<00:30, 4.28it/s]\n[Step 5] Reference Enhancement: 5%|▌ | 7/135 [00:02<00:26, 4.90it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 8/135 [00:02<00:23, 5.42it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 9/135 [00:02<00:21, 5.81it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 10/135 [00:02<00:20, 6.17it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 11/135 [00:03<00:19, 6.43it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 12/135 [00:03<00:18, 6.61it/s]\n[Step 5] Reference Enhancement: 10%|▉ | 13/135 [00:03<00:18, 6.74it/s]\n[Step 5] Reference Enhancement: 10%|█ | 14/135 [00:03<00:17, 6.85it/s]\n[Step 5] Reference Enhancement: 11%|█ | 15/135 [00:03<00:17, 6.93it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 16/135 [00:03<00:17, 6.98it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 17/135 [00:03<00:16, 7.00it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 18/135 [00:04<00:16, 7.01it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 19/135 [00:04<00:16, 7.04it/s]\n[Step 5] Reference Enhancement: 15%|█▍ | 20/135 [00:04<00:16, 7.04it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 21/135 [00:04<00:16, 7.06it/s]\n[Step 5] Reference Enhancement: 16%|█▋ | 22/135 [00:04<00:15, 7.08it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 23/135 [00:04<00:15, 7.10it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 24/135 [00:04<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 19%|█▊ | 25/135 [00:05<00:15, 7.10it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 26/135 [00:05<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 20%|██ | 27/135 [00:05<00:15, 7.07it/s]\n[Step 5] Reference Enhancement: 21%|██ | 28/135 [00:05<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 21%|██▏ | 29/135 [00:05<00:14, 7.08it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 30/135 [00:05<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 31/135 [00:05<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 24%|██▎ | 32/135 [00:06<00:14, 7.08it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 33/135 [00:06<00:14, 7.08it/s]\n[Step 5] Reference Enhancement: 25%|██▌ | 34/135 [00:06<00:14, 7.00it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 35/135 [00:06<00:14, 7.03it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 36/135 [00:06<00:14, 7.04it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 37/135 [00:06<00:13, 7.03it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 38/135 [00:06<00:13, 7.04it/s]\n[Step 5] Reference Enhancement: 29%|██▉ | 39/135 [00:07<00:13, 7.08it/s]\n[Step 5] Reference Enhancement: 30%|██▉ | 40/135 [00:07<00:13, 7.06it/s]\n[Step 5] Reference Enhancement: 30%|███ | 41/135 [00:07<00:13, 7.08it/s]\n[Step 5] Reference Enhancement: 31%|███ | 42/135 [00:07<00:13, 7.09it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 43/135 [00:07<00:12, 7.10it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 44/135 [00:07<00:12, 7.08it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 45/135 [00:07<00:12, 7.12it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 46/135 [00:08<00:12, 7.10it/s]\n[Step 5] Reference Enhancement: 35%|███▍ | 47/135 [00:08<00:12, 7.10it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 48/135 [00:08<00:12, 7.09it/s]\n[Step 5] Reference Enhancement: 36%|███▋ | 49/135 [00:08<00:12, 7.06it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 50/135 [00:08<00:12, 7.02it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 51/135 [00:08<00:11, 7.02it/s]\n[Step 5] Reference Enhancement: 39%|███▊ | 52/135 [00:08<00:11, 7.05it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 53/135 [00:09<00:11, 7.04it/s]\n[Step 5] Reference Enhancement: 40%|████ | 54/135 [00:09<00:11, 7.10it/s]\n[Step 5] Reference Enhancement: 41%|████ | 55/135 [00:09<00:11, 7.14it/s]\n[Step 5] Reference Enhancement: 41%|████▏ | 56/135 [00:09<00:11, 7.14it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 57/135 [00:09<00:10, 7.11it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 58/135 [00:09<00:10, 7.07it/s]\n[Step 5] Reference Enhancement: 44%|████▎ | 59/135 [00:09<00:10, 7.05it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 60/135 [00:10<00:10, 7.01it/s]\n[Step 5] Reference Enhancement: 45%|████▌ | 61/135 [00:10<00:10, 6.92it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 62/135 [00:10<00:10, 6.96it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 63/135 [00:10<00:10, 7.04it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 64/135 [00:10<00:10, 7.05it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 65/135 [00:10<00:09, 7.07it/s]\n[Step 5] Reference Enhancement: 49%|████▉ | 66/135 [00:10<00:09, 7.09it/s]\n[Step 5] Reference Enhancement: 50%|████▉ | 67/135 [00:11<00:09, 7.09it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 68/135 [00:11<00:09, 7.14it/s]\n[Step 5] Reference Enhancement: 51%|█████ | 69/135 [00:11<00:09, 7.11it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 70/135 [00:11<00:09, 7.10it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 71/135 [00:11<00:08, 7.12it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 72/135 [00:11<00:08, 7.15it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 73/135 [00:11<00:08, 7.13it/s]\n[Step 5] Reference Enhancement: 55%|█████▍ | 74/135 [00:12<00:08, 7.12it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 75/135 [00:12<00:08, 7.08it/s]\n[Step 5] Reference Enhancement: 56%|█████▋ | 76/135 [00:12<00:08, 7.08it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 77/135 [00:12<00:08, 7.08it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 78/135 [00:12<00:08, 7.08it/s]\n[Step 5] Reference Enhancement: 59%|█████▊ | 79/135 [00:12<00:07, 7.08it/s]\n[Step 5] Reference Enhancement: 59%|█████▉ | 80/135 [00:12<00:07, 7.03it/s]\n[Step 5] Reference Enhancement: 60%|██████ | 81/135 [00:13<00:07, 7.05it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 82/135 [00:13<00:07, 7.08it/s]\n[Step 5] Reference Enhancement: 61%|██████▏ | 83/135 [00:13<00:07, 7.10it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 84/135 [00:13<00:07, 7.10it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 85/135 [00:13<00:07, 7.06it/s]\n[Step 5] Reference Enhancement: 64%|██████▎ | 86/135 [00:13<00:07, 6.84it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 87/135 [00:13<00:07, 6.82it/s]\n[Step 5] Reference Enhancement: 65%|██████▌ | 88/135 [00:14<00:07, 6.71it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 89/135 [00:14<00:06, 6.58it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 90/135 [00:14<00:06, 6.69it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 91/135 [00:14<00:06, 6.77it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 92/135 [00:14<00:06, 6.84it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 93/135 [00:14<00:06, 6.79it/s]\n[Step 5] Reference Enhancement: 70%|██████▉ | 94/135 [00:14<00:05, 6.89it/s]\n[Step 5] Reference Enhancement: 70%|███████ | 95/135 [00:15<00:05, 6.89it/s]\n[Step 5] Reference Enhancement: 71%|███████ | 96/135 [00:15<00:05, 6.94it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 97/135 [00:15<00:05, 7.04it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 98/135 [00:15<00:05, 7.06it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 99/135 [00:15<00:05, 6.98it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 100/135 [00:15<00:04, 7.07it/s]\n[Step 5] Reference Enhancement: 75%|███████▍ | 101/135 [00:15<00:04, 7.05it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 102/135 [00:16<00:04, 7.10it/s]\n[Step 5] Reference Enhancement: 76%|███████▋ | 103/135 [00:16<00:04, 7.06it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 104/135 [00:16<00:04, 7.12it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 105/135 [00:16<00:04, 7.08it/s]\n[Step 5] Reference Enhancement: 79%|███████▊ | 106/135 [00:16<00:04, 7.08it/s]\n[Step 5] Reference Enhancement: 79%|███████▉ | 107/135 [00:16<00:03, 7.05it/s]\n[Step 5] Reference Enhancement: 80%|████████ | 108/135 [00:16<00:03, 7.07it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 109/135 [00:17<00:03, 7.03it/s]\n[Step 5] Reference Enhancement: 81%|████████▏ | 110/135 [00:17<00:03, 7.09it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 111/135 [00:17<00:03, 7.07it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 112/135 [00:17<00:03, 7.09it/s]\n[Step 5] Reference Enhancement: 84%|████████▎ | 113/135 [00:17<00:03, 6.94it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 114/135 [00:17<00:03, 6.95it/s]\n[Step 5] Reference Enhancement: 85%|████████▌ | 115/135 [00:17<00:02, 6.97it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 116/135 [00:18<00:02, 6.99it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 117/135 [00:18<00:02, 7.00it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 118/135 [00:18<00:02, 7.07it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 119/135 [00:18<00:02, 7.10it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 120/135 [00:18<00:02, 7.06it/s]\n[Step 5] Reference Enhancement: 90%|████████▉ | 121/135 [00:18<00:01, 7.09it/s]\n[Step 5] Reference Enhancement: 90%|█████████ | 122/135 [00:18<00:01, 7.05it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 123/135 [00:19<00:01, 7.06it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 124/135 [00:19<00:01, 7.11it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 125/135 [00:19<00:01, 7.13it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 126/135 [00:19<00:01, 7.09it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 127/135 [00:19<00:01, 7.07it/s]\n[Step 5] Reference Enhancement: 95%|█████████▍| 128/135 [00:19<00:01, 6.99it/s]\n[Step 5] Reference Enhancement: 96%|█████████▌| 129/135 [00:19<00:00, 7.01it/s]\n[Step 5] Reference Enhancement: 96%|█████████▋| 130/135 [00:20<00:00, 7.06it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 131/135 [00:20<00:00, 7.01it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 132/135 [00:20<00:00, 7.04it/s]\n[Step 5] Reference Enhancement: 99%|█████████▊| 133/135 [00:20<00:00, 7.01it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 134/135 [00:20<00:00, 7.05it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 135/135 [00:20<00:00, 7.01it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 135/135 [00:20<00:00, 6.51it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/14 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/135 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/135 [00:00<00:25, 5.28it/s]\u001b[A\nlandmark Det:: 1%|▏ | 2/135 [00:00<00:46, 2.89it/s]\u001b[A\nlandmark Det:: 7%|▋ | 9/135 [00:00<00:08, 15.72it/s]\u001b[A\nlandmark Det:: 12%|█▏ | 16/135 [00:00<00:04, 27.02it/s]\u001b[A\nlandmark Det:: 17%|█▋ | 23/135 [00:00<00:03, 36.49it/s]\u001b[A\nlandmark Det:: 22%|██▏ | 30/135 [00:01<00:02, 44.06it/s]\u001b[A\nlandmark Det:: 27%|██▋ | 37/135 [00:01<00:01, 49.95it/s]\u001b[A\nlandmark Det:: 33%|███▎ | 44/135 [00:01<00:01, 54.23it/s]\u001b[A\nlandmark Det:: 38%|███▊ | 51/135 [00:01<00:01, 57.59it/s]\u001b[A\nlandmark Det:: 43%|████▎ | 58/135 [00:01<00:01, 58.87it/s]\u001b[A\nlandmark Det:: 48%|████▊ | 65/135 [00:01<00:01, 60.92it/s]\u001b[A\nlandmark Det:: 53%|█████▎ | 72/135 [00:01<00:01, 62.45it/s]\u001b[A\nlandmark Det:: 59%|█████▊ | 79/135 [00:01<00:00, 63.38it/s]\u001b[A\nlandmark Det:: 64%|██████▎ | 86/135 [00:01<00:00, 64.36it/s]\u001b[A\nlandmark Det:: 69%|██████▉ | 93/135 [00:02<00:00, 65.06it/s]\u001b[A\nlandmark Det:: 74%|███████▍ | 100/135 [00:02<00:00, 65.48it/s]\u001b[A\nlandmark Det:: 79%|███████▉ | 107/135 [00:02<00:00, 65.87it/s]\u001b[A\nlandmark Det:: 84%|████████▍ | 114/135 [00:02<00:00, 65.90it/s]\u001b[A\nlandmark Det:: 90%|████████▉ | 121/135 [00:02<00:00, 64.43it/s]\u001b[A\nlandmark Det:: 95%|█████████▍| 128/135 [00:02<00:00, 65.02it/s]\u001b[A\nlandmark Det:: 100%|██████████| 135/135 [00:02<00:00, 65.50it/s]\u001b[A\nlandmark Det:: 100%|██████████| 135/135 [00:02<00:00, 50.46it/s]\n 0%| | 0/135 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 135/135 [00:00<00:00, 20511.16it/s]\n 0%| | 0/135 [00:00<?, ?it/s]\u001b[A\n 47%|████▋ | 64/135 [00:00<00:00, 632.71it/s]\u001b[A\n 96%|█████████▌| 129/135 [00:00<00:00, 642.09it/s]\u001b[A\n100%|██████████| 135/135 [00:00<00:00, 641.18it/s]\nFaceDet:: 0%| | 0/34 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 3%|▎ | 1/34 [00:00<00:29, 1.13it/s]\u001b[A\nFaceDet:: 6%|▌ | 2/34 [00:01<00:14, 2.22it/s]\u001b[A\nFaceDet:: 9%|▉ | 3/34 [00:01<00:09, 3.23it/s]\u001b[A\nFaceDet:: 12%|█▏ | 4/34 [00:01<00:07, 4.11it/s]\u001b[A\nFaceDet:: 15%|█▍ | 5/34 [00:01<00:06, 4.82it/s]\u001b[A\nFaceDet:: 18%|█▊ | 6/34 [00:01<00:05, 5.42it/s]\u001b[A\nFaceDet:: 21%|██ | 7/34 [00:01<00:04, 5.90it/s]\u001b[A\nFaceDet:: 24%|██▎ | 8/34 [00:01<00:04, 6.25it/s]\u001b[A\nFaceDet:: 26%|██▋ | 9/34 [00:02<00:03, 6.48it/s]\u001b[A\nFaceDet:: 29%|██▉ | 10/34 [00:02<00:03, 6.65it/s]\u001b[A\nFaceDet:: 32%|███▏ | 11/34 [00:02<00:03, 6.77it/s]\u001b[A\nFaceDet:: 35%|███▌ | 12/34 [00:02<00:03, 6.84it/s]\u001b[A\nFaceDet:: 38%|███▊ | 13/34 [00:02<00:03, 6.90it/s]\u001b[A\nFaceDet:: 41%|████ | 14/34 [00:02<00:02, 7.01it/s]\u001b[A\nFaceDet:: 44%|████▍ | 15/34 [00:02<00:02, 7.11it/s]\u001b[A\nFaceDet:: 47%|████▋ | 16/34 [00:02<00:02, 7.18it/s]\u001b[A\nFaceDet:: 50%|█████ | 17/34 [00:03<00:02, 7.23it/s]\u001b[A\nFaceDet:: 53%|█████▎ | 18/34 [00:03<00:02, 7.27it/s]\u001b[A\nFaceDet:: 56%|█████▌ | 19/34 [00:03<00:02, 7.34it/s]\u001b[A\nFaceDet:: 59%|█████▉ | 20/34 [00:03<00:02, 6.82it/s]\u001b[A\nFaceDet:: 62%|██████▏ | 21/34 [00:03<00:02, 6.45it/s]\u001b[A\nFaceDet:: 65%|██████▍ | 22/34 [00:03<00:01, 6.26it/s]\u001b[A\nFaceDet:: 68%|██████▊ | 23/34 [00:04<00:01, 6.13it/s]\u001b[A\nFaceDet:: 71%|███████ | 24/34 [00:04<00:01, 6.07it/s]\u001b[A\nFaceDet:: 74%|███████▎ | 25/34 [00:04<00:01, 6.01it/s]\u001b[A\nFaceDet:: 76%|███████▋ | 26/34 [00:04<00:01, 5.95it/s]\u001b[A\nFaceDet:: 79%|███████▉ | 27/34 [00:04<00:01, 5.93it/s]\u001b[A\nFaceDet:: 82%|████████▏ | 28/34 [00:04<00:00, 6.07it/s]\u001b[A\nFaceDet:: 85%|████████▌ | 29/34 [00:05<00:00, 6.01it/s]\u001b[A\nFaceDet:: 88%|████████▊ | 30/34 [00:05<00:00, 6.01it/s]\u001b[A\nFaceDet:: 91%|█████████ | 31/34 [00:05<00:00, 5.98it/s]\u001b[A\nFaceDet:: 94%|█████████▍| 32/34 [00:05<00:00, 5.97it/s]\u001b[A\nFaceDet:: 97%|█████████▋| 33/34 [00:05<00:00, 5.95it/s]\u001b[A\nFaceDet:: 100%|██████████| 34/34 [00:06<00:00, 3.21it/s]\u001b[A\nFaceDet:: 100%|██████████| 34/34 [00:06<00:00, 5.30it/s]\n[Step 6] Lip Synthesis:: 7%|▋ | 1/14 [00:23<05:09, 23.84s/it]\n[Step 6] Lip Synthesis:: 14%|█▍ | 2/14 [00:30<02:42, 13.50s/it]\n[Step 6] Lip Synthesis:: 21%|██▏ | 3/14 [00:36<01:51, 10.13s/it]\n[Step 6] Lip Synthesis:: 29%|██▊ | 4/14 [00:42<01:25, 8.60s/it]\n[Step 6] Lip Synthesis:: 36%|███▌ | 5/14 [00:48<01:09, 7.70s/it]\n[Step 6] Lip Synthesis:: 43%|████▎ | 6/14 [00:54<00:58, 7.26s/it]\n[Step 6] Lip Synthesis:: 50%|█████ | 7/14 [01:01<00:48, 6.88s/it]\n[Step 6] Lip Synthesis:: 57%|█████▋ | 8/14 [01:07<00:39, 6.65s/it]\n[Step 6] Lip Synthesis:: 64%|██████▍ | 9/14 [01:13<00:32, 6.52s/it]\n[Step 6] Lip Synthesis:: 71%|███████▏ | 10/14 [01:19<00:25, 6.47s/it]\n[Step 6] Lip Synthesis:: 79%|███████▊ | 11/14 [01:26<00:19, 6.40s/it]\n[Step 6] Lip Synthesis:: 86%|████████▌ | 12/14 [01:32<00:12, 6.37s/it]\n[Step 6] Lip Synthesis:: 93%|█████████▎| 13/14 [01:38<00:06, 6.28s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 14/14 [01:47<00:00, 7.21s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 14/14 [01:47<00:00, 7.70s/it]", "metrics": { "predict_time": 166.27062, "total_time": 233.212507 }, "output": "https://replicate.delivery/pbxt/eDyKkbTbkaUIMqi9kHLFW2qheXUnXbU3pIbEQe6NtfLTj16HB/output.mp4", "started_at": "2023-12-04T00:55:43.048369Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/dkmwymlbchvurk4pboar4y2cmq", "cancel": "https://api.replicate.com/v1/predictions/dkmwymlbchvurk4pboar4y2cmq/cancel" }, "version": "a0dbf0b26be3a3d249473aa11fe197126a05f12e439199a0074151ae1fa47c3c" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/135 [00:00<?, ?it/s] landmark Det:: 1%| | 1/135 [00:09<20:45, 9.29s/it] landmark Det:: 1%|▏ | 2/135 [00:16<17:57, 8.10s/it] landmark Det:: 6%|▌ | 8/135 [00:16<02:52, 1.35s/it] landmark Det:: 11%|█ | 15/135 [00:16<01:09, 1.74it/s] landmark Det:: 16%|█▋ | 22/135 [00:16<00:36, 3.12it/s] landmark Det:: 21%|██▏ | 29/135 [00:16<00:21, 4.98it/s] landmark Det:: 27%|██▋ | 36/135 [00:17<00:13, 7.45it/s] landmark Det:: 32%|███▏ | 43/135 [00:17<00:08, 10.65it/s] landmark Det:: 37%|███▋ | 50/135 [00:17<00:05, 14.67it/s] landmark Det:: 42%|████▏ | 57/135 [00:17<00:03, 19.52it/s] landmark Det:: 47%|████▋ | 64/135 [00:17<00:02, 24.63it/s] landmark Det:: 53%|█████▎ | 71/135 [00:17<00:02, 30.36it/s] landmark Det:: 58%|█████▊ | 78/135 [00:17<00:01, 36.19it/s] landmark Det:: 63%|██████▎ | 85/135 [00:17<00:01, 41.84it/s] landmark Det:: 68%|██████▊ | 92/135 [00:17<00:00, 46.88it/s] landmark Det:: 73%|███████▎ | 99/135 [00:18<00:00, 51.19it/s] landmark Det:: 79%|███████▊ | 106/135 [00:18<00:00, 54.74it/s] landmark Det:: 84%|████████▎ | 113/135 [00:18<00:00, 57.35it/s] landmark Det:: 89%|████████▉ | 120/135 [00:18<00:00, 58.30it/s] landmark Det:: 94%|█████████▍| 127/135 [00:18<00:00, 59.06it/s] landmark Det:: 99%|█████████▉| 134/135 [00:18<00:00, 60.85it/s] landmark Det:: 100%|██████████| 135/135 [00:18<00:00, 7.24it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/135 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 1%| | 1/135 [00:00<00:30, 4.38it/s] [Step 2] 3DMM Extraction In Video:: 10%|█ | 14/135 [00:00<00:02, 51.43it/s] [Step 2] 3DMM Extraction In Video:: 20%|██ | 27/135 [00:00<00:01, 78.60it/s] [Step 2] 3DMM Extraction In Video:: 30%|██▉ | 40/135 [00:00<00:00, 95.36it/s] [Step 2] 3DMM Extraction In Video:: 39%|███▉ | 53/135 [00:00<00:00, 106.15it/s] [Step 2] 3DMM Extraction In Video:: 49%|████▉ | 66/135 [00:00<00:00, 112.44it/s] [Step 2] 3DMM Extraction In Video:: 59%|█████▊ | 79/135 [00:00<00:00, 113.09it/s] [Step 2] 3DMM Extraction In Video:: 68%|██████▊ | 92/135 [00:00<00:00, 117.69it/s] [Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 105/135 [00:01<00:00, 121.00it/s] [Step 2] 3DMM Extraction In Video:: 87%|████████▋ | 118/135 [00:01<00:00, 122.95it/s] [Step 2] 3DMM Extraction In Video:: 97%|█████████▋| 131/135 [00:01<00:00, 124.10it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 135/135 [00:01<00:00, 104.36it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/135 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 1%| | 1/135 [00:00<00:50, 2.63it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 3/135 [00:00<00:20, 6.34it/s] [Step 3] Stabilize the expression In Video:: 4%|▎ | 5/135 [00:00<00:15, 8.57it/s] [Step 3] Stabilize the expression In Video:: 5%|▌ | 7/135 [00:00<00:12, 9.99it/s] [Step 3] Stabilize the expression In Video:: 7%|▋ | 9/135 [00:01<00:11, 10.92it/s] [Step 3] Stabilize the expression In Video:: 8%|▊ | 11/135 [00:01<00:10, 11.52it/s] [Step 3] Stabilize the expression In Video:: 10%|▉ | 13/135 [00:01<00:10, 11.94it/s] [Step 3] Stabilize the expression In Video:: 11%|█ | 15/135 [00:01<00:09, 12.22it/s] [Step 3] Stabilize the expression In Video:: 13%|█▎ | 17/135 [00:01<00:09, 12.41it/s] [Step 3] Stabilize the expression In Video:: 14%|█▍ | 19/135 [00:01<00:09, 12.50it/s] [Step 3] Stabilize the expression In Video:: 16%|█▌ | 21/135 [00:01<00:09, 12.56it/s] [Step 3] Stabilize the expression In Video:: 17%|█▋ | 23/135 [00:02<00:08, 12.63it/s] [Step 3] Stabilize the expression In Video:: 19%|█▊ | 25/135 [00:02<00:08, 12.66it/s] [Step 3] Stabilize the expression In Video:: 20%|██ | 27/135 [00:02<00:08, 12.64it/s] [Step 3] Stabilize the expression In Video:: 21%|██▏ | 29/135 [00:02<00:08, 12.66it/s] [Step 3] Stabilize the expression In Video:: 23%|██▎ | 31/135 [00:02<00:08, 12.51it/s] [Step 3] Stabilize the expression In Video:: 24%|██▍ | 33/135 [00:02<00:08, 12.41it/s] [Step 3] Stabilize the expression In Video:: 26%|██▌ | 35/135 [00:03<00:08, 12.46it/s] [Step 3] Stabilize the expression In Video:: 27%|██▋ | 37/135 [00:03<00:07, 12.56it/s] [Step 3] Stabilize the expression In Video:: 29%|██▉ | 39/135 [00:03<00:07, 12.66it/s] [Step 3] Stabilize the expression In Video:: 30%|███ | 41/135 [00:03<00:07, 12.74it/s] [Step 3] Stabilize the expression In Video:: 32%|███▏ | 43/135 [00:03<00:07, 12.77it/s] [Step 3] Stabilize the expression In Video:: 33%|███▎ | 45/135 [00:03<00:07, 12.81it/s] [Step 3] Stabilize the expression In Video:: 35%|███▍ | 47/135 [00:03<00:06, 12.85it/s] [Step 3] Stabilize the expression In Video:: 36%|███▋ | 49/135 [00:04<00:06, 12.87it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 51/135 [00:04<00:06, 12.76it/s] [Step 3] Stabilize the expression In Video:: 39%|███▉ | 53/135 [00:04<00:06, 12.81it/s] [Step 3] Stabilize the expression In Video:: 41%|████ | 55/135 [00:04<00:06, 12.85it/s] [Step 3] Stabilize the expression In Video:: 42%|████▏ | 57/135 [00:04<00:06, 12.87it/s] [Step 3] Stabilize the expression In Video:: 44%|████▎ | 59/135 [00:04<00:05, 12.86it/s] [Step 3] Stabilize the expression In Video:: 45%|████▌ | 61/135 [00:05<00:05, 12.88it/s] [Step 3] Stabilize the expression In Video:: 47%|████▋ | 63/135 [00:05<00:05, 12.81it/s] [Step 3] Stabilize the expression In Video:: 48%|████▊ | 65/135 [00:05<00:05, 12.81it/s] [Step 3] Stabilize the expression In Video:: 50%|████▉ | 67/135 [00:05<00:05, 12.83it/s] [Step 3] Stabilize the expression In Video:: 51%|█████ | 69/135 [00:05<00:05, 12.86it/s] [Step 3] Stabilize the expression In Video:: 53%|█████▎ | 71/135 [00:05<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▍ | 73/135 [00:06<00:04, 12.89it/s] [Step 3] Stabilize the expression In Video:: 56%|█████▌ | 75/135 [00:06<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 57%|█████▋ | 77/135 [00:06<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 59%|█████▊ | 79/135 [00:06<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 60%|██████ | 81/135 [00:06<00:04, 12.89it/s] [Step 3] Stabilize the expression In Video:: 61%|██████▏ | 83/135 [00:06<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 63%|██████▎ | 85/135 [00:06<00:03, 12.90it/s] [Step 3] Stabilize the expression In Video:: 64%|██████▍ | 87/135 [00:07<00:03, 12.91it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▌ | 89/135 [00:07<00:03, 12.92it/s] [Step 3] Stabilize the expression In Video:: 67%|██████▋ | 91/135 [00:07<00:03, 12.93it/s] [Step 3] Stabilize the expression In Video:: 69%|██████▉ | 93/135 [00:07<00:03, 12.94it/s] [Step 3] Stabilize the expression In Video:: 70%|███████ | 95/135 [00:07<00:03, 12.94it/s] [Step 3] Stabilize the expression In Video:: 72%|███████▏ | 97/135 [00:07<00:02, 12.93it/s] [Step 3] Stabilize the expression In Video:: 73%|███████▎ | 99/135 [00:08<00:02, 12.89it/s] [Step 3] Stabilize the expression In Video:: 75%|███████▍ | 101/135 [00:08<00:02, 12.91it/s] [Step 3] Stabilize the expression In Video:: 76%|███████▋ | 103/135 [00:08<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 78%|███████▊ | 105/135 [00:08<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 79%|███████▉ | 107/135 [00:08<00:02, 12.88it/s] [Step 3] Stabilize the expression In Video:: 81%|████████ | 109/135 [00:08<00:02, 12.90it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 111/135 [00:08<00:01, 12.91it/s] [Step 3] Stabilize the expression In Video:: 84%|████████▎ | 113/135 [00:09<00:01, 12.92it/s] [Step 3] Stabilize the expression In Video:: 85%|████████▌ | 115/135 [00:09<00:01, 12.90it/s] [Step 3] Stabilize the expression In Video:: 87%|████████▋ | 117/135 [00:09<00:01, 12.92it/s] [Step 3] Stabilize the expression In Video:: 88%|████████▊ | 119/135 [00:09<00:01, 12.93it/s] [Step 3] Stabilize the expression In Video:: 90%|████████▉ | 121/135 [00:09<00:01, 12.94it/s] [Step 3] Stabilize the expression In Video:: 91%|█████████ | 123/135 [00:09<00:00, 12.91it/s] [Step 3] Stabilize the expression In Video:: 93%|█████████▎| 125/135 [00:10<00:00, 12.92it/s] [Step 3] Stabilize the expression In Video:: 94%|█████████▍| 127/135 [00:10<00:00, 12.92it/s] [Step 3] Stabilize the expression In Video:: 96%|█████████▌| 129/135 [00:10<00:00, 12.92it/s] [Step 3] Stabilize the expression In Video:: 97%|█████████▋| 131/135 [00:10<00:00, 12.89it/s] [Step 3] Stabilize the expression In Video:: 99%|█████████▊| 133/135 [00:10<00:00, 12.91it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 135/135 [00:10<00:00, 12.91it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 135/135 [00:10<00:00, 12.48it/s] [Step 4] Load audio; Length of mel chunks: 220 [Step 5] Reference Enhancement: 0%| | 0/135 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/135 [00:01<03:45, 1.68s/it] [Step 5] Reference Enhancement: 1%|▏ | 2/135 [00:01<01:44, 1.28it/s] [Step 5] Reference Enhancement: 2%|▏ | 3/135 [00:01<01:04, 2.04it/s] [Step 5] Reference Enhancement: 3%|▎ | 4/135 [00:02<00:46, 2.83it/s] [Step 5] Reference Enhancement: 4%|▎ | 5/135 [00:02<00:36, 3.59it/s] [Step 5] Reference Enhancement: 4%|▍ | 6/135 [00:02<00:30, 4.28it/s] [Step 5] Reference Enhancement: 5%|▌ | 7/135 [00:02<00:26, 4.90it/s] [Step 5] Reference Enhancement: 6%|▌ | 8/135 [00:02<00:23, 5.42it/s] [Step 5] Reference Enhancement: 7%|▋ | 9/135 [00:02<00:21, 5.81it/s] [Step 5] Reference Enhancement: 7%|▋ | 10/135 [00:02<00:20, 6.17it/s] [Step 5] Reference Enhancement: 8%|▊ | 11/135 [00:03<00:19, 6.43it/s] [Step 5] Reference Enhancement: 9%|▉ | 12/135 [00:03<00:18, 6.61it/s] [Step 5] Reference Enhancement: 10%|▉ | 13/135 [00:03<00:18, 6.74it/s] [Step 5] Reference Enhancement: 10%|█ | 14/135 [00:03<00:17, 6.85it/s] [Step 5] Reference Enhancement: 11%|█ | 15/135 [00:03<00:17, 6.93it/s] [Step 5] Reference Enhancement: 12%|█▏ | 16/135 [00:03<00:17, 6.98it/s] [Step 5] Reference Enhancement: 13%|█▎ | 17/135 [00:03<00:16, 7.00it/s] [Step 5] Reference Enhancement: 13%|█▎ | 18/135 [00:04<00:16, 7.01it/s] [Step 5] Reference Enhancement: 14%|█▍ | 19/135 [00:04<00:16, 7.04it/s] [Step 5] Reference Enhancement: 15%|█▍ | 20/135 [00:04<00:16, 7.04it/s] [Step 5] Reference Enhancement: 16%|█▌ | 21/135 [00:04<00:16, 7.06it/s] [Step 5] Reference Enhancement: 16%|█▋ | 22/135 [00:04<00:15, 7.08it/s] [Step 5] Reference Enhancement: 17%|█▋ | 23/135 [00:04<00:15, 7.10it/s] [Step 5] Reference Enhancement: 18%|█▊ | 24/135 [00:04<00:15, 7.09it/s] [Step 5] Reference Enhancement: 19%|█▊ | 25/135 [00:05<00:15, 7.10it/s] [Step 5] Reference Enhancement: 19%|█▉ | 26/135 [00:05<00:15, 7.09it/s] [Step 5] Reference Enhancement: 20%|██ | 27/135 [00:05<00:15, 7.07it/s] [Step 5] Reference Enhancement: 21%|██ | 28/135 [00:05<00:15, 7.09it/s] [Step 5] Reference Enhancement: 21%|██▏ | 29/135 [00:05<00:14, 7.08it/s] [Step 5] Reference Enhancement: 22%|██▏ | 30/135 [00:05<00:14, 7.07it/s] [Step 5] Reference Enhancement: 23%|██▎ | 31/135 [00:05<00:14, 7.07it/s] [Step 5] Reference Enhancement: 24%|██▎ | 32/135 [00:06<00:14, 7.08it/s] [Step 5] Reference Enhancement: 24%|██▍ | 33/135 [00:06<00:14, 7.08it/s] [Step 5] Reference Enhancement: 25%|██▌ | 34/135 [00:06<00:14, 7.00it/s] [Step 5] Reference Enhancement: 26%|██▌ | 35/135 [00:06<00:14, 7.03it/s] [Step 5] Reference Enhancement: 27%|██▋ | 36/135 [00:06<00:14, 7.04it/s] [Step 5] Reference Enhancement: 27%|██▋ | 37/135 [00:06<00:13, 7.03it/s] [Step 5] Reference Enhancement: 28%|██▊ | 38/135 [00:06<00:13, 7.04it/s] [Step 5] Reference Enhancement: 29%|██▉ | 39/135 [00:07<00:13, 7.08it/s] [Step 5] Reference Enhancement: 30%|██▉ | 40/135 [00:07<00:13, 7.06it/s] [Step 5] Reference Enhancement: 30%|███ | 41/135 [00:07<00:13, 7.08it/s] [Step 5] Reference Enhancement: 31%|███ | 42/135 [00:07<00:13, 7.09it/s] [Step 5] Reference Enhancement: 32%|███▏ | 43/135 [00:07<00:12, 7.10it/s] [Step 5] Reference Enhancement: 33%|███▎ | 44/135 [00:07<00:12, 7.08it/s] [Step 5] Reference Enhancement: 33%|███▎ | 45/135 [00:07<00:12, 7.12it/s] [Step 5] Reference Enhancement: 34%|███▍ | 46/135 [00:08<00:12, 7.10it/s] [Step 5] Reference Enhancement: 35%|███▍ | 47/135 [00:08<00:12, 7.10it/s] [Step 5] Reference Enhancement: 36%|███▌ | 48/135 [00:08<00:12, 7.09it/s] [Step 5] Reference Enhancement: 36%|███▋ | 49/135 [00:08<00:12, 7.06it/s] [Step 5] Reference Enhancement: 37%|███▋ | 50/135 [00:08<00:12, 7.02it/s] [Step 5] Reference Enhancement: 38%|███▊ | 51/135 [00:08<00:11, 7.02it/s] [Step 5] Reference Enhancement: 39%|███▊ | 52/135 [00:08<00:11, 7.05it/s] [Step 5] Reference Enhancement: 39%|███▉ | 53/135 [00:09<00:11, 7.04it/s] [Step 5] Reference Enhancement: 40%|████ | 54/135 [00:09<00:11, 7.10it/s] [Step 5] Reference Enhancement: 41%|████ | 55/135 [00:09<00:11, 7.14it/s] [Step 5] Reference Enhancement: 41%|████▏ | 56/135 [00:09<00:11, 7.14it/s] [Step 5] Reference Enhancement: 42%|████▏ | 57/135 [00:09<00:10, 7.11it/s] [Step 5] Reference Enhancement: 43%|████▎ | 58/135 [00:09<00:10, 7.07it/s] [Step 5] Reference Enhancement: 44%|████▎ | 59/135 [00:09<00:10, 7.05it/s] [Step 5] Reference Enhancement: 44%|████▍ | 60/135 [00:10<00:10, 7.01it/s] [Step 5] Reference Enhancement: 45%|████▌ | 61/135 [00:10<00:10, 6.92it/s] [Step 5] Reference Enhancement: 46%|████▌ | 62/135 [00:10<00:10, 6.96it/s] [Step 5] Reference Enhancement: 47%|████▋ | 63/135 [00:10<00:10, 7.04it/s] [Step 5] Reference Enhancement: 47%|████▋ | 64/135 [00:10<00:10, 7.05it/s] [Step 5] Reference Enhancement: 48%|████▊ | 65/135 [00:10<00:09, 7.07it/s] [Step 5] Reference Enhancement: 49%|████▉ | 66/135 [00:10<00:09, 7.09it/s] [Step 5] Reference Enhancement: 50%|████▉ | 67/135 [00:11<00:09, 7.09it/s] [Step 5] Reference Enhancement: 50%|█████ | 68/135 [00:11<00:09, 7.14it/s] [Step 5] Reference Enhancement: 51%|█████ | 69/135 [00:11<00:09, 7.11it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 70/135 [00:11<00:09, 7.10it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 71/135 [00:11<00:08, 7.12it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 72/135 [00:11<00:08, 7.15it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 73/135 [00:11<00:08, 7.13it/s] [Step 5] Reference Enhancement: 55%|█████▍ | 74/135 [00:12<00:08, 7.12it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 75/135 [00:12<00:08, 7.08it/s] [Step 5] Reference Enhancement: 56%|█████▋ | 76/135 [00:12<00:08, 7.08it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 77/135 [00:12<00:08, 7.08it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 78/135 [00:12<00:08, 7.08it/s] [Step 5] Reference Enhancement: 59%|█████▊ | 79/135 [00:12<00:07, 7.08it/s] [Step 5] Reference Enhancement: 59%|█████▉ | 80/135 [00:12<00:07, 7.03it/s] [Step 5] Reference Enhancement: 60%|██████ | 81/135 [00:13<00:07, 7.05it/s] [Step 5] Reference Enhancement: 61%|██████ | 82/135 [00:13<00:07, 7.08it/s] [Step 5] Reference Enhancement: 61%|██████▏ | 83/135 [00:13<00:07, 7.10it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 84/135 [00:13<00:07, 7.10it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 85/135 [00:13<00:07, 7.06it/s] [Step 5] Reference Enhancement: 64%|██████▎ | 86/135 [00:13<00:07, 6.84it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 87/135 [00:13<00:07, 6.82it/s] [Step 5] Reference Enhancement: 65%|██████▌ | 88/135 [00:14<00:07, 6.71it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 89/135 [00:14<00:06, 6.58it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 90/135 [00:14<00:06, 6.69it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 91/135 [00:14<00:06, 6.77it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 92/135 [00:14<00:06, 6.84it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 93/135 [00:14<00:06, 6.79it/s] [Step 5] Reference Enhancement: 70%|██████▉ | 94/135 [00:14<00:05, 6.89it/s] [Step 5] Reference Enhancement: 70%|███████ | 95/135 [00:15<00:05, 6.89it/s] [Step 5] Reference Enhancement: 71%|███████ | 96/135 [00:15<00:05, 6.94it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 97/135 [00:15<00:05, 7.04it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 98/135 [00:15<00:05, 7.06it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 99/135 [00:15<00:05, 6.98it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 100/135 [00:15<00:04, 7.07it/s] [Step 5] Reference Enhancement: 75%|███████▍ | 101/135 [00:15<00:04, 7.05it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 102/135 [00:16<00:04, 7.10it/s] [Step 5] Reference Enhancement: 76%|███████▋ | 103/135 [00:16<00:04, 7.06it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 104/135 [00:16<00:04, 7.12it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 105/135 [00:16<00:04, 7.08it/s] [Step 5] Reference Enhancement: 79%|███████▊ | 106/135 [00:16<00:04, 7.08it/s] [Step 5] Reference Enhancement: 79%|███████▉ | 107/135 [00:16<00:03, 7.05it/s] [Step 5] Reference Enhancement: 80%|████████ | 108/135 [00:16<00:03, 7.07it/s] [Step 5] Reference Enhancement: 81%|████████ | 109/135 [00:17<00:03, 7.03it/s] [Step 5] Reference Enhancement: 81%|████████▏ | 110/135 [00:17<00:03, 7.09it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 111/135 [00:17<00:03, 7.07it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 112/135 [00:17<00:03, 7.09it/s] [Step 5] Reference Enhancement: 84%|████████▎ | 113/135 [00:17<00:03, 6.94it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 114/135 [00:17<00:03, 6.95it/s] [Step 5] Reference Enhancement: 85%|████████▌ | 115/135 [00:17<00:02, 6.97it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 116/135 [00:18<00:02, 6.99it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 117/135 [00:18<00:02, 7.00it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 118/135 [00:18<00:02, 7.07it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 119/135 [00:18<00:02, 7.10it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 120/135 [00:18<00:02, 7.06it/s] [Step 5] Reference Enhancement: 90%|████████▉ | 121/135 [00:18<00:01, 7.09it/s] [Step 5] Reference Enhancement: 90%|█████████ | 122/135 [00:18<00:01, 7.05it/s] [Step 5] Reference Enhancement: 91%|█████████ | 123/135 [00:19<00:01, 7.06it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 124/135 [00:19<00:01, 7.11it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 125/135 [00:19<00:01, 7.13it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 126/135 [00:19<00:01, 7.09it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 127/135 [00:19<00:01, 7.07it/s] [Step 5] Reference Enhancement: 95%|█████████▍| 128/135 [00:19<00:01, 6.99it/s] [Step 5] Reference Enhancement: 96%|█████████▌| 129/135 [00:19<00:00, 7.01it/s] [Step 5] Reference Enhancement: 96%|█████████▋| 130/135 [00:20<00:00, 7.06it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 131/135 [00:20<00:00, 7.01it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 132/135 [00:20<00:00, 7.04it/s] [Step 5] Reference Enhancement: 99%|█████████▊| 133/135 [00:20<00:00, 7.01it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 134/135 [00:20<00:00, 7.05it/s] [Step 5] Reference Enhancement: 100%|██████████| 135/135 [00:20<00:00, 7.01it/s] [Step 5] Reference Enhancement: 100%|██████████| 135/135 [00:20<00:00, 6.51it/s] [Step 6] Lip Synthesis:: 0%| | 0/14 [00:00<?, ?it/s] landmark Det:: 0%| | 0/135 [00:00<?, ?it/s] landmark Det:: 1%| | 1/135 [00:00<00:25, 5.28it/s] landmark Det:: 1%|▏ | 2/135 [00:00<00:46, 2.89it/s] landmark Det:: 7%|▋ | 9/135 [00:00<00:08, 15.72it/s] landmark Det:: 12%|█▏ | 16/135 [00:00<00:04, 27.02it/s] landmark Det:: 17%|█▋ | 23/135 [00:00<00:03, 36.49it/s] landmark Det:: 22%|██▏ | 30/135 [00:01<00:02, 44.06it/s] landmark Det:: 27%|██▋ | 37/135 [00:01<00:01, 49.95it/s] landmark Det:: 33%|███▎ | 44/135 [00:01<00:01, 54.23it/s] landmark Det:: 38%|███▊ | 51/135 [00:01<00:01, 57.59it/s] landmark Det:: 43%|████▎ | 58/135 [00:01<00:01, 58.87it/s] landmark Det:: 48%|████▊ | 65/135 [00:01<00:01, 60.92it/s] landmark Det:: 53%|█████▎ | 72/135 [00:01<00:01, 62.45it/s] landmark Det:: 59%|█████▊ | 79/135 [00:01<00:00, 63.38it/s] landmark Det:: 64%|██████▎ | 86/135 [00:01<00:00, 64.36it/s] landmark Det:: 69%|██████▉ | 93/135 [00:02<00:00, 65.06it/s] landmark Det:: 74%|███████▍ | 100/135 [00:02<00:00, 65.48it/s] landmark Det:: 79%|███████▉ | 107/135 [00:02<00:00, 65.87it/s] landmark Det:: 84%|████████▍ | 114/135 [00:02<00:00, 65.90it/s] landmark Det:: 90%|████████▉ | 121/135 [00:02<00:00, 64.43it/s] landmark Det:: 95%|█████████▍| 128/135 [00:02<00:00, 65.02it/s] landmark Det:: 100%|██████████| 135/135 [00:02<00:00, 65.50it/s] landmark Det:: 100%|██████████| 135/135 [00:02<00:00, 50.46it/s] 0%| | 0/135 [00:00<?, ?it/s] 100%|██████████| 135/135 [00:00<00:00, 20511.16it/s] 0%| | 0/135 [00:00<?, ?it/s] 47%|████▋ | 64/135 [00:00<00:00, 632.71it/s] 96%|█████████▌| 129/135 [00:00<00:00, 642.09it/s] 100%|██████████| 135/135 [00:00<00:00, 641.18it/s] FaceDet:: 0%| | 0/34 [00:00<?, ?it/s] FaceDet:: 3%|▎ | 1/34 [00:00<00:29, 1.13it/s] FaceDet:: 6%|▌ | 2/34 [00:01<00:14, 2.22it/s] FaceDet:: 9%|▉ | 3/34 [00:01<00:09, 3.23it/s] FaceDet:: 12%|█▏ | 4/34 [00:01<00:07, 4.11it/s] FaceDet:: 15%|█▍ | 5/34 [00:01<00:06, 4.82it/s] FaceDet:: 18%|█▊ | 6/34 [00:01<00:05, 5.42it/s] FaceDet:: 21%|██ | 7/34 [00:01<00:04, 5.90it/s] FaceDet:: 24%|██▎ | 8/34 [00:01<00:04, 6.25it/s] FaceDet:: 26%|██▋ | 9/34 [00:02<00:03, 6.48it/s] FaceDet:: 29%|██▉ | 10/34 [00:02<00:03, 6.65it/s] FaceDet:: 32%|███▏ | 11/34 [00:02<00:03, 6.77it/s] FaceDet:: 35%|███▌ | 12/34 [00:02<00:03, 6.84it/s] FaceDet:: 38%|███▊ | 13/34 [00:02<00:03, 6.90it/s] FaceDet:: 41%|████ | 14/34 [00:02<00:02, 7.01it/s] FaceDet:: 44%|████▍ | 15/34 [00:02<00:02, 7.11it/s] FaceDet:: 47%|████▋ | 16/34 [00:02<00:02, 7.18it/s] FaceDet:: 50%|█████ | 17/34 [00:03<00:02, 7.23it/s] FaceDet:: 53%|█████▎ | 18/34 [00:03<00:02, 7.27it/s] FaceDet:: 56%|█████▌ | 19/34 [00:03<00:02, 7.34it/s] FaceDet:: 59%|█████▉ | 20/34 [00:03<00:02, 6.82it/s] FaceDet:: 62%|██████▏ | 21/34 [00:03<00:02, 6.45it/s] FaceDet:: 65%|██████▍ | 22/34 [00:03<00:01, 6.26it/s] FaceDet:: 68%|██████▊ | 23/34 [00:04<00:01, 6.13it/s] FaceDet:: 71%|███████ | 24/34 [00:04<00:01, 6.07it/s] FaceDet:: 74%|███████▎ | 25/34 [00:04<00:01, 6.01it/s] FaceDet:: 76%|███████▋ | 26/34 [00:04<00:01, 5.95it/s] FaceDet:: 79%|███████▉ | 27/34 [00:04<00:01, 5.93it/s] FaceDet:: 82%|████████▏ | 28/34 [00:04<00:00, 6.07it/s] FaceDet:: 85%|████████▌ | 29/34 [00:05<00:00, 6.01it/s] FaceDet:: 88%|████████▊ | 30/34 [00:05<00:00, 6.01it/s] FaceDet:: 91%|█████████ | 31/34 [00:05<00:00, 5.98it/s] FaceDet:: 94%|█████████▍| 32/34 [00:05<00:00, 5.97it/s] FaceDet:: 97%|█████████▋| 33/34 [00:05<00:00, 5.95it/s] FaceDet:: 100%|██████████| 34/34 [00:06<00:00, 3.21it/s] FaceDet:: 100%|██████████| 34/34 [00:06<00:00, 5.30it/s] [Step 6] Lip Synthesis:: 7%|▋ | 1/14 [00:23<05:09, 23.84s/it] [Step 6] Lip Synthesis:: 14%|█▍ | 2/14 [00:30<02:42, 13.50s/it] [Step 6] Lip Synthesis:: 21%|██▏ | 3/14 [00:36<01:51, 10.13s/it] [Step 6] Lip Synthesis:: 29%|██▊ | 4/14 [00:42<01:25, 8.60s/it] [Step 6] Lip Synthesis:: 36%|███▌ | 5/14 [00:48<01:09, 7.70s/it] [Step 6] Lip Synthesis:: 43%|████▎ | 6/14 [00:54<00:58, 7.26s/it] [Step 6] Lip Synthesis:: 50%|█████ | 7/14 [01:01<00:48, 6.88s/it] [Step 6] Lip Synthesis:: 57%|█████▋ | 8/14 [01:07<00:39, 6.65s/it] [Step 6] Lip Synthesis:: 64%|██████▍ | 9/14 [01:13<00:32, 6.52s/it] [Step 6] Lip Synthesis:: 71%|███████▏ | 10/14 [01:19<00:25, 6.47s/it] [Step 6] Lip Synthesis:: 79%|███████▊ | 11/14 [01:26<00:19, 6.40s/it] [Step 6] Lip Synthesis:: 86%|████████▌ | 12/14 [01:32<00:12, 6.37s/it] [Step 6] Lip Synthesis:: 93%|█████████▎| 13/14 [01:38<00:06, 6.28s/it] [Step 6] Lip Synthesis:: 100%|██████████| 14/14 [01:47<00:00, 7.21s/it] [Step 6] Lip Synthesis:: 100%|██████████| 14/14 [01:47<00:00, 7.70s/it]Prediction
chenxwh/video-retalking:db5a650cIDygkizg3bs67p6rvmnmezdr4qb4StatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", "input_audio": "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", input_audio: "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", "input_audio": "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", "input_audio": "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2023-12-04T01:02:11.698672Z", "created_at": "2023-12-04T01:00:21.833881Z", "data_removed": false, "error": null, "id": "ygkizg3bs67p6rvmnmezdr4qb4", "input": { "face": "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", "input_audio": "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/125 [00:00<?, ?it/s]\nlandmark Det:: 6%|▌ | 7/125 [00:00<00:01, 61.19it/s]\nlandmark Det:: 11%|█ | 14/125 [00:00<00:01, 63.32it/s]\nlandmark Det:: 17%|█▋ | 21/125 [00:00<00:01, 63.33it/s]\nlandmark Det:: 22%|██▏ | 28/125 [00:00<00:01, 63.63it/s]\nlandmark Det:: 28%|██▊ | 35/125 [00:00<00:01, 63.19it/s]\nlandmark Det:: 34%|███▎ | 42/125 [00:00<00:01, 63.97it/s]\nlandmark Det:: 39%|███▉ | 49/125 [00:00<00:01, 64.53it/s]\nlandmark Det:: 45%|████▍ | 56/125 [00:00<00:01, 64.73it/s]\nlandmark Det:: 50%|█████ | 63/125 [00:00<00:00, 64.49it/s]\nlandmark Det:: 56%|█████▌ | 70/125 [00:01<00:00, 63.70it/s]\nlandmark Det:: 62%|██████▏ | 77/125 [00:01<00:00, 63.93it/s]\nlandmark Det:: 67%|██████▋ | 84/125 [00:01<00:00, 63.29it/s]\nlandmark Det:: 73%|███████▎ | 91/125 [00:01<00:00, 63.92it/s]\nlandmark Det:: 78%|███████▊ | 98/125 [00:01<00:00, 62.63it/s]\nlandmark Det:: 84%|████████▍ | 105/125 [00:01<00:00, 63.37it/s]\nlandmark Det:: 90%|████████▉ | 112/125 [00:01<00:00, 63.72it/s]\nlandmark Det:: 95%|█████████▌| 119/125 [00:01<00:00, 64.15it/s]\nlandmark Det:: 100%|██████████| 125/125 [00:01<00:00, 63.82it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 10%|█ | 13/125 [00:00<00:00, 128.40it/s]\n[Step 2] 3DMM Extraction In Video:: 22%|██▏ | 27/125 [00:00<00:00, 130.05it/s]\n[Step 2] 3DMM Extraction In Video:: 33%|███▎ | 41/125 [00:00<00:00, 130.45it/s]\n[Step 2] 3DMM Extraction In Video:: 44%|████▍ | 55/125 [00:00<00:00, 130.64it/s]\n[Step 2] 3DMM Extraction In Video:: 55%|█████▌ | 69/125 [00:00<00:00, 130.86it/s]\n[Step 2] 3DMM Extraction In Video:: 66%|██████▋ | 83/125 [00:00<00:00, 127.96it/s]\n[Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 97/125 [00:00<00:00, 129.13it/s]\n[Step 2] 3DMM Extraction In Video:: 89%|████████▉ | 111/125 [00:00<00:00, 129.97it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:00<00:00, 130.23it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:00<00:00, 129.89it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 2/125 [00:00<00:10, 11.92it/s]\n[Step 3] Stabilize the expression In Video:: 3%|▎ | 4/125 [00:00<00:09, 12.40it/s]\n[Step 3] Stabilize the expression In Video:: 5%|▍ | 6/125 [00:00<00:09, 12.65it/s]\n[Step 3] Stabilize the expression In Video:: 6%|▋ | 8/125 [00:00<00:09, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 8%|▊ | 10/125 [00:00<00:08, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 10%|▉ | 12/125 [00:00<00:08, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 11%|█ | 14/125 [00:01<00:08, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 13%|█▎ | 16/125 [00:01<00:08, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 14%|█▍ | 18/125 [00:01<00:08, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 16%|█▌ | 20/125 [00:01<00:08, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 18%|█▊ | 22/125 [00:01<00:07, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 19%|█▉ | 24/125 [00:01<00:07, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 21%|██ | 26/125 [00:02<00:07, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 22%|██▏ | 28/125 [00:02<00:07, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 24%|██▍ | 30/125 [00:02<00:07, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▌ | 32/125 [00:02<00:07, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 27%|██▋ | 34/125 [00:02<00:07, 12.95it/s]\n[Step 3] Stabilize the expression In Video:: 29%|██▉ | 36/125 [00:02<00:06, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 30%|███ | 38/125 [00:02<00:06, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 32%|███▏ | 40/125 [00:03<00:06, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 34%|███▎ | 42/125 [00:03<00:06, 12.95it/s]\n[Step 3] Stabilize the expression In Video:: 35%|███▌ | 44/125 [00:03<00:06, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 37%|███▋ | 46/125 [00:03<00:06, 12.58it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 48/125 [00:03<00:06, 12.69it/s]\n[Step 3] Stabilize the expression In Video:: 40%|████ | 50/125 [00:03<00:05, 12.77it/s]\n[Step 3] Stabilize the expression In Video:: 42%|████▏ | 52/125 [00:04<00:05, 12.80it/s]\n[Step 3] Stabilize the expression In Video:: 43%|████▎ | 54/125 [00:04<00:05, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 45%|████▍ | 56/125 [00:04<00:05, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 46%|████▋ | 58/125 [00:04<00:05, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 48%|████▊ | 60/125 [00:04<00:05, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 50%|████▉ | 62/125 [00:04<00:04, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 51%|█████ | 64/125 [00:04<00:04, 12.75it/s]\n[Step 3] Stabilize the expression In Video:: 53%|█████▎ | 66/125 [00:05<00:04, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▍ | 68/125 [00:05<00:04, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 56%|█████▌ | 70/125 [00:05<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 58%|█████▊ | 72/125 [00:05<00:04, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 59%|█████▉ | 74/125 [00:05<00:03, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 61%|██████ | 76/125 [00:05<00:03, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 62%|██████▏ | 78/125 [00:06<00:03, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 64%|██████▍ | 80/125 [00:06<00:03, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▌ | 82/125 [00:06<00:03, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 67%|██████▋ | 84/125 [00:06<00:03, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 69%|██████▉ | 86/125 [00:06<00:03, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 70%|███████ | 88/125 [00:06<00:02, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 72%|███████▏ | 90/125 [00:07<00:02, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 74%|███████▎ | 92/125 [00:07<00:02, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 75%|███████▌ | 94/125 [00:07<00:02, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 77%|███████▋ | 96/125 [00:07<00:02, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 78%|███████▊ | 98/125 [00:07<00:02, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 80%|████████ | 100/125 [00:07<00:01, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 102/125 [00:07<00:01, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 83%|████████▎ | 104/125 [00:08<00:01, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 85%|████████▍ | 106/125 [00:08<00:01, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 86%|████████▋ | 108/125 [00:08<00:01, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 88%|████████▊ | 110/125 [00:08<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 90%|████████▉ | 112/125 [00:08<00:01, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 91%|█████████ | 114/125 [00:08<00:00, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 93%|█████████▎| 116/125 [00:09<00:00, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 94%|█████████▍| 118/125 [00:09<00:00, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 96%|█████████▌| 120/125 [00:09<00:00, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 98%|█████████▊| 122/125 [00:09<00:00, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 99%|█████████▉| 124/125 [00:09<00:00, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.86it/s]\n[Step 4] Load audio; Length of mel chunks: 122\n[Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/122 [00:00<00:18, 6.44it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:00<00:17, 6.76it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:00<00:17, 6.84it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:00<00:17, 6.89it/s]\n[Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:00<00:16, 6.98it/s]\n[Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:00<00:16, 7.00it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:01<00:16, 7.04it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:01<00:16, 7.03it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:01<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:01<00:15, 7.07it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:01<00:15, 7.06it/s]\n[Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:01<00:15, 7.05it/s]\n[Step 5] Reference Enhancement: 11%|█ | 13/122 [00:01<00:15, 7.11it/s]\n[Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:01<00:15, 7.11it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:02<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:02<00:14, 7.08it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:02<00:14, 7.08it/s]\n[Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:02<00:14, 7.04it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:02<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:02<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:02<00:14, 7.06it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:03<00:14, 7.03it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:03<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:03<00:13, 7.08it/s]\n[Step 5] Reference Enhancement: 20%|██ | 25/122 [00:03<00:13, 7.11it/s]\n[Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:03<00:13, 7.12it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:03<00:13, 7.13it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:03<00:13, 7.09it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:04<00:13, 7.10it/s]\n[Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:04<00:12, 7.08it/s]\n[Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:04<00:12, 7.14it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:04<00:12, 7.09it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:04<00:12, 7.09it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:04<00:12, 7.07it/s]\n[Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:04<00:12, 7.07it/s]\n[Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:05<00:12, 7.04it/s]\n[Step 5] Reference Enhancement: 30%|███ | 37/122 [00:05<00:12, 6.98it/s]\n[Step 5] Reference Enhancement: 31%|███ | 38/122 [00:05<00:12, 6.97it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:05<00:11, 7.05it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:05<00:11, 7.04it/s]\n[Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:05<00:11, 7.08it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:05<00:11, 7.05it/s]\n[Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:06<00:11, 7.11it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:06<00:11, 7.07it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:06<00:10, 7.07it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:06<00:10, 7.04it/s]\n[Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:06<00:10, 7.03it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:06<00:10, 7.04it/s]\n[Step 5] Reference Enhancement: 40%|████ | 49/122 [00:06<00:10, 7.07it/s]\n[Step 5] Reference Enhancement: 41%|████ | 50/122 [00:07<00:10, 7.03it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:07<00:10, 7.02it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:07<00:09, 7.01it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:07<00:09, 7.04it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:07<00:09, 7.03it/s]\n[Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:07<00:09, 7.06it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:07<00:09, 7.04it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:08<00:09, 7.10it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:08<00:09, 7.09it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:08<00:08, 7.13it/s]\n[Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:08<00:08, 7.09it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:08<00:08, 7.08it/s]\n[Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:08<00:08, 7.03it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:08<00:08, 7.06it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:09<00:08, 7.11it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:09<00:08, 7.11it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:09<00:07, 7.09it/s]\n[Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:09<00:07, 7.12it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:09<00:07, 7.16it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:09<00:07, 7.22it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:09<00:07, 7.15it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:10<00:07, 7.16it/s]\n[Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:10<00:07, 7.13it/s]\n[Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:10<00:06, 7.16it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:10<00:06, 7.16it/s]\n[Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:10<00:06, 7.11it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:10<00:06, 7.08it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:10<00:06, 7.10it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.09it/s]\n[Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:11<00:06, 7.12it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:11<00:05, 7.08it/s]\n[Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:11<00:05, 7.15it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:11<00:05, 7.11it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:11<00:05, 7.18it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:11<00:05, 7.13it/s]\n[Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:12<00:05, 7.17it/s]\n[Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:12<00:05, 7.12it/s]\n[Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:12<00:04, 7.14it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:12<00:04, 7.12it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:12<00:04, 7.16it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:12<00:04, 7.12it/s]\n[Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:12<00:04, 7.13it/s]\n[Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:12<00:04, 7.11it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:13<00:04, 7.13it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:13<00:03, 7.07it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:13<00:03, 7.07it/s]\n[Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:13<00:03, 7.02it/s]\n[Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:13<00:03, 7.10it/s]\n[Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:13<00:03, 7.07it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:13<00:03, 7.10it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:14<00:03, 7.15it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:14<00:02, 7.15it/s]\n[Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:14<00:02, 7.12it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:14<00:02, 7.13it/s]\n[Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:14<00:02, 7.11it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:14<00:02, 7.09it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:14<00:02, 7.08it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:15<00:02, 7.10it/s]\n[Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:15<00:01, 7.07it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:15<00:01, 7.12it/s]\n[Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:15<00:01, 7.08it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:15<00:01, 7.07it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:15<00:01, 7.00it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:15<00:01, 7.01it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:16<00:01, 7.02it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:16<00:00, 7.03it/s]\n[Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:16<00:00, 7.06it/s]\n[Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:16<00:00, 7.04it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:16<00:00, 7.03it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:16<00:00, 7.04it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:16<00:00, 7.05it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:17<00:00, 7.13it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.10it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.08it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/122 [00:00<00:23, 5.20it/s]\u001b[A\nlandmark Det:: 2%|▏ | 2/122 [00:00<00:41, 2.90it/s]\u001b[A\nlandmark Det:: 7%|▋ | 9/122 [00:00<00:07, 15.79it/s]\u001b[A\nlandmark Det:: 13%|█▎ | 16/122 [00:00<00:03, 27.28it/s]\u001b[A\nlandmark Det:: 19%|█▉ | 23/122 [00:00<00:02, 36.93it/s]\u001b[A\nlandmark Det:: 25%|██▍ | 30/122 [00:01<00:02, 44.13it/s]\u001b[A\nlandmark Det:: 30%|███ | 37/122 [00:01<00:01, 50.34it/s]\u001b[A\nlandmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 54.91it/s]\u001b[A\nlandmark Det:: 42%|████▏ | 51/122 [00:01<00:01, 58.41it/s]\u001b[A\nlandmark Det:: 48%|████▊ | 58/122 [00:01<00:01, 59.88it/s]\u001b[A\nlandmark Det:: 53%|█████▎ | 65/122 [00:01<00:00, 61.79it/s]\u001b[A\nlandmark Det:: 59%|█████▉ | 72/122 [00:01<00:00, 63.20it/s]\u001b[A\nlandmark Det:: 65%|██████▍ | 79/122 [00:01<00:00, 63.98it/s]\u001b[A\nlandmark Det:: 70%|███████ | 86/122 [00:01<00:00, 64.82it/s]\u001b[A\nlandmark Det:: 76%|███████▌ | 93/122 [00:02<00:00, 63.41it/s]\u001b[A\nlandmark Det:: 82%|████████▏ | 100/122 [00:02<00:00, 64.55it/s]\u001b[A\nlandmark Det:: 88%|████████▊ | 107/122 [00:02<00:00, 65.39it/s]\u001b[A\nlandmark Det:: 93%|█████████▎| 114/122 [00:02<00:00, 65.81it/s]\u001b[A\nlandmark Det:: 99%|█████████▉| 121/122 [00:02<00:00, 66.28it/s]\u001b[A\nlandmark Det:: 100%|██████████| 122/122 [00:02<00:00, 49.56it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 21365.56it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n 52%|█████▏ | 63/122 [00:00<00:00, 622.79it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 616.77it/s]\nFaceDet:: 0%| | 0/31 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 3%|▎ | 1/31 [00:01<00:33, 1.12s/it]\u001b[A\nFaceDet:: 6%|▋ | 2/31 [00:01<00:17, 1.66it/s]\u001b[A\nFaceDet:: 10%|▉ | 3/31 [00:01<00:12, 2.24it/s]\u001b[A\nFaceDet:: 13%|█▎ | 4/31 [00:01<00:10, 2.68it/s]\u001b[A\nFaceDet:: 16%|█▌ | 5/31 [00:02<00:08, 3.03it/s]\u001b[A\nFaceDet:: 19%|█▉ | 6/31 [00:02<00:07, 3.26it/s]\u001b[A\nFaceDet:: 23%|██▎ | 7/31 [00:02<00:07, 3.40it/s]\u001b[A\nFaceDet:: 26%|██▌ | 8/31 [00:02<00:06, 3.49it/s]\u001b[A\nFaceDet:: 29%|██▉ | 9/31 [00:03<00:06, 3.60it/s]\u001b[A\nFaceDet:: 32%|███▏ | 10/31 [00:03<00:05, 3.64it/s]\u001b[A\nFaceDet:: 35%|███▌ | 11/31 [00:03<00:05, 3.72it/s]\u001b[A\nFaceDet:: 39%|███▊ | 12/31 [00:03<00:05, 3.68it/s]\u001b[A\nFaceDet:: 42%|████▏ | 13/31 [00:04<00:04, 3.70it/s]\u001b[A\nFaceDet:: 45%|████▌ | 14/31 [00:04<00:04, 3.78it/s]\u001b[A\nFaceDet:: 48%|████▊ | 15/31 [00:04<00:04, 3.84it/s]\u001b[A\nFaceDet:: 52%|█████▏ | 16/31 [00:05<00:03, 3.82it/s]\u001b[A\nFaceDet:: 55%|█████▍ | 17/31 [00:05<00:03, 3.87it/s]\u001b[A\nFaceDet:: 58%|█████▊ | 18/31 [00:05<00:03, 3.89it/s]\u001b[A\nFaceDet:: 61%|██████▏ | 19/31 [00:05<00:03, 3.89it/s]\u001b[A\nFaceDet:: 65%|██████▍ | 20/31 [00:06<00:02, 3.81it/s]\u001b[A\nFaceDet:: 68%|██████▊ | 21/31 [00:06<00:02, 3.84it/s]\u001b[A\nFaceDet:: 71%|███████ | 22/31 [00:06<00:02, 3.78it/s]\u001b[A\nFaceDet:: 74%|███████▍ | 23/31 [00:06<00:02, 3.80it/s]\u001b[A\nFaceDet:: 77%|███████▋ | 24/31 [00:07<00:01, 3.76it/s]\u001b[A\nFaceDet:: 81%|████████ | 25/31 [00:07<00:01, 3.78it/s]\u001b[A\nFaceDet:: 84%|████████▍ | 26/31 [00:07<00:01, 3.77it/s]\u001b[A\nFaceDet:: 87%|████████▋ | 27/31 [00:07<00:01, 3.69it/s]\u001b[A\nFaceDet:: 90%|█████████ | 28/31 [00:08<00:00, 3.69it/s]\u001b[A\nFaceDet:: 94%|█████████▎| 29/31 [00:08<00:00, 3.69it/s]\u001b[A\nFaceDet:: 97%|█████████▋| 30/31 [00:08<00:00, 3.69it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:09<00:00, 2.64it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:09<00:00, 3.30it/s]\n[Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:21<02:28, 21.17s/it]\n[Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:28<01:17, 13.00s/it]\n[Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:35<00:51, 10.36s/it]\n[Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:42<00:36, 9.10s/it]\n[Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:50<00:25, 8.47s/it]\n[Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:57<00:16, 8.03s/it]\n[Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [01:04<00:07, 7.85s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:13<00:00, 8.08s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:13<00:00, 9.18s/it]", "metrics": { "predict_time": 109.817621, "total_time": 109.864791 }, "output": "https://replicate.delivery/pbxt/9Ef1yof7HOk55Etu6Te7Jk92s0MGPdeep8YRqvilnkuVir1PC/output.mp4", "started_at": "2023-12-04T01:00:21.881051Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/ygkizg3bs67p6rvmnmezdr4qb4", "cancel": "https://api.replicate.com/v1/predictions/ygkizg3bs67p6rvmnmezdr4qb4/cancel" }, "version": "a0dbf0b26be3a3d249473aa11fe197126a05f12e439199a0074151ae1fa47c3c" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/125 [00:00<?, ?it/s] landmark Det:: 6%|▌ | 7/125 [00:00<00:01, 61.19it/s] landmark Det:: 11%|█ | 14/125 [00:00<00:01, 63.32it/s] landmark Det:: 17%|█▋ | 21/125 [00:00<00:01, 63.33it/s] landmark Det:: 22%|██▏ | 28/125 [00:00<00:01, 63.63it/s] landmark Det:: 28%|██▊ | 35/125 [00:00<00:01, 63.19it/s] landmark Det:: 34%|███▎ | 42/125 [00:00<00:01, 63.97it/s] landmark Det:: 39%|███▉ | 49/125 [00:00<00:01, 64.53it/s] landmark Det:: 45%|████▍ | 56/125 [00:00<00:01, 64.73it/s] landmark Det:: 50%|█████ | 63/125 [00:00<00:00, 64.49it/s] landmark Det:: 56%|█████▌ | 70/125 [00:01<00:00, 63.70it/s] landmark Det:: 62%|██████▏ | 77/125 [00:01<00:00, 63.93it/s] landmark Det:: 67%|██████▋ | 84/125 [00:01<00:00, 63.29it/s] landmark Det:: 73%|███████▎ | 91/125 [00:01<00:00, 63.92it/s] landmark Det:: 78%|███████▊ | 98/125 [00:01<00:00, 62.63it/s] landmark Det:: 84%|████████▍ | 105/125 [00:01<00:00, 63.37it/s] landmark Det:: 90%|████████▉ | 112/125 [00:01<00:00, 63.72it/s] landmark Det:: 95%|█████████▌| 119/125 [00:01<00:00, 64.15it/s] landmark Det:: 100%|██████████| 125/125 [00:01<00:00, 63.82it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 10%|█ | 13/125 [00:00<00:00, 128.40it/s] [Step 2] 3DMM Extraction In Video:: 22%|██▏ | 27/125 [00:00<00:00, 130.05it/s] [Step 2] 3DMM Extraction In Video:: 33%|███▎ | 41/125 [00:00<00:00, 130.45it/s] [Step 2] 3DMM Extraction In Video:: 44%|████▍ | 55/125 [00:00<00:00, 130.64it/s] [Step 2] 3DMM Extraction In Video:: 55%|█████▌ | 69/125 [00:00<00:00, 130.86it/s] [Step 2] 3DMM Extraction In Video:: 66%|██████▋ | 83/125 [00:00<00:00, 127.96it/s] [Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 97/125 [00:00<00:00, 129.13it/s] [Step 2] 3DMM Extraction In Video:: 89%|████████▉ | 111/125 [00:00<00:00, 129.97it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:00<00:00, 130.23it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:00<00:00, 129.89it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 2/125 [00:00<00:10, 11.92it/s] [Step 3] Stabilize the expression In Video:: 3%|▎ | 4/125 [00:00<00:09, 12.40it/s] [Step 3] Stabilize the expression In Video:: 5%|▍ | 6/125 [00:00<00:09, 12.65it/s] [Step 3] Stabilize the expression In Video:: 6%|▋ | 8/125 [00:00<00:09, 12.76it/s] [Step 3] Stabilize the expression In Video:: 8%|▊ | 10/125 [00:00<00:08, 12.83it/s] [Step 3] Stabilize the expression In Video:: 10%|▉ | 12/125 [00:00<00:08, 12.84it/s] [Step 3] Stabilize the expression In Video:: 11%|█ | 14/125 [00:01<00:08, 12.87it/s] [Step 3] Stabilize the expression In Video:: 13%|█▎ | 16/125 [00:01<00:08, 12.90it/s] [Step 3] Stabilize the expression In Video:: 14%|█▍ | 18/125 [00:01<00:08, 12.91it/s] [Step 3] Stabilize the expression In Video:: 16%|█▌ | 20/125 [00:01<00:08, 12.89it/s] [Step 3] Stabilize the expression In Video:: 18%|█▊ | 22/125 [00:01<00:07, 12.92it/s] [Step 3] Stabilize the expression In Video:: 19%|█▉ | 24/125 [00:01<00:07, 12.92it/s] [Step 3] Stabilize the expression In Video:: 21%|██ | 26/125 [00:02<00:07, 12.94it/s] [Step 3] Stabilize the expression In Video:: 22%|██▏ | 28/125 [00:02<00:07, 12.92it/s] [Step 3] Stabilize the expression In Video:: 24%|██▍ | 30/125 [00:02<00:07, 12.93it/s] [Step 3] Stabilize the expression In Video:: 26%|██▌ | 32/125 [00:02<00:07, 12.94it/s] [Step 3] Stabilize the expression In Video:: 27%|██▋ | 34/125 [00:02<00:07, 12.95it/s] [Step 3] Stabilize the expression In Video:: 29%|██▉ | 36/125 [00:02<00:06, 12.93it/s] [Step 3] Stabilize the expression In Video:: 30%|███ | 38/125 [00:02<00:06, 12.94it/s] [Step 3] Stabilize the expression In Video:: 32%|███▏ | 40/125 [00:03<00:06, 12.94it/s] [Step 3] Stabilize the expression In Video:: 34%|███▎ | 42/125 [00:03<00:06, 12.95it/s] [Step 3] Stabilize the expression In Video:: 35%|███▌ | 44/125 [00:03<00:06, 12.93it/s] [Step 3] Stabilize the expression In Video:: 37%|███▋ | 46/125 [00:03<00:06, 12.58it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 48/125 [00:03<00:06, 12.69it/s] [Step 3] Stabilize the expression In Video:: 40%|████ | 50/125 [00:03<00:05, 12.77it/s] [Step 3] Stabilize the expression In Video:: 42%|████▏ | 52/125 [00:04<00:05, 12.80it/s] [Step 3] Stabilize the expression In Video:: 43%|████▎ | 54/125 [00:04<00:05, 12.82it/s] [Step 3] Stabilize the expression In Video:: 45%|████▍ | 56/125 [00:04<00:05, 12.86it/s] [Step 3] Stabilize the expression In Video:: 46%|████▋ | 58/125 [00:04<00:05, 12.89it/s] [Step 3] Stabilize the expression In Video:: 48%|████▊ | 60/125 [00:04<00:05, 12.85it/s] [Step 3] Stabilize the expression In Video:: 50%|████▉ | 62/125 [00:04<00:04, 12.76it/s] [Step 3] Stabilize the expression In Video:: 51%|█████ | 64/125 [00:04<00:04, 12.75it/s] [Step 3] Stabilize the expression In Video:: 53%|█████▎ | 66/125 [00:05<00:04, 12.81it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▍ | 68/125 [00:05<00:04, 12.83it/s] [Step 3] Stabilize the expression In Video:: 56%|█████▌ | 70/125 [00:05<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 58%|█████▊ | 72/125 [00:05<00:04, 12.89it/s] [Step 3] Stabilize the expression In Video:: 59%|█████▉ | 74/125 [00:05<00:03, 12.91it/s] [Step 3] Stabilize the expression In Video:: 61%|██████ | 76/125 [00:05<00:03, 12.90it/s] [Step 3] Stabilize the expression In Video:: 62%|██████▏ | 78/125 [00:06<00:03, 12.91it/s] [Step 3] Stabilize the expression In Video:: 64%|██████▍ | 80/125 [00:06<00:03, 12.81it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▌ | 82/125 [00:06<00:03, 12.76it/s] [Step 3] Stabilize the expression In Video:: 67%|██████▋ | 84/125 [00:06<00:03, 12.79it/s] [Step 3] Stabilize the expression In Video:: 69%|██████▉ | 86/125 [00:06<00:03, 12.83it/s] [Step 3] Stabilize the expression In Video:: 70%|███████ | 88/125 [00:06<00:02, 12.84it/s] [Step 3] Stabilize the expression In Video:: 72%|███████▏ | 90/125 [00:07<00:02, 12.85it/s] [Step 3] Stabilize the expression In Video:: 74%|███████▎ | 92/125 [00:07<00:02, 12.86it/s] [Step 3] Stabilize the expression In Video:: 75%|███████▌ | 94/125 [00:07<00:02, 12.88it/s] [Step 3] Stabilize the expression In Video:: 77%|███████▋ | 96/125 [00:07<00:02, 12.90it/s] [Step 3] Stabilize the expression In Video:: 78%|███████▊ | 98/125 [00:07<00:02, 12.91it/s] [Step 3] Stabilize the expression In Video:: 80%|████████ | 100/125 [00:07<00:01, 12.90it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 102/125 [00:07<00:01, 12.92it/s] [Step 3] Stabilize the expression In Video:: 83%|████████▎ | 104/125 [00:08<00:01, 12.79it/s] [Step 3] Stabilize the expression In Video:: 85%|████████▍ | 106/125 [00:08<00:01, 12.84it/s] [Step 3] Stabilize the expression In Video:: 86%|████████▋ | 108/125 [00:08<00:01, 12.85it/s] [Step 3] Stabilize the expression In Video:: 88%|████████▊ | 110/125 [00:08<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 90%|████████▉ | 112/125 [00:08<00:01, 12.90it/s] [Step 3] Stabilize the expression In Video:: 91%|█████████ | 114/125 [00:08<00:00, 12.92it/s] [Step 3] Stabilize the expression In Video:: 93%|█████████▎| 116/125 [00:09<00:00, 12.91it/s] [Step 3] Stabilize the expression In Video:: 94%|█████████▍| 118/125 [00:09<00:00, 12.92it/s] [Step 3] Stabilize the expression In Video:: 96%|█████████▌| 120/125 [00:09<00:00, 12.93it/s] [Step 3] Stabilize the expression In Video:: 98%|█████████▊| 122/125 [00:09<00:00, 12.94it/s] [Step 3] Stabilize the expression In Video:: 99%|█████████▉| 124/125 [00:09<00:00, 12.91it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.86it/s] [Step 4] Load audio; Length of mel chunks: 122 [Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/122 [00:00<00:18, 6.44it/s] [Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:00<00:17, 6.76it/s] [Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:00<00:17, 6.84it/s] [Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:00<00:17, 6.89it/s] [Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:00<00:16, 6.98it/s] [Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:00<00:16, 7.00it/s] [Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:01<00:16, 7.04it/s] [Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:01<00:16, 7.03it/s] [Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:01<00:15, 7.09it/s] [Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:01<00:15, 7.07it/s] [Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:01<00:15, 7.06it/s] [Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:01<00:15, 7.05it/s] [Step 5] Reference Enhancement: 11%|█ | 13/122 [00:01<00:15, 7.11it/s] [Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:01<00:15, 7.11it/s] [Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:02<00:15, 7.09it/s] [Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:02<00:14, 7.08it/s] [Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:02<00:14, 7.08it/s] [Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:02<00:14, 7.04it/s] [Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:02<00:14, 7.07it/s] [Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:02<00:14, 7.07it/s] [Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:02<00:14, 7.06it/s] [Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:03<00:14, 7.03it/s] [Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:03<00:14, 7.07it/s] [Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:03<00:13, 7.08it/s] [Step 5] Reference Enhancement: 20%|██ | 25/122 [00:03<00:13, 7.11it/s] [Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:03<00:13, 7.12it/s] [Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:03<00:13, 7.13it/s] [Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:03<00:13, 7.09it/s] [Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:04<00:13, 7.10it/s] [Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:04<00:12, 7.08it/s] [Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:04<00:12, 7.14it/s] [Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:04<00:12, 7.09it/s] [Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:04<00:12, 7.09it/s] [Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:04<00:12, 7.07it/s] [Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:04<00:12, 7.07it/s] [Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:05<00:12, 7.04it/s] [Step 5] Reference Enhancement: 30%|███ | 37/122 [00:05<00:12, 6.98it/s] [Step 5] Reference Enhancement: 31%|███ | 38/122 [00:05<00:12, 6.97it/s] [Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:05<00:11, 7.05it/s] [Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:05<00:11, 7.04it/s] [Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:05<00:11, 7.08it/s] [Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:05<00:11, 7.05it/s] [Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:06<00:11, 7.11it/s] [Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:06<00:11, 7.07it/s] [Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:06<00:10, 7.07it/s] [Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:06<00:10, 7.04it/s] [Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:06<00:10, 7.03it/s] [Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:06<00:10, 7.04it/s] [Step 5] Reference Enhancement: 40%|████ | 49/122 [00:06<00:10, 7.07it/s] [Step 5] Reference Enhancement: 41%|████ | 50/122 [00:07<00:10, 7.03it/s] [Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:07<00:10, 7.02it/s] [Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:07<00:09, 7.01it/s] [Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:07<00:09, 7.04it/s] [Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:07<00:09, 7.03it/s] [Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:07<00:09, 7.06it/s] [Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:07<00:09, 7.04it/s] [Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:08<00:09, 7.10it/s] [Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:08<00:09, 7.09it/s] [Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:08<00:08, 7.13it/s] [Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:08<00:08, 7.09it/s] [Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:08<00:08, 7.08it/s] [Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:08<00:08, 7.03it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:08<00:08, 7.06it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:09<00:08, 7.11it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:09<00:08, 7.11it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:09<00:07, 7.09it/s] [Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:09<00:07, 7.12it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:09<00:07, 7.16it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:09<00:07, 7.22it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:09<00:07, 7.15it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:10<00:07, 7.16it/s] [Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:10<00:07, 7.13it/s] [Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:10<00:06, 7.16it/s] [Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:10<00:06, 7.16it/s] [Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:10<00:06, 7.11it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:10<00:06, 7.08it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:10<00:06, 7.10it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.09it/s] [Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:11<00:06, 7.12it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:11<00:05, 7.08it/s] [Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:11<00:05, 7.15it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:11<00:05, 7.11it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:11<00:05, 7.18it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:11<00:05, 7.13it/s] [Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:12<00:05, 7.17it/s] [Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:12<00:05, 7.12it/s] [Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:12<00:04, 7.14it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:12<00:04, 7.12it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:12<00:04, 7.16it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:12<00:04, 7.12it/s] [Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:12<00:04, 7.13it/s] [Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:12<00:04, 7.11it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:13<00:04, 7.13it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:13<00:03, 7.07it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:13<00:03, 7.07it/s] [Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:13<00:03, 7.02it/s] [Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:13<00:03, 7.10it/s] [Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:13<00:03, 7.07it/s] [Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:13<00:03, 7.10it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:14<00:03, 7.15it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:14<00:02, 7.15it/s] [Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:14<00:02, 7.12it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:14<00:02, 7.13it/s] [Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:14<00:02, 7.11it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:14<00:02, 7.09it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:14<00:02, 7.08it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:15<00:02, 7.10it/s] [Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:15<00:01, 7.07it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:15<00:01, 7.12it/s] [Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:15<00:01, 7.08it/s] [Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:15<00:01, 7.07it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:15<00:01, 7.00it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:15<00:01, 7.01it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:16<00:01, 7.02it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:16<00:00, 7.03it/s] [Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:16<00:00, 7.06it/s] [Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:16<00:00, 7.04it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:16<00:00, 7.03it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:16<00:00, 7.04it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:16<00:00, 7.05it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:17<00:00, 7.13it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.10it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.08it/s] [Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s] landmark Det:: 0%| | 0/122 [00:00<?, ?it/s] landmark Det:: 1%| | 1/122 [00:00<00:23, 5.20it/s] landmark Det:: 2%|▏ | 2/122 [00:00<00:41, 2.90it/s] landmark Det:: 7%|▋ | 9/122 [00:00<00:07, 15.79it/s] landmark Det:: 13%|█▎ | 16/122 [00:00<00:03, 27.28it/s] landmark Det:: 19%|█▉ | 23/122 [00:00<00:02, 36.93it/s] landmark Det:: 25%|██▍ | 30/122 [00:01<00:02, 44.13it/s] landmark Det:: 30%|███ | 37/122 [00:01<00:01, 50.34it/s] landmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 54.91it/s] landmark Det:: 42%|████▏ | 51/122 [00:01<00:01, 58.41it/s] landmark Det:: 48%|████▊ | 58/122 [00:01<00:01, 59.88it/s] landmark Det:: 53%|█████▎ | 65/122 [00:01<00:00, 61.79it/s] landmark Det:: 59%|█████▉ | 72/122 [00:01<00:00, 63.20it/s] landmark Det:: 65%|██████▍ | 79/122 [00:01<00:00, 63.98it/s] landmark Det:: 70%|███████ | 86/122 [00:01<00:00, 64.82it/s] landmark Det:: 76%|███████▌ | 93/122 [00:02<00:00, 63.41it/s] landmark Det:: 82%|████████▏ | 100/122 [00:02<00:00, 64.55it/s] landmark Det:: 88%|████████▊ | 107/122 [00:02<00:00, 65.39it/s] landmark Det:: 93%|█████████▎| 114/122 [00:02<00:00, 65.81it/s] landmark Det:: 99%|█████████▉| 121/122 [00:02<00:00, 66.28it/s] landmark Det:: 100%|██████████| 122/122 [00:02<00:00, 49.56it/s] 0%| | 0/122 [00:00<?, ?it/s] 100%|██████████| 122/122 [00:00<00:00, 21365.56it/s] 0%| | 0/122 [00:00<?, ?it/s] 52%|█████▏ | 63/122 [00:00<00:00, 622.79it/s] 100%|██████████| 122/122 [00:00<00:00, 616.77it/s] FaceDet:: 0%| | 0/31 [00:00<?, ?it/s] FaceDet:: 3%|▎ | 1/31 [00:01<00:33, 1.12s/it] FaceDet:: 6%|▋ | 2/31 [00:01<00:17, 1.66it/s] FaceDet:: 10%|▉ | 3/31 [00:01<00:12, 2.24it/s] FaceDet:: 13%|█▎ | 4/31 [00:01<00:10, 2.68it/s] FaceDet:: 16%|█▌ | 5/31 [00:02<00:08, 3.03it/s] FaceDet:: 19%|█▉ | 6/31 [00:02<00:07, 3.26it/s] FaceDet:: 23%|██▎ | 7/31 [00:02<00:07, 3.40it/s] FaceDet:: 26%|██▌ | 8/31 [00:02<00:06, 3.49it/s] FaceDet:: 29%|██▉ | 9/31 [00:03<00:06, 3.60it/s] FaceDet:: 32%|███▏ | 10/31 [00:03<00:05, 3.64it/s] FaceDet:: 35%|███▌ | 11/31 [00:03<00:05, 3.72it/s] FaceDet:: 39%|███▊ | 12/31 [00:03<00:05, 3.68it/s] FaceDet:: 42%|████▏ | 13/31 [00:04<00:04, 3.70it/s] FaceDet:: 45%|████▌ | 14/31 [00:04<00:04, 3.78it/s] FaceDet:: 48%|████▊ | 15/31 [00:04<00:04, 3.84it/s] FaceDet:: 52%|█████▏ | 16/31 [00:05<00:03, 3.82it/s] FaceDet:: 55%|█████▍ | 17/31 [00:05<00:03, 3.87it/s] FaceDet:: 58%|█████▊ | 18/31 [00:05<00:03, 3.89it/s] FaceDet:: 61%|██████▏ | 19/31 [00:05<00:03, 3.89it/s] FaceDet:: 65%|██████▍ | 20/31 [00:06<00:02, 3.81it/s] FaceDet:: 68%|██████▊ | 21/31 [00:06<00:02, 3.84it/s] FaceDet:: 71%|███████ | 22/31 [00:06<00:02, 3.78it/s] FaceDet:: 74%|███████▍ | 23/31 [00:06<00:02, 3.80it/s] FaceDet:: 77%|███████▋ | 24/31 [00:07<00:01, 3.76it/s] FaceDet:: 81%|████████ | 25/31 [00:07<00:01, 3.78it/s] FaceDet:: 84%|████████▍ | 26/31 [00:07<00:01, 3.77it/s] FaceDet:: 87%|████████▋ | 27/31 [00:07<00:01, 3.69it/s] FaceDet:: 90%|█████████ | 28/31 [00:08<00:00, 3.69it/s] FaceDet:: 94%|█████████▎| 29/31 [00:08<00:00, 3.69it/s] FaceDet:: 97%|█████████▋| 30/31 [00:08<00:00, 3.69it/s] FaceDet:: 100%|██████████| 31/31 [00:09<00:00, 2.64it/s] FaceDet:: 100%|██████████| 31/31 [00:09<00:00, 3.30it/s] [Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:21<02:28, 21.17s/it] [Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:28<01:17, 13.00s/it] [Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:35<00:51, 10.36s/it] [Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:42<00:36, 9.10s/it] [Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:50<00:25, 8.47s/it] [Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:57<00:16, 8.03s/it] [Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [01:04<00:07, 7.85s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:13<00:00, 8.08s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:13<00:00, 9.18s/it]Prediction
chenxwh/video-retalking:db5a650cIDpqbnb23bqhkoanwjfarus74axeStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", "input_audio": "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", input_audio: "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", "input_audio": "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", "input_audio": "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-01-15T23:25:36.558741Z", "created_at": "2024-01-15T23:21:10.134644Z", "data_removed": false, "error": null, "id": "pqbnb23bqhkoanwjfarus74axe", "input": { "face": "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", "input_audio": "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/125 [00:00<?, ?it/s]\nlandmark Det:: 1%| | 1/125 [00:09<18:35, 9.00s/it]\nlandmark Det:: 2%|▏ | 2/125 [00:15<15:31, 7.57s/it]\nlandmark Det:: 7%|▋ | 9/125 [00:15<02:09, 1.11s/it]\nlandmark Det:: 13%|█▎ | 16/125 [00:15<00:55, 1.96it/s]\nlandmark Det:: 18%|█▊ | 23/125 [00:15<00:29, 3.41it/s]\nlandmark Det:: 24%|██▍ | 30/125 [00:16<00:17, 5.36it/s]\nlandmark Det:: 30%|██▉ | 37/125 [00:16<00:11, 7.93it/s]\nlandmark Det:: 34%|███▍ | 43/125 [00:16<00:07, 10.76it/s]\nlandmark Det:: 40%|████ | 50/125 [00:16<00:05, 14.93it/s]\nlandmark Det:: 45%|████▍ | 56/125 [00:16<00:03, 18.96it/s]\nlandmark Det:: 50%|█████ | 63/125 [00:16<00:02, 24.47it/s]\nlandmark Det:: 56%|█████▌ | 70/125 [00:16<00:01, 30.41it/s]\nlandmark Det:: 62%|██████▏ | 77/125 [00:16<00:01, 35.98it/s]\nlandmark Det:: 67%|██████▋ | 84/125 [00:16<00:00, 41.04it/s]\nlandmark Det:: 73%|███████▎ | 91/125 [00:17<00:00, 45.62it/s]\nlandmark Det:: 78%|███████▊ | 98/125 [00:17<00:00, 48.72it/s]\nlandmark Det:: 83%|████████▎ | 104/125 [00:17<00:00, 51.06it/s]\nlandmark Det:: 89%|████████▉ | 111/125 [00:17<00:00, 53.91it/s]\nlandmark Det:: 94%|█████████▎| 117/125 [00:17<00:00, 54.60it/s]\nlandmark Det:: 99%|█████████▉| 124/125 [00:17<00:00, 56.96it/s]\nlandmark Det:: 100%|██████████| 125/125 [00:17<00:00, 7.10it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 1%| | 1/125 [00:00<00:21, 5.64it/s]\n[Step 2] 3DMM Extraction In Video:: 12%|█▏ | 15/125 [00:00<00:01, 63.79it/s]\n[Step 2] 3DMM Extraction In Video:: 23%|██▎ | 29/125 [00:00<00:01, 91.19it/s]\n[Step 2] 3DMM Extraction In Video:: 34%|███▍ | 43/125 [00:00<00:00, 106.78it/s]\n[Step 2] 3DMM Extraction In Video:: 46%|████▌ | 57/125 [00:00<00:00, 115.69it/s]\n[Step 2] 3DMM Extraction In Video:: 57%|█████▋ | 71/125 [00:00<00:00, 121.07it/s]\n[Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 84/125 [00:00<00:00, 120.56it/s]\n[Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 98/125 [00:00<00:00, 124.50it/s]\n[Step 2] 3DMM Extraction In Video:: 90%|████████▉ | 112/125 [00:01<00:00, 127.22it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:01<00:00, 111.56it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 1%| | 1/125 [00:00<00:43, 2.84it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 3/125 [00:00<00:18, 6.69it/s]\n[Step 3] Stabilize the expression In Video:: 4%|▍ | 5/125 [00:00<00:13, 8.90it/s]\n[Step 3] Stabilize the expression In Video:: 6%|▌ | 7/125 [00:00<00:11, 10.26it/s]\n[Step 3] Stabilize the expression In Video:: 7%|▋ | 9/125 [00:00<00:10, 11.13it/s]\n[Step 3] Stabilize the expression In Video:: 9%|▉ | 11/125 [00:01<00:09, 11.68it/s]\n[Step 3] Stabilize the expression In Video:: 10%|█ | 13/125 [00:01<00:09, 12.07it/s]\n[Step 3] Stabilize the expression In Video:: 12%|█▏ | 15/125 [00:01<00:08, 12.33it/s]\n[Step 3] Stabilize the expression In Video:: 14%|█▎ | 17/125 [00:01<00:08, 12.51it/s]\n[Step 3] Stabilize the expression In Video:: 15%|█▌ | 19/125 [00:01<00:08, 12.65it/s]\n[Step 3] Stabilize the expression In Video:: 17%|█▋ | 21/125 [00:01<00:08, 12.72it/s]\n[Step 3] Stabilize the expression In Video:: 18%|█▊ | 23/125 [00:02<00:07, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 20%|██ | 25/125 [00:02<00:07, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 22%|██▏ | 27/125 [00:02<00:07, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 23%|██▎ | 29/125 [00:02<00:07, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 25%|██▍ | 31/125 [00:02<00:07, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▋ | 33/125 [00:02<00:07, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 28%|██▊ | 35/125 [00:02<00:06, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 30%|██▉ | 37/125 [00:03<00:06, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 31%|███ | 39/125 [00:03<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 33%|███▎ | 41/125 [00:03<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 34%|███▍ | 43/125 [00:03<00:06, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 36%|███▌ | 45/125 [00:03<00:06, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 47/125 [00:03<00:06, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 39%|███▉ | 49/125 [00:04<00:05, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 41%|████ | 51/125 [00:04<00:05, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 42%|████▏ | 53/125 [00:04<00:05, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 44%|████▍ | 55/125 [00:04<00:05, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 46%|████▌ | 57/125 [00:04<00:05, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 47%|████▋ | 59/125 [00:04<00:05, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 49%|████▉ | 61/125 [00:05<00:04, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 50%|█████ | 63/125 [00:05<00:04, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 52%|█████▏ | 65/125 [00:05<00:04, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▎ | 67/125 [00:05<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 55%|█████▌ | 69/125 [00:05<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 57%|█████▋ | 71/125 [00:05<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 58%|█████▊ | 73/125 [00:05<00:04, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 60%|██████ | 75/125 [00:06<00:03, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 62%|██████▏ | 77/125 [00:06<00:03, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 63%|██████▎ | 79/125 [00:06<00:03, 12.74it/s]\n[Step 3] Stabilize the expression In Video:: 65%|██████▍ | 81/125 [00:06<00:03, 12.73it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▋ | 83/125 [00:06<00:03, 12.78it/s]\n[Step 3] Stabilize the expression In Video:: 68%|██████▊ | 85/125 [00:06<00:03, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 70%|██████▉ | 87/125 [00:07<00:02, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 71%|███████ | 89/125 [00:07<00:02, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 73%|███████▎ | 91/125 [00:07<00:02, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 74%|███████▍ | 93/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 76%|███████▌ | 95/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 78%|███████▊ | 97/125 [00:07<00:02, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 79%|███████▉ | 99/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 81%|████████ | 101/125 [00:08<00:01, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 103/125 [00:08<00:01, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 84%|████████▍ | 105/125 [00:08<00:01, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 86%|████████▌ | 107/125 [00:08<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 87%|████████▋ | 109/125 [00:08<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 89%|████████▉ | 111/125 [00:08<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 90%|█████████ | 113/125 [00:09<00:00, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 92%|█████████▏| 115/125 [00:09<00:00, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 94%|█████████▎| 117/125 [00:09<00:00, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 95%|█████████▌| 119/125 [00:09<00:00, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 97%|█████████▋| 121/125 [00:09<00:00, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 98%|█████████▊| 123/125 [00:09<00:00, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.54it/s]\n[Step 4] Load audio; Length of mel chunks: 122\n[Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/122 [00:01<02:14, 1.11s/it]\n[Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:01<01:05, 1.84it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:01<00:42, 2.79it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:01<00:32, 3.67it/s]\n[Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:01<00:26, 4.44it/s]\n[Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:01<00:22, 5.09it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:01<00:20, 5.56it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:02<00:19, 5.98it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:02<00:17, 6.29it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:02<00:17, 6.54it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:02<00:16, 6.70it/s]\n[Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:02<00:16, 6.83it/s]\n[Step 5] Reference Enhancement: 11%|█ | 13/122 [00:02<00:15, 6.92it/s]\n[Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:02<00:15, 7.02it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:03<00:15, 7.07it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:03<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:03<00:14, 7.09it/s]\n[Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:03<00:14, 7.05it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:03<00:14, 7.03it/s]\n[Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:03<00:14, 7.05it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:03<00:14, 7.09it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:04<00:14, 7.12it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:04<00:13, 7.08it/s]\n[Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:04<00:13, 7.05it/s]\n[Step 5] Reference Enhancement: 20%|██ | 25/122 [00:04<00:13, 7.07it/s]\n[Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:04<00:13, 7.06it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:04<00:13, 7.07it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:04<00:13, 7.05it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:05<00:13, 7.10it/s]\n[Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:05<00:12, 7.09it/s]\n[Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:05<00:12, 7.10it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:05<00:12, 7.04it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:05<00:12, 7.05it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:05<00:12, 7.09it/s]\n[Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:05<00:12, 7.06it/s]\n[Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:06<00:12, 7.10it/s]\n[Step 5] Reference Enhancement: 30%|███ | 37/122 [00:06<00:12, 7.05it/s]\n[Step 5] Reference Enhancement: 31%|███ | 38/122 [00:06<00:11, 7.12it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:06<00:11, 7.08it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:06<00:11, 7.04it/s]\n[Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:06<00:11, 7.12it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:06<00:11, 7.12it/s]\n[Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:07<00:11, 7.14it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:07<00:10, 7.16it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:07<00:10, 7.14it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:07<00:10, 7.13it/s]\n[Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:07<00:10, 7.10it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:07<00:10, 7.10it/s]\n[Step 5] Reference Enhancement: 40%|████ | 49/122 [00:07<00:10, 7.00it/s]\n[Step 5] Reference Enhancement: 41%|████ | 50/122 [00:08<00:10, 7.02it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:08<00:10, 7.09it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:08<00:09, 7.12it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:08<00:09, 7.09it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:08<00:09, 7.06it/s]\n[Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:08<00:09, 7.08it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:08<00:09, 7.08it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:09<00:09, 7.10it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:09<00:09, 7.10it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:09<00:08, 7.06it/s]\n[Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:09<00:08, 7.05it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:09<00:08, 7.03it/s]\n[Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:09<00:08, 7.07it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:09<00:08, 7.09it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:10<00:08, 7.11it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:10<00:08, 7.10it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:10<00:07, 7.05it/s]\n[Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:10<00:07, 7.06it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:10<00:07, 7.05it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:10<00:07, 7.06it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:10<00:07, 6.97it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:11<00:07, 6.98it/s]\n[Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:11<00:07, 7.01it/s]\n[Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:11<00:06, 7.01it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:11<00:06, 7.01it/s]\n[Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:11<00:06, 7.01it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:11<00:06, 7.03it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:11<00:06, 7.02it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.04it/s]\n[Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:12<00:06, 7.00it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:12<00:05, 7.04it/s]\n[Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:12<00:05, 7.00it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:12<00:05, 6.98it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:12<00:05, 7.01it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:12<00:05, 7.02it/s]\n[Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:12<00:05, 7.01it/s]\n[Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:13<00:05, 7.04it/s]\n[Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:13<00:04, 7.05it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:13<00:04, 7.07it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:13<00:04, 7.11it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:13<00:04, 7.10it/s]\n[Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:13<00:04, 7.06it/s]\n[Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:13<00:04, 7.03it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:14<00:04, 7.03it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:14<00:04, 6.99it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:14<00:03, 7.01it/s]\n[Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:14<00:03, 7.03it/s]\n[Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:14<00:03, 7.05it/s]\n[Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:14<00:03, 7.02it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:14<00:03, 7.05it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:15<00:03, 7.04it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:15<00:02, 7.01it/s]\n[Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:15<00:02, 7.02it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:15<00:02, 7.05it/s]\n[Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:15<00:02, 7.01it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:15<00:02, 7.02it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:15<00:02, 6.97it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:16<00:02, 6.97it/s]\n[Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:16<00:02, 6.99it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:16<00:01, 7.00it/s]\n[Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:16<00:01, 6.97it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:16<00:01, 7.00it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:16<00:01, 7.00it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:16<00:01, 7.00it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:17<00:01, 6.96it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:17<00:01, 6.94it/s]\n[Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:17<00:00, 6.99it/s]\n[Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:17<00:00, 7.01it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:17<00:00, 7.03it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:17<00:00, 7.05it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:17<00:00, 7.04it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:18<00:00, 7.06it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:18<00:00, 7.04it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:18<00:00, 6.68it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/122 [00:00<00:22, 5.45it/s]\u001b[A\nlandmark Det:: 2%|▏ | 2/122 [00:00<00:40, 2.99it/s]\u001b[A\nlandmark Det:: 7%|▋ | 8/122 [00:00<00:08, 14.09it/s]\u001b[A\nlandmark Det:: 11%|█▏ | 14/122 [00:00<00:04, 23.70it/s]\u001b[A\nlandmark Det:: 16%|█▋ | 20/122 [00:00<00:03, 31.61it/s]\u001b[A\nlandmark Det:: 21%|██▏ | 26/122 [00:01<00:02, 37.89it/s]\u001b[A\nlandmark Det:: 26%|██▌ | 32/122 [00:01<00:02, 42.45it/s]\u001b[A\nlandmark Det:: 31%|███ | 38/122 [00:01<00:01, 44.87it/s]\u001b[A\nlandmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 47.18it/s]\u001b[A\nlandmark Det:: 41%|████ | 50/122 [00:01<00:01, 49.21it/s]\u001b[A\nlandmark Det:: 46%|████▌ | 56/122 [00:01<00:01, 51.04it/s]\u001b[A\nlandmark Det:: 51%|█████ | 62/122 [00:01<00:01, 52.43it/s]\u001b[A\nlandmark Det:: 56%|█████▌ | 68/122 [00:01<00:01, 52.97it/s]\u001b[A\nlandmark Det:: 61%|██████ | 74/122 [00:01<00:00, 53.58it/s]\u001b[A\nlandmark Det:: 66%|██████▌ | 80/122 [00:02<00:00, 54.19it/s]\u001b[A\nlandmark Det:: 70%|███████ | 86/122 [00:02<00:00, 54.44it/s]\u001b[A\nlandmark Det:: 75%|███████▌ | 92/122 [00:02<00:00, 53.38it/s]\u001b[A\nlandmark Det:: 80%|████████ | 98/122 [00:02<00:00, 53.31it/s]\u001b[A\nlandmark Det:: 85%|████████▌ | 104/122 [00:02<00:00, 53.55it/s]\u001b[A\nlandmark Det:: 90%|█████████ | 110/122 [00:02<00:00, 53.73it/s]\u001b[A\nlandmark Det:: 95%|█████████▌| 116/122 [00:02<00:00, 54.48it/s]\u001b[A\nlandmark Det:: 100%|██████████| 122/122 [00:02<00:00, 54.89it/s]\u001b[A\nlandmark Det:: 100%|██████████| 122/122 [00:02<00:00, 43.08it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 20623.29it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n 54%|█████▍ | 66/122 [00:00<00:00, 656.23it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 671.87it/s]\nFaceDet:: 0%| | 0/31 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 3%|▎ | 1/31 [00:00<00:22, 1.34it/s]\u001b[A\nFaceDet:: 6%|▋ | 2/31 [00:00<00:12, 2.38it/s]\u001b[A\nFaceDet:: 10%|▉ | 3/31 [00:01<00:08, 3.26it/s]\u001b[A\nFaceDet:: 13%|█▎ | 4/31 [00:01<00:07, 3.83it/s]\u001b[A\nFaceDet:: 16%|█▌ | 5/31 [00:01<00:06, 4.26it/s]\u001b[A\nFaceDet:: 19%|█▉ | 6/31 [00:01<00:05, 4.53it/s]\u001b[A\nFaceDet:: 23%|██▎ | 7/31 [00:01<00:05, 4.77it/s]\u001b[A\nFaceDet:: 26%|██▌ | 8/31 [00:02<00:04, 4.95it/s]\u001b[A\nFaceDet:: 29%|██▉ | 9/31 [00:02<00:04, 5.04it/s]\u001b[A\nFaceDet:: 32%|███▏ | 10/31 [00:02<00:03, 5.37it/s]\u001b[A\nFaceDet:: 35%|███▌ | 11/31 [00:02<00:03, 5.40it/s]\u001b[A\nFaceDet:: 39%|███▊ | 12/31 [00:02<00:03, 5.39it/s]\u001b[A\nFaceDet:: 42%|████▏ | 13/31 [00:02<00:03, 5.47it/s]\u001b[A\nFaceDet:: 45%|████▌ | 14/31 [00:03<00:03, 5.56it/s]\u001b[A\nFaceDet:: 48%|████▊ | 15/31 [00:03<00:02, 5.53it/s]\u001b[A\nFaceDet:: 52%|█████▏ | 16/31 [00:03<00:02, 5.49it/s]\u001b[A\nFaceDet:: 55%|█████▍ | 17/31 [00:03<00:02, 5.46it/s]\u001b[A\nFaceDet:: 58%|█████▊ | 18/31 [00:03<00:02, 5.43it/s]\u001b[A\nFaceDet:: 61%|██████▏ | 19/31 [00:04<00:02, 5.43it/s]\u001b[A\nFaceDet:: 65%|██████▍ | 20/31 [00:04<00:02, 5.35it/s]\u001b[A\nFaceDet:: 68%|██████▊ | 21/31 [00:04<00:01, 5.36it/s]\u001b[A\nFaceDet:: 71%|███████ | 22/31 [00:04<00:01, 5.27it/s]\u001b[A\nFaceDet:: 74%|███████▍ | 23/31 [00:04<00:01, 5.24it/s]\u001b[A\nFaceDet:: 77%|███████▋ | 24/31 [00:04<00:01, 5.32it/s]\u001b[A\nFaceDet:: 81%|████████ | 25/31 [00:05<00:01, 5.33it/s]\u001b[A\nFaceDet:: 84%|████████▍ | 26/31 [00:05<00:00, 5.36it/s]\u001b[A\nFaceDet:: 87%|████████▋ | 27/31 [00:05<00:00, 5.36it/s]\u001b[A\nFaceDet:: 90%|█████████ | 28/31 [00:05<00:00, 5.36it/s]\u001b[A\nFaceDet:: 94%|█████████▎| 29/31 [00:05<00:00, 5.39it/s]\u001b[A\nFaceDet:: 97%|█████████▋| 30/31 [00:06<00:00, 5.48it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:06<00:00, 3.83it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:06<00:00, 4.74it/s]\n[Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:23<02:43, 23.33s/it]\n[Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:28<01:16, 12.74s/it]\n[Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:33<00:46, 9.35s/it]\n[Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:39<00:31, 7.77s/it]\n[Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:44<00:20, 6.89s/it]\n[Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:49<00:12, 6.36s/it]\n[Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [00:55<00:06, 6.05s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:01<00:00, 6.03s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:01<00:00, 7.67s/it]", "metrics": { "predict_time": 114.076838, "total_time": 266.424097 }, "output": "https://replicate.delivery/pbxt/DBec3xV3pPSdOCfBFQBMAdJhW0Zekvy4yDzmANZR3M3fOczIB/output.mp4", "started_at": "2024-01-15T23:23:42.481903Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/pqbnb23bqhkoanwjfarus74axe", "cancel": "https://api.replicate.com/v1/predictions/pqbnb23bqhkoanwjfarus74axe/cancel" }, "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/125 [00:00<?, ?it/s] landmark Det:: 1%| | 1/125 [00:09<18:35, 9.00s/it] landmark Det:: 2%|▏ | 2/125 [00:15<15:31, 7.57s/it] landmark Det:: 7%|▋ | 9/125 [00:15<02:09, 1.11s/it] landmark Det:: 13%|█▎ | 16/125 [00:15<00:55, 1.96it/s] landmark Det:: 18%|█▊ | 23/125 [00:15<00:29, 3.41it/s] landmark Det:: 24%|██▍ | 30/125 [00:16<00:17, 5.36it/s] landmark Det:: 30%|██▉ | 37/125 [00:16<00:11, 7.93it/s] landmark Det:: 34%|███▍ | 43/125 [00:16<00:07, 10.76it/s] landmark Det:: 40%|████ | 50/125 [00:16<00:05, 14.93it/s] landmark Det:: 45%|████▍ | 56/125 [00:16<00:03, 18.96it/s] landmark Det:: 50%|█████ | 63/125 [00:16<00:02, 24.47it/s] landmark Det:: 56%|█████▌ | 70/125 [00:16<00:01, 30.41it/s] landmark Det:: 62%|██████▏ | 77/125 [00:16<00:01, 35.98it/s] landmark Det:: 67%|██████▋ | 84/125 [00:16<00:00, 41.04it/s] landmark Det:: 73%|███████▎ | 91/125 [00:17<00:00, 45.62it/s] landmark Det:: 78%|███████▊ | 98/125 [00:17<00:00, 48.72it/s] landmark Det:: 83%|████████▎ | 104/125 [00:17<00:00, 51.06it/s] landmark Det:: 89%|████████▉ | 111/125 [00:17<00:00, 53.91it/s] landmark Det:: 94%|█████████▎| 117/125 [00:17<00:00, 54.60it/s] landmark Det:: 99%|█████████▉| 124/125 [00:17<00:00, 56.96it/s] landmark Det:: 100%|██████████| 125/125 [00:17<00:00, 7.10it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 1%| | 1/125 [00:00<00:21, 5.64it/s] [Step 2] 3DMM Extraction In Video:: 12%|█▏ | 15/125 [00:00<00:01, 63.79it/s] [Step 2] 3DMM Extraction In Video:: 23%|██▎ | 29/125 [00:00<00:01, 91.19it/s] [Step 2] 3DMM Extraction In Video:: 34%|███▍ | 43/125 [00:00<00:00, 106.78it/s] [Step 2] 3DMM Extraction In Video:: 46%|████▌ | 57/125 [00:00<00:00, 115.69it/s] [Step 2] 3DMM Extraction In Video:: 57%|█████▋ | 71/125 [00:00<00:00, 121.07it/s] [Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 84/125 [00:00<00:00, 120.56it/s] [Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 98/125 [00:00<00:00, 124.50it/s] [Step 2] 3DMM Extraction In Video:: 90%|████████▉ | 112/125 [00:01<00:00, 127.22it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:01<00:00, 111.56it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 1%| | 1/125 [00:00<00:43, 2.84it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 3/125 [00:00<00:18, 6.69it/s] [Step 3] Stabilize the expression In Video:: 4%|▍ | 5/125 [00:00<00:13, 8.90it/s] [Step 3] Stabilize the expression In Video:: 6%|▌ | 7/125 [00:00<00:11, 10.26it/s] [Step 3] Stabilize the expression In Video:: 7%|▋ | 9/125 [00:00<00:10, 11.13it/s] [Step 3] Stabilize the expression In Video:: 9%|▉ | 11/125 [00:01<00:09, 11.68it/s] [Step 3] Stabilize the expression In Video:: 10%|█ | 13/125 [00:01<00:09, 12.07it/s] [Step 3] Stabilize the expression In Video:: 12%|█▏ | 15/125 [00:01<00:08, 12.33it/s] [Step 3] Stabilize the expression In Video:: 14%|█▎ | 17/125 [00:01<00:08, 12.51it/s] [Step 3] Stabilize the expression In Video:: 15%|█▌ | 19/125 [00:01<00:08, 12.65it/s] [Step 3] Stabilize the expression In Video:: 17%|█▋ | 21/125 [00:01<00:08, 12.72it/s] [Step 3] Stabilize the expression In Video:: 18%|█▊ | 23/125 [00:02<00:07, 12.79it/s] [Step 3] Stabilize the expression In Video:: 20%|██ | 25/125 [00:02<00:07, 12.83it/s] [Step 3] Stabilize the expression In Video:: 22%|██▏ | 27/125 [00:02<00:07, 12.84it/s] [Step 3] Stabilize the expression In Video:: 23%|██▎ | 29/125 [00:02<00:07, 12.88it/s] [Step 3] Stabilize the expression In Video:: 25%|██▍ | 31/125 [00:02<00:07, 12.88it/s] [Step 3] Stabilize the expression In Video:: 26%|██▋ | 33/125 [00:02<00:07, 12.85it/s] [Step 3] Stabilize the expression In Video:: 28%|██▊ | 35/125 [00:02<00:06, 12.86it/s] [Step 3] Stabilize the expression In Video:: 30%|██▉ | 37/125 [00:03<00:06, 12.88it/s] [Step 3] Stabilize the expression In Video:: 31%|███ | 39/125 [00:03<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 33%|███▎ | 41/125 [00:03<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 34%|███▍ | 43/125 [00:03<00:06, 12.85it/s] [Step 3] Stabilize the expression In Video:: 36%|███▌ | 45/125 [00:03<00:06, 12.87it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 47/125 [00:03<00:06, 12.88it/s] [Step 3] Stabilize the expression In Video:: 39%|███▉ | 49/125 [00:04<00:05, 12.89it/s] [Step 3] Stabilize the expression In Video:: 41%|████ | 51/125 [00:04<00:05, 12.87it/s] [Step 3] Stabilize the expression In Video:: 42%|████▏ | 53/125 [00:04<00:05, 12.89it/s] [Step 3] Stabilize the expression In Video:: 44%|████▍ | 55/125 [00:04<00:05, 12.91it/s] [Step 3] Stabilize the expression In Video:: 46%|████▌ | 57/125 [00:04<00:05, 12.90it/s] [Step 3] Stabilize the expression In Video:: 47%|████▋ | 59/125 [00:04<00:05, 12.90it/s] [Step 3] Stabilize the expression In Video:: 49%|████▉ | 61/125 [00:05<00:04, 12.91it/s] [Step 3] Stabilize the expression In Video:: 50%|█████ | 63/125 [00:05<00:04, 12.92it/s] [Step 3] Stabilize the expression In Video:: 52%|█████▏ | 65/125 [00:05<00:04, 12.90it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▎ | 67/125 [00:05<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 55%|█████▌ | 69/125 [00:05<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 57%|█████▋ | 71/125 [00:05<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 58%|█████▊ | 73/125 [00:05<00:04, 12.91it/s] [Step 3] Stabilize the expression In Video:: 60%|██████ | 75/125 [00:06<00:03, 12.90it/s] [Step 3] Stabilize the expression In Video:: 62%|██████▏ | 77/125 [00:06<00:03, 12.91it/s] [Step 3] Stabilize the expression In Video:: 63%|██████▎ | 79/125 [00:06<00:03, 12.74it/s] [Step 3] Stabilize the expression In Video:: 65%|██████▍ | 81/125 [00:06<00:03, 12.73it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▋ | 83/125 [00:06<00:03, 12.78it/s] [Step 3] Stabilize the expression In Video:: 68%|██████▊ | 85/125 [00:06<00:03, 12.84it/s] [Step 3] Stabilize the expression In Video:: 70%|██████▉ | 87/125 [00:07<00:02, 12.88it/s] [Step 3] Stabilize the expression In Video:: 71%|███████ | 89/125 [00:07<00:02, 12.91it/s] [Step 3] Stabilize the expression In Video:: 73%|███████▎ | 91/125 [00:07<00:02, 12.90it/s] [Step 3] Stabilize the expression In Video:: 74%|███████▍ | 93/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 76%|███████▌ | 95/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 78%|███████▊ | 97/125 [00:07<00:02, 12.94it/s] [Step 3] Stabilize the expression In Video:: 79%|███████▉ | 99/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 81%|████████ | 101/125 [00:08<00:01, 12.93it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 103/125 [00:08<00:01, 12.94it/s] [Step 3] Stabilize the expression In Video:: 84%|████████▍ | 105/125 [00:08<00:01, 12.94it/s] [Step 3] Stabilize the expression In Video:: 86%|████████▌ | 107/125 [00:08<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 87%|████████▋ | 109/125 [00:08<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 89%|████████▉ | 111/125 [00:08<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 90%|█████████ | 113/125 [00:09<00:00, 12.90it/s] [Step 3] Stabilize the expression In Video:: 92%|█████████▏| 115/125 [00:09<00:00, 12.87it/s] [Step 3] Stabilize the expression In Video:: 94%|█████████▎| 117/125 [00:09<00:00, 12.87it/s] [Step 3] Stabilize the expression In Video:: 95%|█████████▌| 119/125 [00:09<00:00, 12.90it/s] [Step 3] Stabilize the expression In Video:: 97%|█████████▋| 121/125 [00:09<00:00, 12.91it/s] [Step 3] Stabilize the expression In Video:: 98%|█████████▊| 123/125 [00:09<00:00, 12.90it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.91it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.54it/s] [Step 4] Load audio; Length of mel chunks: 122 [Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/122 [00:01<02:14, 1.11s/it] [Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:01<01:05, 1.84it/s] [Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:01<00:42, 2.79it/s] [Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:01<00:32, 3.67it/s] [Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:01<00:26, 4.44it/s] [Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:01<00:22, 5.09it/s] [Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:01<00:20, 5.56it/s] [Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:02<00:19, 5.98it/s] [Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:02<00:17, 6.29it/s] [Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:02<00:17, 6.54it/s] [Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:02<00:16, 6.70it/s] [Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:02<00:16, 6.83it/s] [Step 5] Reference Enhancement: 11%|█ | 13/122 [00:02<00:15, 6.92it/s] [Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:02<00:15, 7.02it/s] [Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:03<00:15, 7.07it/s] [Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:03<00:14, 7.07it/s] [Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:03<00:14, 7.09it/s] [Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:03<00:14, 7.05it/s] [Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:03<00:14, 7.03it/s] [Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:03<00:14, 7.05it/s] [Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:03<00:14, 7.09it/s] [Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:04<00:14, 7.12it/s] [Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:04<00:13, 7.08it/s] [Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:04<00:13, 7.05it/s] [Step 5] Reference Enhancement: 20%|██ | 25/122 [00:04<00:13, 7.07it/s] [Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:04<00:13, 7.06it/s] [Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:04<00:13, 7.07it/s] [Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:04<00:13, 7.05it/s] [Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:05<00:13, 7.10it/s] [Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:05<00:12, 7.09it/s] [Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:05<00:12, 7.10it/s] [Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:05<00:12, 7.04it/s] [Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:05<00:12, 7.05it/s] [Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:05<00:12, 7.09it/s] [Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:05<00:12, 7.06it/s] [Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:06<00:12, 7.10it/s] [Step 5] Reference Enhancement: 30%|███ | 37/122 [00:06<00:12, 7.05it/s] [Step 5] Reference Enhancement: 31%|███ | 38/122 [00:06<00:11, 7.12it/s] [Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:06<00:11, 7.08it/s] [Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:06<00:11, 7.04it/s] [Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:06<00:11, 7.12it/s] [Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:06<00:11, 7.12it/s] [Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:07<00:11, 7.14it/s] [Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:07<00:10, 7.16it/s] [Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:07<00:10, 7.14it/s] [Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:07<00:10, 7.13it/s] [Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:07<00:10, 7.10it/s] [Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:07<00:10, 7.10it/s] [Step 5] Reference Enhancement: 40%|████ | 49/122 [00:07<00:10, 7.00it/s] [Step 5] Reference Enhancement: 41%|████ | 50/122 [00:08<00:10, 7.02it/s] [Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:08<00:10, 7.09it/s] [Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:08<00:09, 7.12it/s] [Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:08<00:09, 7.09it/s] [Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:08<00:09, 7.06it/s] [Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:08<00:09, 7.08it/s] [Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:08<00:09, 7.08it/s] [Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:09<00:09, 7.10it/s] [Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:09<00:09, 7.10it/s] [Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:09<00:08, 7.06it/s] [Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:09<00:08, 7.05it/s] [Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:09<00:08, 7.03it/s] [Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:09<00:08, 7.07it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:09<00:08, 7.09it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:10<00:08, 7.11it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:10<00:08, 7.10it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:10<00:07, 7.05it/s] [Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:10<00:07, 7.06it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:10<00:07, 7.05it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:10<00:07, 7.06it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:10<00:07, 6.97it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:11<00:07, 6.98it/s] [Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:11<00:07, 7.01it/s] [Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:11<00:06, 7.01it/s] [Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:11<00:06, 7.01it/s] [Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:11<00:06, 7.01it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:11<00:06, 7.03it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:11<00:06, 7.02it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.04it/s] [Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:12<00:06, 7.00it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:12<00:05, 7.04it/s] [Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:12<00:05, 7.00it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:12<00:05, 6.98it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:12<00:05, 7.01it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:12<00:05, 7.02it/s] [Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:12<00:05, 7.01it/s] [Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:13<00:05, 7.04it/s] [Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:13<00:04, 7.05it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:13<00:04, 7.07it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:13<00:04, 7.11it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:13<00:04, 7.10it/s] [Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:13<00:04, 7.06it/s] [Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:13<00:04, 7.03it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:14<00:04, 7.03it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:14<00:04, 6.99it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:14<00:03, 7.01it/s] [Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:14<00:03, 7.03it/s] [Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:14<00:03, 7.05it/s] [Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:14<00:03, 7.02it/s] [Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:14<00:03, 7.05it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:15<00:03, 7.04it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:15<00:02, 7.01it/s] [Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:15<00:02, 7.02it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:15<00:02, 7.05it/s] [Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:15<00:02, 7.01it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:15<00:02, 7.02it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:15<00:02, 6.97it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:16<00:02, 6.97it/s] [Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:16<00:02, 6.99it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:16<00:01, 7.00it/s] [Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:16<00:01, 6.97it/s] [Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:16<00:01, 7.00it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:16<00:01, 7.00it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:16<00:01, 7.00it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:17<00:01, 6.96it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:17<00:01, 6.94it/s] [Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:17<00:00, 6.99it/s] [Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:17<00:00, 7.01it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:17<00:00, 7.03it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:17<00:00, 7.05it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:17<00:00, 7.04it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:18<00:00, 7.06it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:18<00:00, 7.04it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:18<00:00, 6.68it/s] [Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s] landmark Det:: 0%| | 0/122 [00:00<?, ?it/s] landmark Det:: 1%| | 1/122 [00:00<00:22, 5.45it/s] landmark Det:: 2%|▏ | 2/122 [00:00<00:40, 2.99it/s] landmark Det:: 7%|▋ | 8/122 [00:00<00:08, 14.09it/s] landmark Det:: 11%|█▏ | 14/122 [00:00<00:04, 23.70it/s] landmark Det:: 16%|█▋ | 20/122 [00:00<00:03, 31.61it/s] landmark Det:: 21%|██▏ | 26/122 [00:01<00:02, 37.89it/s] landmark Det:: 26%|██▌ | 32/122 [00:01<00:02, 42.45it/s] landmark Det:: 31%|███ | 38/122 [00:01<00:01, 44.87it/s] landmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 47.18it/s] landmark Det:: 41%|████ | 50/122 [00:01<00:01, 49.21it/s] landmark Det:: 46%|████▌ | 56/122 [00:01<00:01, 51.04it/s] landmark Det:: 51%|█████ | 62/122 [00:01<00:01, 52.43it/s] landmark Det:: 56%|█████▌ | 68/122 [00:01<00:01, 52.97it/s] landmark Det:: 61%|██████ | 74/122 [00:01<00:00, 53.58it/s] landmark Det:: 66%|██████▌ | 80/122 [00:02<00:00, 54.19it/s] landmark Det:: 70%|███████ | 86/122 [00:02<00:00, 54.44it/s] landmark Det:: 75%|███████▌ | 92/122 [00:02<00:00, 53.38it/s] landmark Det:: 80%|████████ | 98/122 [00:02<00:00, 53.31it/s] landmark Det:: 85%|████████▌ | 104/122 [00:02<00:00, 53.55it/s] landmark Det:: 90%|█████████ | 110/122 [00:02<00:00, 53.73it/s] landmark Det:: 95%|█████████▌| 116/122 [00:02<00:00, 54.48it/s] landmark Det:: 100%|██████████| 122/122 [00:02<00:00, 54.89it/s] landmark Det:: 100%|██████████| 122/122 [00:02<00:00, 43.08it/s] 0%| | 0/122 [00:00<?, ?it/s] 100%|██████████| 122/122 [00:00<00:00, 20623.29it/s] 0%| | 0/122 [00:00<?, ?it/s] 54%|█████▍ | 66/122 [00:00<00:00, 656.23it/s] 100%|██████████| 122/122 [00:00<00:00, 671.87it/s] FaceDet:: 0%| | 0/31 [00:00<?, ?it/s] FaceDet:: 3%|▎ | 1/31 [00:00<00:22, 1.34it/s] FaceDet:: 6%|▋ | 2/31 [00:00<00:12, 2.38it/s] FaceDet:: 10%|▉ | 3/31 [00:01<00:08, 3.26it/s] FaceDet:: 13%|█▎ | 4/31 [00:01<00:07, 3.83it/s] FaceDet:: 16%|█▌ | 5/31 [00:01<00:06, 4.26it/s] FaceDet:: 19%|█▉ | 6/31 [00:01<00:05, 4.53it/s] FaceDet:: 23%|██▎ | 7/31 [00:01<00:05, 4.77it/s] FaceDet:: 26%|██▌ | 8/31 [00:02<00:04, 4.95it/s] FaceDet:: 29%|██▉ | 9/31 [00:02<00:04, 5.04it/s] FaceDet:: 32%|███▏ | 10/31 [00:02<00:03, 5.37it/s] FaceDet:: 35%|███▌ | 11/31 [00:02<00:03, 5.40it/s] FaceDet:: 39%|███▊ | 12/31 [00:02<00:03, 5.39it/s] FaceDet:: 42%|████▏ | 13/31 [00:02<00:03, 5.47it/s] FaceDet:: 45%|████▌ | 14/31 [00:03<00:03, 5.56it/s] FaceDet:: 48%|████▊ | 15/31 [00:03<00:02, 5.53it/s] FaceDet:: 52%|█████▏ | 16/31 [00:03<00:02, 5.49it/s] FaceDet:: 55%|█████▍ | 17/31 [00:03<00:02, 5.46it/s] FaceDet:: 58%|█████▊ | 18/31 [00:03<00:02, 5.43it/s] FaceDet:: 61%|██████▏ | 19/31 [00:04<00:02, 5.43it/s] FaceDet:: 65%|██████▍ | 20/31 [00:04<00:02, 5.35it/s] FaceDet:: 68%|██████▊ | 21/31 [00:04<00:01, 5.36it/s] FaceDet:: 71%|███████ | 22/31 [00:04<00:01, 5.27it/s] FaceDet:: 74%|███████▍ | 23/31 [00:04<00:01, 5.24it/s] FaceDet:: 77%|███████▋ | 24/31 [00:04<00:01, 5.32it/s] FaceDet:: 81%|████████ | 25/31 [00:05<00:01, 5.33it/s] FaceDet:: 84%|████████▍ | 26/31 [00:05<00:00, 5.36it/s] FaceDet:: 87%|████████▋ | 27/31 [00:05<00:00, 5.36it/s] FaceDet:: 90%|█████████ | 28/31 [00:05<00:00, 5.36it/s] FaceDet:: 94%|█████████▎| 29/31 [00:05<00:00, 5.39it/s] FaceDet:: 97%|█████████▋| 30/31 [00:06<00:00, 5.48it/s] FaceDet:: 100%|██████████| 31/31 [00:06<00:00, 3.83it/s] FaceDet:: 100%|██████████| 31/31 [00:06<00:00, 4.74it/s] [Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:23<02:43, 23.33s/it] [Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:28<01:16, 12.74s/it] [Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:33<00:46, 9.35s/it] [Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:39<00:31, 7.77s/it] [Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:44<00:20, 6.89s/it] [Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:49<00:12, 6.36s/it] [Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [00:55<00:06, 6.05s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:01<00:00, 6.03s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:01<00:00, 7.67s/it]Prediction
chenxwh/video-retalking:db5a650cID3um4e5lb4y235x45udoewzojeqStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", "input_audio": "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", input_audio: "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", "input_audio": "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", "input_audio": "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-01-15T22:30:38.435957Z", "created_at": "2024-01-15T22:25:38.388744Z", "data_removed": false, "error": null, "id": "3um4e5lb4y235x45udoewzojeq", "input": { "face": "https://replicate.delivery/pbxt/Jnm95KgYvAQIHlR0tg8rbWHweReTtCYp42Drl7dMNtHXaTNR/3.mp4", "input_audio": "https://replicate.delivery/pbxt/JnkUjVcUPLreS4x7ZXXQuCY7qVcLLDNxOeRAsHRi7qj79xBk/1.wav" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/125 [00:00<?, ?it/s]\nlandmark Det:: 1%| | 1/125 [00:08<18:28, 8.94s/it]\nlandmark Det:: 2%|▏ | 2/125 [00:15<15:26, 7.53s/it]\nlandmark Det:: 6%|▋ | 8/125 [00:15<02:27, 1.26s/it]\nlandmark Det:: 12%|█▏ | 15/125 [00:15<00:59, 1.86it/s]\nlandmark Det:: 17%|█▋ | 21/125 [00:15<00:33, 3.12it/s]\nlandmark Det:: 22%|██▏ | 28/125 [00:15<00:18, 5.11it/s]\nlandmark Det:: 27%|██▋ | 34/125 [00:16<00:12, 7.35it/s]\nlandmark Det:: 33%|███▎ | 41/125 [00:16<00:07, 10.73it/s]\nlandmark Det:: 38%|███▊ | 48/125 [00:16<00:05, 14.89it/s]\nlandmark Det:: 44%|████▍ | 55/125 [00:16<00:03, 19.81it/s]\nlandmark Det:: 50%|████▉ | 62/125 [00:16<00:02, 25.31it/s]\nlandmark Det:: 55%|█████▌ | 69/125 [00:16<00:01, 31.07it/s]\nlandmark Det:: 61%|██████ | 76/125 [00:16<00:01, 36.46it/s]\nlandmark Det:: 66%|██████▋ | 83/125 [00:16<00:01, 41.74it/s]\nlandmark Det:: 72%|███████▏ | 90/125 [00:16<00:00, 46.45it/s]\nlandmark Det:: 78%|███████▊ | 97/125 [00:17<00:00, 48.75it/s]\nlandmark Det:: 83%|████████▎ | 104/125 [00:17<00:00, 51.96it/s]\nlandmark Det:: 89%|████████▉ | 111/125 [00:17<00:00, 54.06it/s]\nlandmark Det:: 94%|█████████▍| 118/125 [00:17<00:00, 56.36it/s]\nlandmark Det:: 100%|██████████| 125/125 [00:17<00:00, 58.12it/s]\nlandmark Det:: 100%|██████████| 125/125 [00:17<00:00, 7.14it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 1%| | 1/125 [00:00<00:21, 5.85it/s]\n[Step 2] 3DMM Extraction In Video:: 12%|█▏ | 15/125 [00:00<00:01, 64.85it/s]\n[Step 2] 3DMM Extraction In Video:: 23%|██▎ | 29/125 [00:00<00:01, 91.90it/s]\n[Step 2] 3DMM Extraction In Video:: 34%|███▎ | 42/125 [00:00<00:00, 103.19it/s]\n[Step 2] 3DMM Extraction In Video:: 45%|████▍ | 56/125 [00:00<00:00, 113.65it/s]\n[Step 2] 3DMM Extraction In Video:: 56%|█████▌ | 70/125 [00:00<00:00, 120.85it/s]\n[Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 84/125 [00:00<00:00, 124.52it/s]\n[Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 98/125 [00:00<00:00, 127.08it/s]\n[Step 2] 3DMM Extraction In Video:: 90%|████████▉ | 112/125 [00:01<00:00, 128.96it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:01<00:00, 112.50it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 1%| | 1/125 [00:00<00:40, 3.08it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 3/125 [00:00<00:17, 6.86it/s]\n[Step 3] Stabilize the expression In Video:: 4%|▍ | 5/125 [00:00<00:13, 9.01it/s]\n[Step 3] Stabilize the expression In Video:: 6%|▌ | 7/125 [00:00<00:11, 10.30it/s]\n[Step 3] Stabilize the expression In Video:: 7%|▋ | 9/125 [00:00<00:10, 11.15it/s]\n[Step 3] Stabilize the expression In Video:: 9%|▉ | 11/125 [00:01<00:09, 11.71it/s]\n[Step 3] Stabilize the expression In Video:: 10%|█ | 13/125 [00:01<00:09, 12.08it/s]\n[Step 3] Stabilize the expression In Video:: 12%|█▏ | 15/125 [00:01<00:08, 12.33it/s]\n[Step 3] Stabilize the expression In Video:: 14%|█▎ | 17/125 [00:01<00:08, 12.52it/s]\n[Step 3] Stabilize the expression In Video:: 15%|█▌ | 19/125 [00:01<00:08, 12.58it/s]\n[Step 3] Stabilize the expression In Video:: 17%|█▋ | 21/125 [00:01<00:08, 12.68it/s]\n[Step 3] Stabilize the expression In Video:: 18%|█▊ | 23/125 [00:02<00:07, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 20%|██ | 25/125 [00:02<00:07, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 22%|██▏ | 27/125 [00:02<00:07, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 23%|██▎ | 29/125 [00:02<00:07, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 25%|██▍ | 31/125 [00:02<00:07, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▋ | 33/125 [00:02<00:07, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 28%|██▊ | 35/125 [00:02<00:06, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 30%|██▉ | 37/125 [00:03<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 31%|███ | 39/125 [00:03<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 33%|███▎ | 41/125 [00:03<00:06, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 34%|███▍ | 43/125 [00:03<00:06, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 36%|███▌ | 45/125 [00:03<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 47/125 [00:03<00:06, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 39%|███▉ | 49/125 [00:04<00:05, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 41%|████ | 51/125 [00:04<00:05, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 42%|████▏ | 53/125 [00:04<00:05, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 44%|████▍ | 55/125 [00:04<00:05, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 46%|████▌ | 57/125 [00:04<00:05, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 47%|████▋ | 59/125 [00:04<00:05, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 49%|████▉ | 61/125 [00:04<00:04, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 50%|█████ | 63/125 [00:05<00:04, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 52%|█████▏ | 65/125 [00:05<00:04, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▎ | 67/125 [00:05<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 55%|█████▌ | 69/125 [00:05<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 57%|█████▋ | 71/125 [00:05<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 58%|█████▊ | 73/125 [00:05<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 60%|██████ | 75/125 [00:06<00:03, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 62%|██████▏ | 77/125 [00:06<00:03, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 63%|██████▎ | 79/125 [00:06<00:03, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 65%|██████▍ | 81/125 [00:06<00:03, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▋ | 83/125 [00:06<00:03, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 68%|██████▊ | 85/125 [00:06<00:03, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 70%|██████▉ | 87/125 [00:07<00:02, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 71%|███████ | 89/125 [00:07<00:02, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 73%|███████▎ | 91/125 [00:07<00:02, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 74%|███████▍ | 93/125 [00:07<00:02, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 76%|███████▌ | 95/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 78%|███████▊ | 97/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 79%|███████▉ | 99/125 [00:07<00:02, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 81%|████████ | 101/125 [00:08<00:01, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 103/125 [00:08<00:01, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 84%|████████▍ | 105/125 [00:08<00:01, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 86%|████████▌ | 107/125 [00:08<00:01, 12.59it/s]\n[Step 3] Stabilize the expression In Video:: 87%|████████▋ | 109/125 [00:08<00:01, 12.67it/s]\n[Step 3] Stabilize the expression In Video:: 89%|████████▉ | 111/125 [00:08<00:01, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 90%|█████████ | 113/125 [00:09<00:00, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 92%|█████████▏| 115/125 [00:09<00:00, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 94%|█████████▎| 117/125 [00:09<00:00, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 95%|█████████▌| 119/125 [00:09<00:00, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 97%|█████████▋| 121/125 [00:09<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 98%|█████████▊| 123/125 [00:09<00:00, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.54it/s]\n[Step 4] Load audio; Length of mel chunks: 122\n[Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/122 [00:01<02:14, 1.11s/it]\n[Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:01<01:04, 1.85it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:01<00:42, 2.80it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:01<00:32, 3.68it/s]\n[Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:01<00:26, 4.46it/s]\n[Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:01<00:22, 5.12it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:01<00:20, 5.64it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:02<00:18, 6.05it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:02<00:17, 6.34it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:02<00:17, 6.57it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:02<00:16, 6.74it/s]\n[Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:02<00:16, 6.86it/s]\n[Step 5] Reference Enhancement: 11%|█ | 13/122 [00:02<00:15, 6.93it/s]\n[Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:02<00:15, 7.06it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:03<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:03<00:14, 7.09it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:03<00:14, 7.12it/s]\n[Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:03<00:14, 7.15it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:03<00:14, 7.18it/s]\n[Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:03<00:14, 7.17it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:03<00:14, 7.20it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:04<00:13, 7.19it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:04<00:13, 7.19it/s]\n[Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:04<00:13, 7.18it/s]\n[Step 5] Reference Enhancement: 20%|██ | 25/122 [00:04<00:13, 7.18it/s]\n[Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:04<00:13, 7.19it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:04<00:13, 7.18it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:04<00:13, 7.16it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:05<00:12, 7.24it/s]\n[Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:05<00:12, 7.21it/s]\n[Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:05<00:12, 7.19it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:05<00:12, 7.19it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:05<00:12, 7.23it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:05<00:12, 7.27it/s]\n[Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:05<00:12, 7.23it/s]\n[Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:05<00:11, 7.19it/s]\n[Step 5] Reference Enhancement: 30%|███ | 37/122 [00:06<00:11, 7.16it/s]\n[Step 5] Reference Enhancement: 31%|███ | 38/122 [00:06<00:11, 7.15it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:06<00:11, 7.14it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:06<00:11, 7.12it/s]\n[Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:06<00:11, 7.15it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:06<00:11, 7.15it/s]\n[Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:06<00:11, 7.16it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:07<00:10, 7.20it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:07<00:10, 7.23it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:07<00:10, 7.19it/s]\n[Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:07<00:10, 7.18it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:07<00:10, 7.16it/s]\n[Step 5] Reference Enhancement: 40%|████ | 49/122 [00:07<00:10, 7.15it/s]\n[Step 5] Reference Enhancement: 41%|████ | 50/122 [00:07<00:10, 7.13it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:08<00:09, 7.16it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:08<00:09, 7.13it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:08<00:09, 7.14it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:08<00:09, 7.13it/s]\n[Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:08<00:09, 7.13it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:08<00:09, 7.17it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:08<00:09, 7.06it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:09<00:09, 7.07it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:09<00:08, 7.06it/s]\n[Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:09<00:08, 7.06it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:09<00:08, 7.10it/s]\n[Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:09<00:08, 7.09it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:09<00:08, 7.09it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:09<00:08, 7.09it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:10<00:08, 7.10it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:10<00:07, 7.07it/s]\n[Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:10<00:07, 7.09it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:10<00:07, 7.15it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:10<00:07, 7.14it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:10<00:07, 7.09it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:10<00:07, 7.13it/s]\n[Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:11<00:07, 7.13it/s]\n[Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:11<00:06, 7.15it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:11<00:06, 7.12it/s]\n[Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:11<00:06, 7.13it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:11<00:06, 7.12it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:11<00:06, 7.13it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.16it/s]\n[Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:12<00:06, 7.13it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:12<00:05, 7.15it/s]\n[Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:12<00:05, 7.15it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:12<00:05, 7.15it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:12<00:05, 7.16it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:12<00:05, 7.22it/s]\n[Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:12<00:05, 7.20it/s]\n[Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:12<00:05, 7.17it/s]\n[Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:13<00:04, 7.17it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:13<00:04, 7.19it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:13<00:04, 7.17it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:13<00:04, 7.15it/s]\n[Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:13<00:04, 7.15it/s]\n[Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:13<00:04, 7.12it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:13<00:04, 7.09it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:14<00:03, 7.05it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:14<00:03, 7.08it/s]\n[Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:14<00:03, 7.11it/s]\n[Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:14<00:03, 7.11it/s]\n[Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:14<00:03, 7.13it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:14<00:03, 7.19it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:14<00:03, 7.19it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:15<00:02, 7.18it/s]\n[Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:15<00:02, 7.14it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:15<00:02, 7.13it/s]\n[Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:15<00:02, 7.11it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:15<00:02, 7.10it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:15<00:02, 7.09it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:15<00:02, 7.09it/s]\n[Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:16<00:01, 7.11it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:16<00:01, 7.10it/s]\n[Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:16<00:01, 7.09it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:16<00:01, 7.12it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:16<00:01, 7.11it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:16<00:01, 7.15it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:16<00:01, 7.17it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:17<00:00, 7.18it/s]\n[Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:17<00:00, 7.16it/s]\n[Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:17<00:00, 7.12it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:17<00:00, 7.13it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:17<00:00, 7.13it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:17<00:00, 7.10it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:17<00:00, 7.16it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:18<00:00, 7.15it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:18<00:00, 6.76it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/122 [00:00<00:22, 5.50it/s]\u001b[A\nlandmark Det:: 2%|▏ | 2/122 [00:00<00:40, 2.98it/s]\u001b[A\nlandmark Det:: 7%|▋ | 8/122 [00:00<00:08, 14.05it/s]\u001b[A\nlandmark Det:: 11%|█▏ | 14/122 [00:00<00:04, 23.66it/s]\u001b[A\nlandmark Det:: 16%|█▋ | 20/122 [00:00<00:03, 31.60it/s]\u001b[A\nlandmark Det:: 21%|██▏ | 26/122 [00:01<00:02, 37.95it/s]\u001b[A\nlandmark Det:: 26%|██▌ | 32/122 [00:01<00:02, 42.56it/s]\u001b[A\nlandmark Det:: 31%|███ | 38/122 [00:01<00:01, 46.07it/s]\u001b[A\nlandmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 47.37it/s]\u001b[A\nlandmark Det:: 41%|████ | 50/122 [00:01<00:01, 49.40it/s]\u001b[A\nlandmark Det:: 46%|████▌ | 56/122 [00:01<00:01, 51.08it/s]\u001b[A\nlandmark Det:: 51%|█████ | 62/122 [00:01<00:01, 52.38it/s]\u001b[A\nlandmark Det:: 56%|█████▌ | 68/122 [00:01<00:01, 53.10it/s]\u001b[A\nlandmark Det:: 61%|██████ | 74/122 [00:01<00:00, 53.72it/s]\u001b[A\nlandmark Det:: 66%|██████▌ | 80/122 [00:02<00:00, 54.38it/s]\u001b[A\nlandmark Det:: 70%|███████ | 86/122 [00:02<00:00, 54.57it/s]\u001b[A\nlandmark Det:: 75%|███████▌ | 92/122 [00:02<00:00, 54.29it/s]\u001b[A\nlandmark Det:: 80%|████████ | 98/122 [00:02<00:00, 52.27it/s]\u001b[A\nlandmark Det:: 85%|████████▌ | 104/122 [00:02<00:00, 52.70it/s]\u001b[A\nlandmark Det:: 90%|█████████ | 110/122 [00:02<00:00, 52.58it/s]\u001b[A\nlandmark Det:: 95%|█████████▌| 116/122 [00:02<00:00, 53.40it/s]\u001b[A\nlandmark Det:: 100%|██████████| 122/122 [00:02<00:00, 54.03it/s]\u001b[A\nlandmark Det:: 100%|██████████| 122/122 [00:02<00:00, 42.97it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 20395.60it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n 52%|█████▏ | 63/122 [00:00<00:00, 623.37it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 649.42it/s]\nFaceDet:: 0%| | 0/31 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 3%|▎ | 1/31 [00:00<00:22, 1.32it/s]\u001b[A\nFaceDet:: 6%|▋ | 2/31 [00:00<00:11, 2.42it/s]\u001b[A\nFaceDet:: 10%|▉ | 3/31 [00:01<00:08, 3.27it/s]\u001b[A\nFaceDet:: 13%|█▎ | 4/31 [00:01<00:07, 3.85it/s]\u001b[A\nFaceDet:: 16%|█▌ | 5/31 [00:01<00:06, 4.28it/s]\u001b[A\nFaceDet:: 19%|█▉ | 6/31 [00:01<00:05, 4.49it/s]\u001b[A\nFaceDet:: 23%|██▎ | 7/31 [00:01<00:04, 4.94it/s]\u001b[A\nFaceDet:: 26%|██▌ | 8/31 [00:02<00:04, 5.07it/s]\u001b[A\nFaceDet:: 29%|██▉ | 9/31 [00:02<00:04, 5.21it/s]\u001b[A\nFaceDet:: 32%|███▏ | 10/31 [00:02<00:03, 5.37it/s]\u001b[A\nFaceDet:: 35%|███▌ | 11/31 [00:02<00:03, 5.48it/s]\u001b[A\nFaceDet:: 39%|███▊ | 12/31 [00:02<00:03, 5.49it/s]\u001b[A\nFaceDet:: 42%|████▏ | 13/31 [00:02<00:03, 5.50it/s]\u001b[A\nFaceDet:: 45%|████▌ | 14/31 [00:03<00:03, 5.51it/s]\u001b[A\nFaceDet:: 48%|████▊ | 15/31 [00:03<00:02, 5.72it/s]\u001b[A\nFaceDet:: 52%|█████▏ | 16/31 [00:03<00:02, 5.66it/s]\u001b[A\nFaceDet:: 55%|█████▍ | 17/31 [00:03<00:02, 5.63it/s]\u001b[A\nFaceDet:: 58%|█████▊ | 18/31 [00:03<00:02, 5.60it/s]\u001b[A\nFaceDet:: 61%|██████▏ | 19/31 [00:03<00:02, 5.62it/s]\u001b[A\nFaceDet:: 65%|██████▍ | 20/31 [00:04<00:01, 5.75it/s]\u001b[A\nFaceDet:: 68%|██████▊ | 21/31 [00:04<00:01, 5.62it/s]\u001b[A\nFaceDet:: 71%|███████ | 22/31 [00:04<00:01, 5.54it/s]\u001b[A\nFaceDet:: 74%|███████▍ | 23/31 [00:04<00:01, 5.33it/s]\u001b[A\nFaceDet:: 77%|███████▋ | 24/31 [00:04<00:01, 5.47it/s]\u001b[A\nFaceDet:: 81%|████████ | 25/31 [00:05<00:01, 5.43it/s]\u001b[A\nFaceDet:: 84%|████████▍ | 26/31 [00:05<00:00, 5.42it/s]\u001b[A\nFaceDet:: 87%|████████▋ | 27/31 [00:05<00:00, 5.40it/s]\u001b[A\nFaceDet:: 90%|█████████ | 28/31 [00:05<00:00, 5.32it/s]\u001b[A\nFaceDet:: 94%|█████████▎| 29/31 [00:05<00:00, 5.60it/s]\u001b[A\nFaceDet:: 97%|█████████▋| 30/31 [00:05<00:00, 5.69it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:06<00:00, 3.91it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:06<00:00, 4.83it/s]\n[Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:23<02:42, 23.27s/it]\n[Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:28<01:16, 12.81s/it]\n[Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:34<00:47, 9.45s/it]\n[Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:39<00:31, 7.96s/it]\n[Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:45<00:21, 7.04s/it]\n[Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:50<00:13, 6.56s/it]\n[Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [00:56<00:06, 6.21s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:02<00:00, 6.13s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:02<00:00, 7.80s/it]\nOutput video generated successfully!", "metrics": { "predict_time": 114.705449, "total_time": 300.047213 }, "output": "https://replicate.delivery/pbxt/DAFtgzTrBpotP9auf1b8zuoTCIA3szPOuhh4m48ecC7NQ2MSA/output.mp4", "started_at": "2024-01-15T22:28:43.730508Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/3um4e5lb4y235x45udoewzojeq", "cancel": "https://api.replicate.com/v1/predictions/3um4e5lb4y235x45udoewzojeq/cancel" }, "version": "0baa7c69a778533521a24486e560a3d4cbb259fb18667b4452d0d7c107f078c8" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/125 [00:00<?, ?it/s] landmark Det:: 1%| | 1/125 [00:08<18:28, 8.94s/it] landmark Det:: 2%|▏ | 2/125 [00:15<15:26, 7.53s/it] landmark Det:: 6%|▋ | 8/125 [00:15<02:27, 1.26s/it] landmark Det:: 12%|█▏ | 15/125 [00:15<00:59, 1.86it/s] landmark Det:: 17%|█▋ | 21/125 [00:15<00:33, 3.12it/s] landmark Det:: 22%|██▏ | 28/125 [00:15<00:18, 5.11it/s] landmark Det:: 27%|██▋ | 34/125 [00:16<00:12, 7.35it/s] landmark Det:: 33%|███▎ | 41/125 [00:16<00:07, 10.73it/s] landmark Det:: 38%|███▊ | 48/125 [00:16<00:05, 14.89it/s] landmark Det:: 44%|████▍ | 55/125 [00:16<00:03, 19.81it/s] landmark Det:: 50%|████▉ | 62/125 [00:16<00:02, 25.31it/s] landmark Det:: 55%|█████▌ | 69/125 [00:16<00:01, 31.07it/s] landmark Det:: 61%|██████ | 76/125 [00:16<00:01, 36.46it/s] landmark Det:: 66%|██████▋ | 83/125 [00:16<00:01, 41.74it/s] landmark Det:: 72%|███████▏ | 90/125 [00:16<00:00, 46.45it/s] landmark Det:: 78%|███████▊ | 97/125 [00:17<00:00, 48.75it/s] landmark Det:: 83%|████████▎ | 104/125 [00:17<00:00, 51.96it/s] landmark Det:: 89%|████████▉ | 111/125 [00:17<00:00, 54.06it/s] landmark Det:: 94%|█████████▍| 118/125 [00:17<00:00, 56.36it/s] landmark Det:: 100%|██████████| 125/125 [00:17<00:00, 58.12it/s] landmark Det:: 100%|██████████| 125/125 [00:17<00:00, 7.14it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 1%| | 1/125 [00:00<00:21, 5.85it/s] [Step 2] 3DMM Extraction In Video:: 12%|█▏ | 15/125 [00:00<00:01, 64.85it/s] [Step 2] 3DMM Extraction In Video:: 23%|██▎ | 29/125 [00:00<00:01, 91.90it/s] [Step 2] 3DMM Extraction In Video:: 34%|███▎ | 42/125 [00:00<00:00, 103.19it/s] [Step 2] 3DMM Extraction In Video:: 45%|████▍ | 56/125 [00:00<00:00, 113.65it/s] [Step 2] 3DMM Extraction In Video:: 56%|█████▌ | 70/125 [00:00<00:00, 120.85it/s] [Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 84/125 [00:00<00:00, 124.52it/s] [Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 98/125 [00:00<00:00, 127.08it/s] [Step 2] 3DMM Extraction In Video:: 90%|████████▉ | 112/125 [00:01<00:00, 128.96it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:01<00:00, 112.50it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 1%| | 1/125 [00:00<00:40, 3.08it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 3/125 [00:00<00:17, 6.86it/s] [Step 3] Stabilize the expression In Video:: 4%|▍ | 5/125 [00:00<00:13, 9.01it/s] [Step 3] Stabilize the expression In Video:: 6%|▌ | 7/125 [00:00<00:11, 10.30it/s] [Step 3] Stabilize the expression In Video:: 7%|▋ | 9/125 [00:00<00:10, 11.15it/s] [Step 3] Stabilize the expression In Video:: 9%|▉ | 11/125 [00:01<00:09, 11.71it/s] [Step 3] Stabilize the expression In Video:: 10%|█ | 13/125 [00:01<00:09, 12.08it/s] [Step 3] Stabilize the expression In Video:: 12%|█▏ | 15/125 [00:01<00:08, 12.33it/s] [Step 3] Stabilize the expression In Video:: 14%|█▎ | 17/125 [00:01<00:08, 12.52it/s] [Step 3] Stabilize the expression In Video:: 15%|█▌ | 19/125 [00:01<00:08, 12.58it/s] [Step 3] Stabilize the expression In Video:: 17%|█▋ | 21/125 [00:01<00:08, 12.68it/s] [Step 3] Stabilize the expression In Video:: 18%|█▊ | 23/125 [00:02<00:07, 12.76it/s] [Step 3] Stabilize the expression In Video:: 20%|██ | 25/125 [00:02<00:07, 12.82it/s] [Step 3] Stabilize the expression In Video:: 22%|██▏ | 27/125 [00:02<00:07, 12.82it/s] [Step 3] Stabilize the expression In Video:: 23%|██▎ | 29/125 [00:02<00:07, 12.84it/s] [Step 3] Stabilize the expression In Video:: 25%|██▍ | 31/125 [00:02<00:07, 12.87it/s] [Step 3] Stabilize the expression In Video:: 26%|██▋ | 33/125 [00:02<00:07, 12.90it/s] [Step 3] Stabilize the expression In Video:: 28%|██▊ | 35/125 [00:02<00:06, 12.88it/s] [Step 3] Stabilize the expression In Video:: 30%|██▉ | 37/125 [00:03<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 31%|███ | 39/125 [00:03<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 33%|███▎ | 41/125 [00:03<00:06, 12.92it/s] [Step 3] Stabilize the expression In Video:: 34%|███▍ | 43/125 [00:03<00:06, 12.89it/s] [Step 3] Stabilize the expression In Video:: 36%|███▌ | 45/125 [00:03<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 47/125 [00:03<00:06, 12.91it/s] [Step 3] Stabilize the expression In Video:: 39%|███▉ | 49/125 [00:04<00:05, 12.92it/s] [Step 3] Stabilize the expression In Video:: 41%|████ | 51/125 [00:04<00:05, 12.89it/s] [Step 3] Stabilize the expression In Video:: 42%|████▏ | 53/125 [00:04<00:05, 12.91it/s] [Step 3] Stabilize the expression In Video:: 44%|████▍ | 55/125 [00:04<00:05, 12.91it/s] [Step 3] Stabilize the expression In Video:: 46%|████▌ | 57/125 [00:04<00:05, 12.91it/s] [Step 3] Stabilize the expression In Video:: 47%|████▋ | 59/125 [00:04<00:05, 12.88it/s] [Step 3] Stabilize the expression In Video:: 49%|████▉ | 61/125 [00:04<00:04, 12.89it/s] [Step 3] Stabilize the expression In Video:: 50%|█████ | 63/125 [00:05<00:04, 12.91it/s] [Step 3] Stabilize the expression In Video:: 52%|█████▏ | 65/125 [00:05<00:04, 12.93it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▎ | 67/125 [00:05<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 55%|█████▌ | 69/125 [00:05<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 57%|█████▋ | 71/125 [00:05<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 58%|█████▊ | 73/125 [00:05<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 60%|██████ | 75/125 [00:06<00:03, 12.86it/s] [Step 3] Stabilize the expression In Video:: 62%|██████▏ | 77/125 [00:06<00:03, 12.83it/s] [Step 3] Stabilize the expression In Video:: 63%|██████▎ | 79/125 [00:06<00:03, 12.86it/s] [Step 3] Stabilize the expression In Video:: 65%|██████▍ | 81/125 [00:06<00:03, 12.87it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▋ | 83/125 [00:06<00:03, 12.85it/s] [Step 3] Stabilize the expression In Video:: 68%|██████▊ | 85/125 [00:06<00:03, 12.87it/s] [Step 3] Stabilize the expression In Video:: 70%|██████▉ | 87/125 [00:07<00:02, 12.86it/s] [Step 3] Stabilize the expression In Video:: 71%|███████ | 89/125 [00:07<00:02, 12.90it/s] [Step 3] Stabilize the expression In Video:: 73%|███████▎ | 91/125 [00:07<00:02, 12.90it/s] [Step 3] Stabilize the expression In Video:: 74%|███████▍ | 93/125 [00:07<00:02, 12.90it/s] [Step 3] Stabilize the expression In Video:: 76%|███████▌ | 95/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 78%|███████▊ | 97/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 79%|███████▉ | 99/125 [00:07<00:02, 12.91it/s] [Step 3] Stabilize the expression In Video:: 81%|████████ | 101/125 [00:08<00:01, 12.91it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 103/125 [00:08<00:01, 12.93it/s] [Step 3] Stabilize the expression In Video:: 84%|████████▍ | 105/125 [00:08<00:01, 12.83it/s] [Step 3] Stabilize the expression In Video:: 86%|████████▌ | 107/125 [00:08<00:01, 12.59it/s] [Step 3] Stabilize the expression In Video:: 87%|████████▋ | 109/125 [00:08<00:01, 12.67it/s] [Step 3] Stabilize the expression In Video:: 89%|████████▉ | 111/125 [00:08<00:01, 12.76it/s] [Step 3] Stabilize the expression In Video:: 90%|█████████ | 113/125 [00:09<00:00, 12.79it/s] [Step 3] Stabilize the expression In Video:: 92%|█████████▏| 115/125 [00:09<00:00, 12.82it/s] [Step 3] Stabilize the expression In Video:: 94%|█████████▎| 117/125 [00:09<00:00, 12.86it/s] [Step 3] Stabilize the expression In Video:: 95%|█████████▌| 119/125 [00:09<00:00, 12.86it/s] [Step 3] Stabilize the expression In Video:: 97%|█████████▋| 121/125 [00:09<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 98%|█████████▊| 123/125 [00:09<00:00, 12.84it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.54it/s] [Step 4] Load audio; Length of mel chunks: 122 [Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/122 [00:01<02:14, 1.11s/it] [Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:01<01:04, 1.85it/s] [Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:01<00:42, 2.80it/s] [Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:01<00:32, 3.68it/s] [Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:01<00:26, 4.46it/s] [Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:01<00:22, 5.12it/s] [Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:01<00:20, 5.64it/s] [Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:02<00:18, 6.05it/s] [Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:02<00:17, 6.34it/s] [Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:02<00:17, 6.57it/s] [Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:02<00:16, 6.74it/s] [Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:02<00:16, 6.86it/s] [Step 5] Reference Enhancement: 11%|█ | 13/122 [00:02<00:15, 6.93it/s] [Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:02<00:15, 7.06it/s] [Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:03<00:15, 7.09it/s] [Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:03<00:14, 7.09it/s] [Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:03<00:14, 7.12it/s] [Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:03<00:14, 7.15it/s] [Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:03<00:14, 7.18it/s] [Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:03<00:14, 7.17it/s] [Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:03<00:14, 7.20it/s] [Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:04<00:13, 7.19it/s] [Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:04<00:13, 7.19it/s] [Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:04<00:13, 7.18it/s] [Step 5] Reference Enhancement: 20%|██ | 25/122 [00:04<00:13, 7.18it/s] [Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:04<00:13, 7.19it/s] [Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:04<00:13, 7.18it/s] [Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:04<00:13, 7.16it/s] [Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:05<00:12, 7.24it/s] [Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:05<00:12, 7.21it/s] [Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:05<00:12, 7.19it/s] [Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:05<00:12, 7.19it/s] [Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:05<00:12, 7.23it/s] [Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:05<00:12, 7.27it/s] [Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:05<00:12, 7.23it/s] [Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:05<00:11, 7.19it/s] [Step 5] Reference Enhancement: 30%|███ | 37/122 [00:06<00:11, 7.16it/s] [Step 5] Reference Enhancement: 31%|███ | 38/122 [00:06<00:11, 7.15it/s] [Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:06<00:11, 7.14it/s] [Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:06<00:11, 7.12it/s] [Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:06<00:11, 7.15it/s] [Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:06<00:11, 7.15it/s] [Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:06<00:11, 7.16it/s] [Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:07<00:10, 7.20it/s] [Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:07<00:10, 7.23it/s] [Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:07<00:10, 7.19it/s] [Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:07<00:10, 7.18it/s] [Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:07<00:10, 7.16it/s] [Step 5] Reference Enhancement: 40%|████ | 49/122 [00:07<00:10, 7.15it/s] [Step 5] Reference Enhancement: 41%|████ | 50/122 [00:07<00:10, 7.13it/s] [Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:08<00:09, 7.16it/s] [Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:08<00:09, 7.13it/s] [Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:08<00:09, 7.14it/s] [Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:08<00:09, 7.13it/s] [Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:08<00:09, 7.13it/s] [Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:08<00:09, 7.17it/s] [Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:08<00:09, 7.06it/s] [Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:09<00:09, 7.07it/s] [Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:09<00:08, 7.06it/s] [Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:09<00:08, 7.06it/s] [Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:09<00:08, 7.10it/s] [Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:09<00:08, 7.09it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:09<00:08, 7.09it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:09<00:08, 7.09it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:10<00:08, 7.10it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:10<00:07, 7.07it/s] [Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:10<00:07, 7.09it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:10<00:07, 7.15it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:10<00:07, 7.14it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:10<00:07, 7.09it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:10<00:07, 7.13it/s] [Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:11<00:07, 7.13it/s] [Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:11<00:06, 7.15it/s] [Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:11<00:06, 7.12it/s] [Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:11<00:06, 7.13it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:11<00:06, 7.12it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:11<00:06, 7.13it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.16it/s] [Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:12<00:06, 7.13it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:12<00:05, 7.15it/s] [Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:12<00:05, 7.15it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:12<00:05, 7.15it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:12<00:05, 7.16it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:12<00:05, 7.22it/s] [Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:12<00:05, 7.20it/s] [Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:12<00:05, 7.17it/s] [Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:13<00:04, 7.17it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:13<00:04, 7.19it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:13<00:04, 7.17it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:13<00:04, 7.15it/s] [Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:13<00:04, 7.15it/s] [Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:13<00:04, 7.12it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:13<00:04, 7.09it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:14<00:03, 7.05it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:14<00:03, 7.08it/s] [Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:14<00:03, 7.11it/s] [Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:14<00:03, 7.11it/s] [Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:14<00:03, 7.13it/s] [Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:14<00:03, 7.19it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:14<00:03, 7.19it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:15<00:02, 7.18it/s] [Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:15<00:02, 7.14it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:15<00:02, 7.13it/s] [Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:15<00:02, 7.11it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:15<00:02, 7.10it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:15<00:02, 7.09it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:15<00:02, 7.09it/s] [Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:16<00:01, 7.11it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:16<00:01, 7.10it/s] [Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:16<00:01, 7.09it/s] [Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:16<00:01, 7.12it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:16<00:01, 7.11it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:16<00:01, 7.15it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:16<00:01, 7.17it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:17<00:00, 7.18it/s] [Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:17<00:00, 7.16it/s] [Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:17<00:00, 7.12it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:17<00:00, 7.13it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:17<00:00, 7.13it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:17<00:00, 7.10it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:17<00:00, 7.16it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:18<00:00, 7.15it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:18<00:00, 6.76it/s] [Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s] landmark Det:: 0%| | 0/122 [00:00<?, ?it/s] landmark Det:: 1%| | 1/122 [00:00<00:22, 5.50it/s] landmark Det:: 2%|▏ | 2/122 [00:00<00:40, 2.98it/s] landmark Det:: 7%|▋ | 8/122 [00:00<00:08, 14.05it/s] landmark Det:: 11%|█▏ | 14/122 [00:00<00:04, 23.66it/s] landmark Det:: 16%|█▋ | 20/122 [00:00<00:03, 31.60it/s] landmark Det:: 21%|██▏ | 26/122 [00:01<00:02, 37.95it/s] landmark Det:: 26%|██▌ | 32/122 [00:01<00:02, 42.56it/s] landmark Det:: 31%|███ | 38/122 [00:01<00:01, 46.07it/s] landmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 47.37it/s] landmark Det:: 41%|████ | 50/122 [00:01<00:01, 49.40it/s] landmark Det:: 46%|████▌ | 56/122 [00:01<00:01, 51.08it/s] landmark Det:: 51%|█████ | 62/122 [00:01<00:01, 52.38it/s] landmark Det:: 56%|█████▌ | 68/122 [00:01<00:01, 53.10it/s] landmark Det:: 61%|██████ | 74/122 [00:01<00:00, 53.72it/s] landmark Det:: 66%|██████▌ | 80/122 [00:02<00:00, 54.38it/s] landmark Det:: 70%|███████ | 86/122 [00:02<00:00, 54.57it/s] landmark Det:: 75%|███████▌ | 92/122 [00:02<00:00, 54.29it/s] landmark Det:: 80%|████████ | 98/122 [00:02<00:00, 52.27it/s] landmark Det:: 85%|████████▌ | 104/122 [00:02<00:00, 52.70it/s] landmark Det:: 90%|█████████ | 110/122 [00:02<00:00, 52.58it/s] landmark Det:: 95%|█████████▌| 116/122 [00:02<00:00, 53.40it/s] landmark Det:: 100%|██████████| 122/122 [00:02<00:00, 54.03it/s] landmark Det:: 100%|██████████| 122/122 [00:02<00:00, 42.97it/s] 0%| | 0/122 [00:00<?, ?it/s] 100%|██████████| 122/122 [00:00<00:00, 20395.60it/s] 0%| | 0/122 [00:00<?, ?it/s] 52%|█████▏ | 63/122 [00:00<00:00, 623.37it/s] 100%|██████████| 122/122 [00:00<00:00, 649.42it/s] FaceDet:: 0%| | 0/31 [00:00<?, ?it/s] FaceDet:: 3%|▎ | 1/31 [00:00<00:22, 1.32it/s] FaceDet:: 6%|▋ | 2/31 [00:00<00:11, 2.42it/s] FaceDet:: 10%|▉ | 3/31 [00:01<00:08, 3.27it/s] FaceDet:: 13%|█▎ | 4/31 [00:01<00:07, 3.85it/s] FaceDet:: 16%|█▌ | 5/31 [00:01<00:06, 4.28it/s] FaceDet:: 19%|█▉ | 6/31 [00:01<00:05, 4.49it/s] FaceDet:: 23%|██▎ | 7/31 [00:01<00:04, 4.94it/s] FaceDet:: 26%|██▌ | 8/31 [00:02<00:04, 5.07it/s] FaceDet:: 29%|██▉ | 9/31 [00:02<00:04, 5.21it/s] FaceDet:: 32%|███▏ | 10/31 [00:02<00:03, 5.37it/s] FaceDet:: 35%|███▌ | 11/31 [00:02<00:03, 5.48it/s] FaceDet:: 39%|███▊ | 12/31 [00:02<00:03, 5.49it/s] FaceDet:: 42%|████▏ | 13/31 [00:02<00:03, 5.50it/s] FaceDet:: 45%|████▌ | 14/31 [00:03<00:03, 5.51it/s] FaceDet:: 48%|████▊ | 15/31 [00:03<00:02, 5.72it/s] FaceDet:: 52%|█████▏ | 16/31 [00:03<00:02, 5.66it/s] FaceDet:: 55%|█████▍ | 17/31 [00:03<00:02, 5.63it/s] FaceDet:: 58%|█████▊ | 18/31 [00:03<00:02, 5.60it/s] FaceDet:: 61%|██████▏ | 19/31 [00:03<00:02, 5.62it/s] FaceDet:: 65%|██████▍ | 20/31 [00:04<00:01, 5.75it/s] FaceDet:: 68%|██████▊ | 21/31 [00:04<00:01, 5.62it/s] FaceDet:: 71%|███████ | 22/31 [00:04<00:01, 5.54it/s] FaceDet:: 74%|███████▍ | 23/31 [00:04<00:01, 5.33it/s] FaceDet:: 77%|███████▋ | 24/31 [00:04<00:01, 5.47it/s] FaceDet:: 81%|████████ | 25/31 [00:05<00:01, 5.43it/s] FaceDet:: 84%|████████▍ | 26/31 [00:05<00:00, 5.42it/s] FaceDet:: 87%|████████▋ | 27/31 [00:05<00:00, 5.40it/s] FaceDet:: 90%|█████████ | 28/31 [00:05<00:00, 5.32it/s] FaceDet:: 94%|█████████▎| 29/31 [00:05<00:00, 5.60it/s] FaceDet:: 97%|█████████▋| 30/31 [00:05<00:00, 5.69it/s] FaceDet:: 100%|██████████| 31/31 [00:06<00:00, 3.91it/s] FaceDet:: 100%|██████████| 31/31 [00:06<00:00, 4.83it/s] [Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:23<02:42, 23.27s/it] [Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:28<01:16, 12.81s/it] [Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:34<00:47, 9.45s/it] [Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:39<00:31, 7.96s/it] [Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:45<00:21, 7.04s/it] [Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:50<00:13, 6.56s/it] [Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [00:56<00:06, 6.21s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:02<00:00, 6.13s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:02<00:00, 7.80s/it] Output video generated successfully!Prediction
chenxwh/video-retalking:db5a650cID36j4icdbmo5trkynweveysfhy4StatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/KEUAR5HgYXKzlaL12MNH2BrKhm2NXpcqIeEyEePhLdqRD2e9/2.mp4", "input_audio": "https://replicate.delivery/pbxt/KEUAROy4eYotyRuTYEYY0OFTRJJ4RFj8du5gEMIiMu8Y0qkk/hh.wav" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/KEUAR5HgYXKzlaL12MNH2BrKhm2NXpcqIeEyEePhLdqRD2e9/2.mp4", input_audio: "https://replicate.delivery/pbxt/KEUAROy4eYotyRuTYEYY0OFTRJJ4RFj8du5gEMIiMu8Y0qkk/hh.wav" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/KEUAR5HgYXKzlaL12MNH2BrKhm2NXpcqIeEyEePhLdqRD2e9/2.mp4", "input_audio": "https://replicate.delivery/pbxt/KEUAROy4eYotyRuTYEYY0OFTRJJ4RFj8du5gEMIiMu8Y0qkk/hh.wav" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/KEUAR5HgYXKzlaL12MNH2BrKhm2NXpcqIeEyEePhLdqRD2e9/2.mp4", "input_audio": "https://replicate.delivery/pbxt/KEUAROy4eYotyRuTYEYY0OFTRJJ4RFj8du5gEMIiMu8Y0qkk/hh.wav" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2024-01-15T21:51:06.804892Z", "created_at": "2024-01-15T21:41:11.189822Z", "data_removed": false, "error": null, "id": "36j4icdbmo5trkynweveysfhy4", "input": { "face": "https://replicate.delivery/pbxt/KEUAR5HgYXKzlaL12MNH2BrKhm2NXpcqIeEyEePhLdqRD2e9/2.mp4", "input_audio": "https://replicate.delivery/pbxt/KEUAROy4eYotyRuTYEYY0OFTRJJ4RFj8du5gEMIiMu8Y0qkk/hh.wav" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/125 [00:00<?, ?it/s]\nlandmark Det:: 1%| | 1/125 [00:08<18:33, 8.98s/it]\nlandmark Det:: 2%|▏ | 2/125 [00:15<15:29, 7.56s/it]\nlandmark Det:: 6%|▋ | 8/125 [00:15<02:28, 1.27s/it]\nlandmark Det:: 12%|█▏ | 15/125 [00:15<00:59, 1.86it/s]\nlandmark Det:: 18%|█▊ | 22/125 [00:15<00:31, 3.32it/s]\nlandmark Det:: 23%|██▎ | 29/125 [00:15<00:18, 5.29it/s]\nlandmark Det:: 29%|██▉ | 36/125 [00:16<00:11, 7.90it/s]\nlandmark Det:: 34%|███▍ | 43/125 [00:16<00:07, 11.25it/s]\nlandmark Det:: 40%|████ | 50/125 [00:16<00:04, 15.35it/s]\nlandmark Det:: 46%|████▌ | 57/125 [00:16<00:03, 20.29it/s]\nlandmark Det:: 51%|█████ | 64/125 [00:16<00:02, 25.34it/s]\nlandmark Det:: 57%|█████▋ | 71/125 [00:16<00:01, 31.14it/s]\nlandmark Det:: 62%|██████▏ | 78/125 [00:16<00:01, 36.87it/s]\nlandmark Det:: 68%|██████▊ | 85/125 [00:16<00:00, 42.40it/s]\nlandmark Det:: 74%|███████▎ | 92/125 [00:16<00:00, 47.39it/s]\nlandmark Det:: 79%|███████▉ | 99/125 [00:17<00:00, 51.21it/s]\nlandmark Det:: 85%|████████▍ | 106/125 [00:17<00:00, 54.24it/s]\nlandmark Det:: 90%|█████████ | 113/125 [00:17<00:00, 57.15it/s]\nlandmark Det:: 96%|█████████▌| 120/125 [00:17<00:00, 59.62it/s]\nlandmark Det:: 100%|██████████| 125/125 [00:17<00:00, 7.15it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 1%| | 1/125 [00:00<00:21, 5.81it/s]\n[Step 2] 3DMM Extraction In Video:: 12%|█▏ | 15/125 [00:00<00:01, 64.52it/s]\n[Step 2] 3DMM Extraction In Video:: 23%|██▎ | 29/125 [00:00<00:01, 91.80it/s]\n[Step 2] 3DMM Extraction In Video:: 34%|███▍ | 43/125 [00:00<00:00, 106.77it/s]\n[Step 2] 3DMM Extraction In Video:: 46%|████▌ | 57/125 [00:00<00:00, 115.66it/s]\n[Step 2] 3DMM Extraction In Video:: 57%|█████▋ | 71/125 [00:00<00:00, 121.46it/s]\n[Step 2] 3DMM Extraction In Video:: 68%|██████▊ | 85/125 [00:00<00:00, 125.10it/s]\n[Step 2] 3DMM Extraction In Video:: 79%|███████▉ | 99/125 [00:00<00:00, 127.17it/s]\n[Step 2] 3DMM Extraction In Video:: 90%|████████▉ | 112/125 [00:01<00:00, 125.88it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:01<00:00, 111.94it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 1%| | 1/125 [00:00<00:41, 3.02it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 3/125 [00:00<00:17, 6.94it/s]\n[Step 3] Stabilize the expression In Video:: 4%|▍ | 5/125 [00:00<00:13, 9.09it/s]\n[Step 3] Stabilize the expression In Video:: 6%|▌ | 7/125 [00:00<00:11, 10.41it/s]\n[Step 3] Stabilize the expression In Video:: 7%|▋ | 9/125 [00:00<00:10, 11.22it/s]\n[Step 3] Stabilize the expression In Video:: 9%|▉ | 11/125 [00:01<00:09, 11.72it/s]\n[Step 3] Stabilize the expression In Video:: 10%|█ | 13/125 [00:01<00:09, 12.10it/s]\n[Step 3] Stabilize the expression In Video:: 12%|█▏ | 15/125 [00:01<00:08, 12.34it/s]\n[Step 3] Stabilize the expression In Video:: 14%|█▎ | 17/125 [00:01<00:08, 12.51it/s]\n[Step 3] Stabilize the expression In Video:: 15%|█▌ | 19/125 [00:01<00:08, 12.61it/s]\n[Step 3] Stabilize the expression In Video:: 17%|█▋ | 21/125 [00:01<00:08, 12.72it/s]\n[Step 3] Stabilize the expression In Video:: 18%|█▊ | 23/125 [00:02<00:08, 12.68it/s]\n[Step 3] Stabilize the expression In Video:: 20%|██ | 25/125 [00:02<00:07, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 22%|██▏ | 27/125 [00:02<00:07, 12.73it/s]\n[Step 3] Stabilize the expression In Video:: 23%|██▎ | 29/125 [00:02<00:07, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 25%|██▍ | 31/125 [00:02<00:07, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▋ | 33/125 [00:02<00:07, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 28%|██▊ | 35/125 [00:02<00:07, 12.72it/s]\n[Step 3] Stabilize the expression In Video:: 30%|██▉ | 37/125 [00:03<00:06, 12.78it/s]\n[Step 3] Stabilize the expression In Video:: 31%|███ | 39/125 [00:03<00:06, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 33%|███▎ | 41/125 [00:03<00:06, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 34%|███▍ | 43/125 [00:03<00:06, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 36%|███▌ | 45/125 [00:03<00:06, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 47/125 [00:03<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 39%|███▉ | 49/125 [00:04<00:06, 12.65it/s]\n[Step 3] Stabilize the expression In Video:: 41%|████ | 51/125 [00:04<00:05, 12.60it/s]\n[Step 3] Stabilize the expression In Video:: 42%|████▏ | 53/125 [00:04<00:05, 12.71it/s]\n[Step 3] Stabilize the expression In Video:: 44%|████▍ | 55/125 [00:04<00:05, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 46%|████▌ | 57/125 [00:04<00:05, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 47%|████▋ | 59/125 [00:04<00:05, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 49%|████▉ | 61/125 [00:05<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 50%|█████ | 63/125 [00:05<00:04, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 52%|█████▏ | 65/125 [00:05<00:04, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▎ | 67/125 [00:05<00:04, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 55%|█████▌ | 69/125 [00:05<00:04, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 57%|█████▋ | 71/125 [00:05<00:04, 12.73it/s]\n[Step 3] Stabilize the expression In Video:: 58%|█████▊ | 73/125 [00:05<00:04, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 60%|██████ | 75/125 [00:06<00:03, 12.66it/s]\n[Step 3] Stabilize the expression In Video:: 62%|██████▏ | 77/125 [00:06<00:03, 12.74it/s]\n[Step 3] Stabilize the expression In Video:: 63%|██████▎ | 79/125 [00:06<00:03, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 65%|██████▍ | 81/125 [00:06<00:03, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▋ | 83/125 [00:06<00:03, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 68%|██████▊ | 85/125 [00:06<00:03, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 70%|██████▉ | 87/125 [00:07<00:02, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 71%|███████ | 89/125 [00:07<00:02, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 73%|███████▎ | 91/125 [00:07<00:02, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 74%|███████▍ | 93/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 76%|███████▌ | 95/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 78%|███████▊ | 97/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 79%|███████▉ | 99/125 [00:07<00:02, 12.77it/s]\n[Step 3] Stabilize the expression In Video:: 81%|████████ | 101/125 [00:08<00:01, 12.75it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 103/125 [00:08<00:01, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 84%|████████▍ | 105/125 [00:08<00:01, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 86%|████████▌ | 107/125 [00:08<00:01, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 87%|████████▋ | 109/125 [00:08<00:01, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 89%|████████▉ | 111/125 [00:08<00:01, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 90%|█████████ | 113/125 [00:09<00:00, 12.72it/s]\n[Step 3] Stabilize the expression In Video:: 92%|█████████▏| 115/125 [00:09<00:00, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 94%|█████████▎| 117/125 [00:09<00:00, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 95%|█████████▌| 119/125 [00:09<00:00, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 97%|█████████▋| 121/125 [00:09<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 98%|█████████▊| 123/125 [00:09<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.50it/s]\n[Step 4] Load audio; Length of mel chunks: 770\n[Step 5] Reference Enhancement: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/125 [00:01<02:18, 1.12s/it]\n[Step 5] Reference Enhancement: 2%|▏ | 2/125 [00:01<01:06, 1.85it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 3/125 [00:01<00:43, 2.81it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 4/125 [00:01<00:32, 3.72it/s]\n[Step 5] Reference Enhancement: 4%|▍ | 5/125 [00:01<00:26, 4.53it/s]\n[Step 5] Reference Enhancement: 5%|▍ | 6/125 [00:01<00:22, 5.22it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 7/125 [00:01<00:20, 5.76it/s]\n[Step 5] Reference Enhancement: 6%|▋ | 8/125 [00:02<00:19, 6.16it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 9/125 [00:02<00:17, 6.51it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 10/125 [00:02<00:16, 6.77it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 11/125 [00:02<00:16, 6.95it/s]\n[Step 5] Reference Enhancement: 10%|▉ | 12/125 [00:02<00:15, 7.10it/s]\n[Step 5] Reference Enhancement: 10%|█ | 13/125 [00:02<00:15, 7.18it/s]\n[Step 5] Reference Enhancement: 11%|█ | 14/125 [00:02<00:15, 7.24it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 15/125 [00:03<00:15, 7.24it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 16/125 [00:03<00:14, 7.28it/s]\n[Step 5] Reference Enhancement: 14%|█▎ | 17/125 [00:03<00:14, 7.33it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 18/125 [00:03<00:14, 7.33it/s]\n[Step 5] Reference Enhancement: 15%|█▌ | 19/125 [00:03<00:14, 7.36it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 20/125 [00:03<00:14, 7.38it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 21/125 [00:03<00:14, 7.39it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 22/125 [00:03<00:13, 7.38it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 23/125 [00:04<00:13, 7.36it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 24/125 [00:04<00:13, 7.38it/s]\n[Step 5] Reference Enhancement: 20%|██ | 25/125 [00:04<00:13, 7.38it/s]\n[Step 5] Reference Enhancement: 21%|██ | 26/125 [00:04<00:13, 7.39it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 27/125 [00:04<00:13, 7.41it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 28/125 [00:04<00:13, 7.37it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 29/125 [00:04<00:12, 7.39it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 30/125 [00:05<00:12, 7.39it/s]\n[Step 5] Reference Enhancement: 25%|██▍ | 31/125 [00:05<00:12, 7.39it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 32/125 [00:05<00:12, 7.38it/s]\n[Step 5] Reference Enhancement: 26%|██▋ | 33/125 [00:05<00:12, 7.37it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 34/125 [00:05<00:12, 7.38it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 35/125 [00:05<00:12, 7.40it/s]\n[Step 5] Reference Enhancement: 29%|██▉ | 36/125 [00:05<00:12, 7.39it/s]\n[Step 5] Reference Enhancement: 30%|██▉ | 37/125 [00:05<00:11, 7.38it/s]\n[Step 5] Reference Enhancement: 30%|███ | 38/125 [00:06<00:11, 7.36it/s]\n[Step 5] Reference Enhancement: 31%|███ | 39/125 [00:06<00:11, 7.37it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 40/125 [00:06<00:11, 7.36it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 41/125 [00:06<00:11, 7.38it/s]\n[Step 5] Reference Enhancement: 34%|███▎ | 42/125 [00:06<00:11, 7.39it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 43/125 [00:06<00:11, 7.39it/s]\n[Step 5] Reference Enhancement: 35%|███▌ | 44/125 [00:06<00:11, 7.34it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 45/125 [00:07<00:10, 7.32it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 46/125 [00:07<00:10, 7.33it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 47/125 [00:07<00:10, 7.35it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 48/125 [00:07<00:10, 7.36it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 49/125 [00:07<00:10, 7.37it/s]\n[Step 5] Reference Enhancement: 40%|████ | 50/125 [00:07<00:10, 7.36it/s]\n[Step 5] Reference Enhancement: 41%|████ | 51/125 [00:07<00:10, 7.34it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 52/125 [00:08<00:09, 7.30it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 53/125 [00:08<00:09, 7.34it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 54/125 [00:08<00:09, 7.33it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 55/125 [00:08<00:09, 7.35it/s]\n[Step 5] Reference Enhancement: 45%|████▍ | 56/125 [00:08<00:09, 7.38it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 57/125 [00:08<00:09, 7.40it/s]\n[Step 5] Reference Enhancement: 46%|████▋ | 58/125 [00:08<00:09, 7.38it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 59/125 [00:08<00:08, 7.36it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 60/125 [00:09<00:08, 7.35it/s]\n[Step 5] Reference Enhancement: 49%|████▉ | 61/125 [00:09<00:08, 7.36it/s]\n[Step 5] Reference Enhancement: 50%|████▉ | 62/125 [00:09<00:08, 7.37it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 63/125 [00:09<00:08, 7.38it/s]\n[Step 5] Reference Enhancement: 51%|█████ | 64/125 [00:09<00:08, 7.40it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 65/125 [00:09<00:08, 7.38it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 66/125 [00:09<00:08, 7.35it/s]\n[Step 5] Reference Enhancement: 54%|█████▎ | 67/125 [00:10<00:07, 7.35it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 68/125 [00:10<00:07, 7.37it/s]\n[Step 5] Reference Enhancement: 55%|█████▌ | 69/125 [00:10<00:07, 7.37it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 70/125 [00:10<00:07, 7.39it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 71/125 [00:10<00:07, 7.39it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 72/125 [00:10<00:07, 7.40it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 73/125 [00:10<00:07, 7.40it/s]\n[Step 5] Reference Enhancement: 59%|█████▉ | 74/125 [00:11<00:06, 7.36it/s]\n[Step 5] Reference Enhancement: 60%|██████ | 75/125 [00:11<00:06, 7.35it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 76/125 [00:11<00:06, 7.36it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 77/125 [00:11<00:06, 7.37it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 78/125 [00:11<00:06, 7.38it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 79/125 [00:11<00:06, 7.39it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 80/125 [00:11<00:06, 7.37it/s]\n[Step 5] Reference Enhancement: 65%|██████▍ | 81/125 [00:11<00:05, 7.37it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 82/125 [00:12<00:05, 7.37it/s]\n[Step 5] Reference Enhancement: 66%|██████▋ | 83/125 [00:12<00:05, 7.38it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 84/125 [00:12<00:05, 7.37it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 85/125 [00:12<00:05, 7.38it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 86/125 [00:12<00:05, 7.40it/s]\n[Step 5] Reference Enhancement: 70%|██████▉ | 87/125 [00:12<00:05, 7.38it/s]\n[Step 5] Reference Enhancement: 70%|███████ | 88/125 [00:12<00:05, 7.38it/s]\n[Step 5] Reference Enhancement: 71%|███████ | 89/125 [00:13<00:04, 7.37it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 90/125 [00:13<00:04, 7.37it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 91/125 [00:13<00:04, 7.36it/s]\n[Step 5] Reference Enhancement: 74%|███████▎ | 92/125 [00:13<00:04, 7.37it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 93/125 [00:13<00:04, 7.38it/s]\n[Step 5] Reference Enhancement: 75%|███████▌ | 94/125 [00:13<00:04, 7.38it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 95/125 [00:13<00:04, 7.39it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 96/125 [00:14<00:03, 7.40it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 97/125 [00:14<00:03, 7.37it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 98/125 [00:14<00:03, 7.37it/s]\n[Step 5] Reference Enhancement: 79%|███████▉ | 99/125 [00:14<00:03, 7.36it/s]\n[Step 5] Reference Enhancement: 80%|████████ | 100/125 [00:14<00:03, 7.35it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 101/125 [00:14<00:03, 7.37it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 102/125 [00:14<00:03, 7.38it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 103/125 [00:14<00:02, 7.38it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 104/125 [00:15<00:02, 7.31it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 105/125 [00:15<00:02, 7.33it/s]\n[Step 5] Reference Enhancement: 85%|████████▍ | 106/125 [00:15<00:02, 7.33it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 107/125 [00:15<00:02, 7.35it/s]\n[Step 5] Reference Enhancement: 86%|████████▋ | 108/125 [00:15<00:02, 7.37it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 109/125 [00:15<00:02, 7.37it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 110/125 [00:15<00:02, 7.37it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 111/125 [00:16<00:01, 7.36it/s]\n[Step 5] Reference Enhancement: 90%|████████▉ | 112/125 [00:16<00:01, 7.36it/s]\n[Step 5] Reference Enhancement: 90%|█████████ | 113/125 [00:16<00:01, 7.34it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 114/125 [00:16<00:01, 7.34it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 115/125 [00:16<00:01, 7.35it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 116/125 [00:16<00:01, 7.36it/s]\n[Step 5] Reference Enhancement: 94%|█████████▎| 117/125 [00:16<00:01, 7.36it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 118/125 [00:16<00:00, 7.35it/s]\n[Step 5] Reference Enhancement: 95%|█████████▌| 119/125 [00:17<00:00, 7.35it/s]\n[Step 5] Reference Enhancement: 96%|█████████▌| 120/125 [00:17<00:00, 7.36it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 121/125 [00:17<00:00, 7.38it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 122/125 [00:17<00:00, 7.38it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 123/125 [00:17<00:00, 7.36it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 124/125 [00:17<00:00, 7.36it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 125/125 [00:17<00:00, 7.36it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 125/125 [00:17<00:00, 6.97it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/49 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/125 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/125 [00:00<00:22, 5.47it/s]\u001b[A\nlandmark Det:: 2%|▏ | 2/125 [00:00<00:41, 2.98it/s]\u001b[A\nlandmark Det:: 7%|▋ | 9/125 [00:00<00:07, 16.12it/s]\u001b[A\nlandmark Det:: 13%|█▎ | 16/125 [00:00<00:03, 27.67it/s]\u001b[A\nlandmark Det:: 18%|█▊ | 23/125 [00:00<00:02, 37.40it/s]\u001b[A\nlandmark Det:: 24%|██▍ | 30/125 [00:01<00:02, 45.18it/s]\u001b[A\nlandmark Det:: 30%|██▉ | 37/125 [00:01<00:01, 51.24it/s]\u001b[A\nlandmark Det:: 35%|███▌ | 44/125 [00:01<00:01, 55.77it/s]\u001b[A\nlandmark Det:: 41%|████ | 51/125 [00:01<00:01, 58.95it/s]\u001b[A\nlandmark Det:: 46%|████▋ | 58/125 [00:01<00:01, 61.47it/s]\u001b[A\nlandmark Det:: 52%|█████▏ | 65/125 [00:01<00:00, 62.27it/s]\u001b[A\nlandmark Det:: 58%|█████▊ | 72/125 [00:01<00:00, 63.70it/s]\u001b[A\nlandmark Det:: 63%|██████▎ | 79/125 [00:01<00:00, 64.75it/s]\u001b[A\nlandmark Det:: 69%|██████▉ | 86/125 [00:01<00:00, 65.32it/s]\u001b[A\nlandmark Det:: 74%|███████▍ | 93/125 [00:01<00:00, 65.96it/s]\u001b[A\nlandmark Det:: 80%|████████ | 100/125 [00:02<00:00, 66.38it/s]\u001b[A\nlandmark Det:: 86%|████████▌ | 107/125 [00:02<00:00, 66.59it/s]\u001b[A\nlandmark Det:: 91%|█████████ | 114/125 [00:02<00:00, 66.84it/s]\u001b[A\nlandmark Det:: 97%|█████████▋| 121/125 [00:02<00:00, 66.59it/s]\u001b[A\nlandmark Det:: 100%|██████████| 125/125 [00:02<00:00, 50.71it/s]\n 0%| | 0/125 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 125/125 [00:00<00:00, 20998.40it/s]\n 0%| | 0/125 [00:00<?, ?it/s]\u001b[A\n 52%|█████▏ | 65/125 [00:00<00:00, 646.91it/s]\u001b[A\n100%|██████████| 125/125 [00:00<00:00, 647.24it/s]\nFaceDet:: 0%| | 0/32 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 3%|▎ | 1/32 [00:01<00:36, 1.16s/it]\u001b[A\nFaceDet:: 6%|▋ | 2/32 [00:01<00:18, 1.59it/s]\u001b[A\nFaceDet:: 9%|▉ | 3/32 [00:01<00:13, 2.20it/s]\u001b[A\nFaceDet:: 12%|█▎ | 4/32 [00:01<00:10, 2.64it/s]\u001b[A\nFaceDet:: 16%|█▌ | 5/32 [00:02<00:08, 3.01it/s]\u001b[A\nFaceDet:: 19%|█▉ | 6/32 [00:02<00:07, 3.42it/s]\u001b[A\nFaceDet:: 22%|██▏ | 7/32 [00:02<00:07, 3.52it/s]\u001b[A\nFaceDet:: 25%|██▌ | 8/32 [00:02<00:06, 3.60it/s]\u001b[A\nFaceDet:: 28%|██▊ | 9/32 [00:03<00:06, 3.70it/s]\u001b[A\nFaceDet:: 31%|███▏ | 10/32 [00:03<00:05, 3.86it/s]\u001b[A\nFaceDet:: 34%|███▍ | 11/32 [00:03<00:05, 3.94it/s]\u001b[A\nFaceDet:: 38%|███▊ | 12/32 [00:03<00:05, 3.85it/s]\u001b[A\nFaceDet:: 41%|████ | 13/32 [00:04<00:04, 3.92it/s]\u001b[A\nFaceDet:: 44%|████▍ | 14/32 [00:04<00:04, 4.12it/s]\u001b[A\nFaceDet:: 47%|████▋ | 15/32 [00:04<00:04, 4.07it/s]\u001b[A\nFaceDet:: 50%|█████ | 16/32 [00:04<00:04, 3.99it/s]\u001b[A\nFaceDet:: 53%|█████▎ | 17/32 [00:05<00:03, 4.02it/s]\u001b[A\nFaceDet:: 56%|█████▋ | 18/32 [00:05<00:03, 4.21it/s]\u001b[A\nFaceDet:: 59%|█████▉ | 19/32 [00:05<00:03, 4.09it/s]\u001b[A\nFaceDet:: 62%|██████▎ | 20/32 [00:05<00:03, 3.97it/s]\u001b[A\nFaceDet:: 66%|██████▌ | 21/32 [00:06<00:02, 3.91it/s]\u001b[A\nFaceDet:: 69%|██████▉ | 22/32 [00:06<00:02, 3.98it/s]\u001b[A\nFaceDet:: 72%|███████▏ | 23/32 [00:06<00:02, 3.92it/s]\u001b[A\nFaceDet:: 75%|███████▌ | 24/32 [00:06<00:02, 3.84it/s]\u001b[A\nFaceDet:: 78%|███████▊ | 25/32 [00:07<00:01, 3.91it/s]\u001b[A\nFaceDet:: 81%|████████▏ | 26/32 [00:07<00:01, 4.03it/s]\u001b[A\nFaceDet:: 84%|████████▍ | 27/32 [00:07<00:01, 4.00it/s]\u001b[A\nFaceDet:: 88%|████████▊ | 28/32 [00:07<00:01, 3.94it/s]\u001b[A\nFaceDet:: 91%|█████████ | 29/32 [00:08<00:00, 3.88it/s]\u001b[A\nFaceDet:: 94%|█████████▍| 30/32 [00:08<00:00, 4.04it/s]\u001b[A\nFaceDet:: 97%|█████████▋| 31/32 [00:08<00:00, 3.93it/s]\u001b[A\nFaceDet:: 100%|██████████| 32/32 [00:09<00:00, 3.25it/s]\u001b[A\nFaceDet:: 100%|██████████| 32/32 [00:09<00:00, 3.51it/s]\n[Step 6] Lip Synthesis:: 2%|▏ | 1/49 [00:27<21:45, 27.19s/it]\n[Step 6] Lip Synthesis:: 4%|▍ | 2/49 [00:33<11:54, 15.20s/it]\n[Step 6] Lip Synthesis:: 6%|▌ | 3/49 [00:40<08:43, 11.38s/it]\n[Step 6] Lip Synthesis:: 8%|▊ | 4/49 [00:47<07:12, 9.61s/it]\n[Step 6] Lip Synthesis:: 10%|█ | 5/49 [00:54<06:19, 8.64s/it]\n[Step 6] Lip Synthesis:: 12%|█▏ | 6/49 [01:01<05:48, 8.12s/it]\n[Step 6] Lip Synthesis:: 14%|█▍ | 7/49 [01:08<05:25, 7.74s/it]\n[Step 6] Lip Synthesis:: 16%|█▋ | 8/49 [01:15<05:06, 7.48s/it]\n[Step 6] Lip Synthesis:: 18%|█▊ | 9/49 [01:22<04:52, 7.31s/it]\n[Step 6] Lip Synthesis:: 20%|██ | 10/49 [01:29<04:39, 7.18s/it]\n[Step 6] Lip Synthesis:: 22%|██▏ | 11/49 [01:36<04:29, 7.10s/it]\n[Step 6] Lip Synthesis:: 24%|██▍ | 12/49 [01:43<04:20, 7.03s/it]\n[Step 6] Lip Synthesis:: 27%|██▋ | 13/49 [01:50<04:11, 6.99s/it]\n[Step 6] Lip Synthesis:: 29%|██▊ | 14/49 [01:57<04:03, 6.96s/it]\n[Step 6] Lip Synthesis:: 31%|███ | 15/49 [02:03<03:56, 6.95s/it]\n[Step 6] Lip Synthesis:: 33%|███▎ | 16/49 [02:10<03:49, 6.95s/it]\n[Step 6] Lip Synthesis:: 35%|███▍ | 17/49 [02:17<03:41, 6.94s/it]\n[Step 6] Lip Synthesis:: 37%|███▋ | 18/49 [02:24<03:35, 6.94s/it]\n[Step 6] Lip Synthesis:: 39%|███▉ | 19/49 [02:31<03:28, 6.94s/it]\n[Step 6] Lip Synthesis:: 41%|████ | 20/49 [02:38<03:21, 6.94s/it]\n[Step 6] Lip Synthesis:: 43%|████▎ | 21/49 [02:45<03:14, 6.95s/it]\n[Step 6] Lip Synthesis:: 45%|████▍ | 22/49 [02:52<03:07, 6.93s/it]\n[Step 6] Lip Synthesis:: 47%|████▋ | 23/49 [02:59<03:00, 6.92s/it]\n[Step 6] Lip Synthesis:: 49%|████▉ | 24/49 [03:06<02:53, 6.93s/it]\n[Step 6] Lip Synthesis:: 51%|█████ | 25/49 [03:13<02:46, 6.93s/it]\n[Step 6] Lip Synthesis:: 53%|█████▎ | 26/49 [03:20<02:39, 6.93s/it]\n[Step 6] Lip Synthesis:: 55%|█████▌ | 27/49 [03:27<02:32, 6.92s/it]\n[Step 6] Lip Synthesis:: 57%|█████▋ | 28/49 [03:33<02:25, 6.91s/it]\n[Step 6] Lip Synthesis:: 59%|█████▉ | 29/49 [03:40<02:18, 6.91s/it]\n[Step 6] Lip Synthesis:: 61%|██████ | 30/49 [03:47<02:11, 6.92s/it]\n[Step 6] Lip Synthesis:: 63%|██████▎ | 31/49 [03:54<02:04, 6.92s/it]\n[Step 6] Lip Synthesis:: 65%|██████▌ | 32/49 [04:01<01:57, 6.91s/it]\n[Step 6] Lip Synthesis:: 67%|██████▋ | 33/49 [04:08<01:50, 6.92s/it]\n[Step 6] Lip Synthesis:: 69%|██████▉ | 34/49 [04:15<01:43, 6.92s/it]\n[Step 6] Lip Synthesis:: 71%|███████▏ | 35/49 [04:22<01:36, 6.92s/it]\n[Step 6] Lip Synthesis:: 73%|███████▎ | 36/49 [04:29<01:29, 6.92s/it]\n[Step 6] Lip Synthesis:: 76%|███████▌ | 37/49 [04:36<01:23, 6.92s/it]\n[Step 6] Lip Synthesis:: 78%|███████▊ | 38/49 [04:43<01:16, 6.93s/it]\n[Step 6] Lip Synthesis:: 80%|███████▉ | 39/49 [04:50<01:09, 6.94s/it]\n[Step 6] Lip Synthesis:: 82%|████████▏ | 40/49 [04:57<01:02, 6.94s/it]\n[Step 6] Lip Synthesis:: 84%|████████▎ | 41/49 [05:04<00:55, 6.94s/it]\n[Step 6] Lip Synthesis:: 86%|████████▌ | 42/49 [05:10<00:48, 6.94s/it]\n[Step 6] Lip Synthesis:: 88%|████████▊ | 43/49 [05:17<00:41, 6.93s/it]\n[Step 6] Lip Synthesis:: 90%|████████▉ | 44/49 [05:24<00:34, 6.93s/it]\n[Step 6] Lip Synthesis:: 92%|█████████▏| 45/49 [05:31<00:27, 6.92s/it]\n[Step 6] Lip Synthesis:: 94%|█████████▍| 46/49 [05:38<00:20, 6.92s/it]\n[Step 6] Lip Synthesis:: 96%|█████████▌| 47/49 [05:45<00:13, 6.92s/it]\n[Step 6] Lip Synthesis:: 98%|█████████▊| 48/49 [05:52<00:06, 6.92s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 49/49 [05:54<00:00, 5.36s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 49/49 [05:54<00:00, 7.23s/it]", "metrics": { "predict_time": 410.801695, "total_time": 595.61507 }, "output": "https://replicate.delivery/pbxt/YFffaeLW3mIlLJJRtSloZgneehnHxeyMivy6VfCG4qwsk1aGJA/output.mp4", "started_at": "2024-01-15T21:44:16.003197Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/36j4icdbmo5trkynweveysfhy4", "cancel": "https://api.replicate.com/v1/predictions/36j4icdbmo5trkynweveysfhy4/cancel" }, "version": "2ba7c9a125bf288c8cbf9eb13e1442fe378dda0e19dac932c85d2c240b5f7a1c" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/125 [00:00<?, ?it/s] landmark Det:: 1%| | 1/125 [00:08<18:33, 8.98s/it] landmark Det:: 2%|▏ | 2/125 [00:15<15:29, 7.56s/it] landmark Det:: 6%|▋ | 8/125 [00:15<02:28, 1.27s/it] landmark Det:: 12%|█▏ | 15/125 [00:15<00:59, 1.86it/s] landmark Det:: 18%|█▊ | 22/125 [00:15<00:31, 3.32it/s] landmark Det:: 23%|██▎ | 29/125 [00:15<00:18, 5.29it/s] landmark Det:: 29%|██▉ | 36/125 [00:16<00:11, 7.90it/s] landmark Det:: 34%|███▍ | 43/125 [00:16<00:07, 11.25it/s] landmark Det:: 40%|████ | 50/125 [00:16<00:04, 15.35it/s] landmark Det:: 46%|████▌ | 57/125 [00:16<00:03, 20.29it/s] landmark Det:: 51%|█████ | 64/125 [00:16<00:02, 25.34it/s] landmark Det:: 57%|█████▋ | 71/125 [00:16<00:01, 31.14it/s] landmark Det:: 62%|██████▏ | 78/125 [00:16<00:01, 36.87it/s] landmark Det:: 68%|██████▊ | 85/125 [00:16<00:00, 42.40it/s] landmark Det:: 74%|███████▎ | 92/125 [00:16<00:00, 47.39it/s] landmark Det:: 79%|███████▉ | 99/125 [00:17<00:00, 51.21it/s] landmark Det:: 85%|████████▍ | 106/125 [00:17<00:00, 54.24it/s] landmark Det:: 90%|█████████ | 113/125 [00:17<00:00, 57.15it/s] landmark Det:: 96%|█████████▌| 120/125 [00:17<00:00, 59.62it/s] landmark Det:: 100%|██████████| 125/125 [00:17<00:00, 7.15it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 1%| | 1/125 [00:00<00:21, 5.81it/s] [Step 2] 3DMM Extraction In Video:: 12%|█▏ | 15/125 [00:00<00:01, 64.52it/s] [Step 2] 3DMM Extraction In Video:: 23%|██▎ | 29/125 [00:00<00:01, 91.80it/s] [Step 2] 3DMM Extraction In Video:: 34%|███▍ | 43/125 [00:00<00:00, 106.77it/s] [Step 2] 3DMM Extraction In Video:: 46%|████▌ | 57/125 [00:00<00:00, 115.66it/s] [Step 2] 3DMM Extraction In Video:: 57%|█████▋ | 71/125 [00:00<00:00, 121.46it/s] [Step 2] 3DMM Extraction In Video:: 68%|██████▊ | 85/125 [00:00<00:00, 125.10it/s] [Step 2] 3DMM Extraction In Video:: 79%|███████▉ | 99/125 [00:00<00:00, 127.17it/s] [Step 2] 3DMM Extraction In Video:: 90%|████████▉ | 112/125 [00:01<00:00, 125.88it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:01<00:00, 111.94it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 1%| | 1/125 [00:00<00:41, 3.02it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 3/125 [00:00<00:17, 6.94it/s] [Step 3] Stabilize the expression In Video:: 4%|▍ | 5/125 [00:00<00:13, 9.09it/s] [Step 3] Stabilize the expression In Video:: 6%|▌ | 7/125 [00:00<00:11, 10.41it/s] [Step 3] Stabilize the expression In Video:: 7%|▋ | 9/125 [00:00<00:10, 11.22it/s] [Step 3] Stabilize the expression In Video:: 9%|▉ | 11/125 [00:01<00:09, 11.72it/s] [Step 3] Stabilize the expression In Video:: 10%|█ | 13/125 [00:01<00:09, 12.10it/s] [Step 3] Stabilize the expression In Video:: 12%|█▏ | 15/125 [00:01<00:08, 12.34it/s] [Step 3] Stabilize the expression In Video:: 14%|█▎ | 17/125 [00:01<00:08, 12.51it/s] [Step 3] Stabilize the expression In Video:: 15%|█▌ | 19/125 [00:01<00:08, 12.61it/s] [Step 3] Stabilize the expression In Video:: 17%|█▋ | 21/125 [00:01<00:08, 12.72it/s] [Step 3] Stabilize the expression In Video:: 18%|█▊ | 23/125 [00:02<00:08, 12.68it/s] [Step 3] Stabilize the expression In Video:: 20%|██ | 25/125 [00:02<00:07, 12.76it/s] [Step 3] Stabilize the expression In Video:: 22%|██▏ | 27/125 [00:02<00:07, 12.73it/s] [Step 3] Stabilize the expression In Video:: 23%|██▎ | 29/125 [00:02<00:07, 12.79it/s] [Step 3] Stabilize the expression In Video:: 25%|██▍ | 31/125 [00:02<00:07, 12.84it/s] [Step 3] Stabilize the expression In Video:: 26%|██▋ | 33/125 [00:02<00:07, 12.87it/s] [Step 3] Stabilize the expression In Video:: 28%|██▊ | 35/125 [00:02<00:07, 12.72it/s] [Step 3] Stabilize the expression In Video:: 30%|██▉ | 37/125 [00:03<00:06, 12.78it/s] [Step 3] Stabilize the expression In Video:: 31%|███ | 39/125 [00:03<00:06, 12.83it/s] [Step 3] Stabilize the expression In Video:: 33%|███▎ | 41/125 [00:03<00:06, 12.85it/s] [Step 3] Stabilize the expression In Video:: 34%|███▍ | 43/125 [00:03<00:06, 12.84it/s] [Step 3] Stabilize the expression In Video:: 36%|███▌ | 45/125 [00:03<00:06, 12.88it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 47/125 [00:03<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 39%|███▉ | 49/125 [00:04<00:06, 12.65it/s] [Step 3] Stabilize the expression In Video:: 41%|████ | 51/125 [00:04<00:05, 12.60it/s] [Step 3] Stabilize the expression In Video:: 42%|████▏ | 53/125 [00:04<00:05, 12.71it/s] [Step 3] Stabilize the expression In Video:: 44%|████▍ | 55/125 [00:04<00:05, 12.79it/s] [Step 3] Stabilize the expression In Video:: 46%|████▌ | 57/125 [00:04<00:05, 12.85it/s] [Step 3] Stabilize the expression In Video:: 47%|████▋ | 59/125 [00:04<00:05, 12.86it/s] [Step 3] Stabilize the expression In Video:: 49%|████▉ | 61/125 [00:05<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 50%|█████ | 63/125 [00:05<00:04, 12.90it/s] [Step 3] Stabilize the expression In Video:: 52%|█████▏ | 65/125 [00:05<00:04, 12.91it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▎ | 67/125 [00:05<00:04, 12.89it/s] [Step 3] Stabilize the expression In Video:: 55%|█████▌ | 69/125 [00:05<00:04, 12.91it/s] [Step 3] Stabilize the expression In Video:: 57%|█████▋ | 71/125 [00:05<00:04, 12.73it/s] [Step 3] Stabilize the expression In Video:: 58%|█████▊ | 73/125 [00:05<00:04, 12.81it/s] [Step 3] Stabilize the expression In Video:: 60%|██████ | 75/125 [00:06<00:03, 12.66it/s] [Step 3] Stabilize the expression In Video:: 62%|██████▏ | 77/125 [00:06<00:03, 12.74it/s] [Step 3] Stabilize the expression In Video:: 63%|██████▎ | 79/125 [00:06<00:03, 12.81it/s] [Step 3] Stabilize the expression In Video:: 65%|██████▍ | 81/125 [00:06<00:03, 12.85it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▋ | 83/125 [00:06<00:03, 12.87it/s] [Step 3] Stabilize the expression In Video:: 68%|██████▊ | 85/125 [00:06<00:03, 12.89it/s] [Step 3] Stabilize the expression In Video:: 70%|██████▉ | 87/125 [00:07<00:02, 12.90it/s] [Step 3] Stabilize the expression In Video:: 71%|███████ | 89/125 [00:07<00:02, 12.93it/s] [Step 3] Stabilize the expression In Video:: 73%|███████▎ | 91/125 [00:07<00:02, 12.91it/s] [Step 3] Stabilize the expression In Video:: 74%|███████▍ | 93/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 76%|███████▌ | 95/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 78%|███████▊ | 97/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 79%|███████▉ | 99/125 [00:07<00:02, 12.77it/s] [Step 3] Stabilize the expression In Video:: 81%|████████ | 101/125 [00:08<00:01, 12.75it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 103/125 [00:08<00:01, 12.81it/s] [Step 3] Stabilize the expression In Video:: 84%|████████▍ | 105/125 [00:08<00:01, 12.82it/s] [Step 3] Stabilize the expression In Video:: 86%|████████▌ | 107/125 [00:08<00:01, 12.84it/s] [Step 3] Stabilize the expression In Video:: 87%|████████▋ | 109/125 [00:08<00:01, 12.83it/s] [Step 3] Stabilize the expression In Video:: 89%|████████▉ | 111/125 [00:08<00:01, 12.83it/s] [Step 3] Stabilize the expression In Video:: 90%|█████████ | 113/125 [00:09<00:00, 12.72it/s] [Step 3] Stabilize the expression In Video:: 92%|█████████▏| 115/125 [00:09<00:00, 12.76it/s] [Step 3] Stabilize the expression In Video:: 94%|█████████▎| 117/125 [00:09<00:00, 12.82it/s] [Step 3] Stabilize the expression In Video:: 95%|█████████▌| 119/125 [00:09<00:00, 12.85it/s] [Step 3] Stabilize the expression In Video:: 97%|█████████▋| 121/125 [00:09<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 98%|█████████▊| 123/125 [00:09<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.76it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.50it/s] [Step 4] Load audio; Length of mel chunks: 770 [Step 5] Reference Enhancement: 0%| | 0/125 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/125 [00:01<02:18, 1.12s/it] [Step 5] Reference Enhancement: 2%|▏ | 2/125 [00:01<01:06, 1.85it/s] [Step 5] Reference Enhancement: 2%|▏ | 3/125 [00:01<00:43, 2.81it/s] [Step 5] Reference Enhancement: 3%|▎ | 4/125 [00:01<00:32, 3.72it/s] [Step 5] Reference Enhancement: 4%|▍ | 5/125 [00:01<00:26, 4.53it/s] [Step 5] Reference Enhancement: 5%|▍ | 6/125 [00:01<00:22, 5.22it/s] [Step 5] Reference Enhancement: 6%|▌ | 7/125 [00:01<00:20, 5.76it/s] [Step 5] Reference Enhancement: 6%|▋ | 8/125 [00:02<00:19, 6.16it/s] [Step 5] Reference Enhancement: 7%|▋ | 9/125 [00:02<00:17, 6.51it/s] [Step 5] Reference Enhancement: 8%|▊ | 10/125 [00:02<00:16, 6.77it/s] [Step 5] Reference Enhancement: 9%|▉ | 11/125 [00:02<00:16, 6.95it/s] [Step 5] Reference Enhancement: 10%|▉ | 12/125 [00:02<00:15, 7.10it/s] [Step 5] Reference Enhancement: 10%|█ | 13/125 [00:02<00:15, 7.18it/s] [Step 5] Reference Enhancement: 11%|█ | 14/125 [00:02<00:15, 7.24it/s] [Step 5] Reference Enhancement: 12%|█▏ | 15/125 [00:03<00:15, 7.24it/s] [Step 5] Reference Enhancement: 13%|█▎ | 16/125 [00:03<00:14, 7.28it/s] [Step 5] Reference Enhancement: 14%|█▎ | 17/125 [00:03<00:14, 7.33it/s] [Step 5] Reference Enhancement: 14%|█▍ | 18/125 [00:03<00:14, 7.33it/s] [Step 5] Reference Enhancement: 15%|█▌ | 19/125 [00:03<00:14, 7.36it/s] [Step 5] Reference Enhancement: 16%|█▌ | 20/125 [00:03<00:14, 7.38it/s] [Step 5] Reference Enhancement: 17%|█▋ | 21/125 [00:03<00:14, 7.39it/s] [Step 5] Reference Enhancement: 18%|█▊ | 22/125 [00:03<00:13, 7.38it/s] [Step 5] Reference Enhancement: 18%|█▊ | 23/125 [00:04<00:13, 7.36it/s] [Step 5] Reference Enhancement: 19%|█▉ | 24/125 [00:04<00:13, 7.38it/s] [Step 5] Reference Enhancement: 20%|██ | 25/125 [00:04<00:13, 7.38it/s] [Step 5] Reference Enhancement: 21%|██ | 26/125 [00:04<00:13, 7.39it/s] [Step 5] Reference Enhancement: 22%|██▏ | 27/125 [00:04<00:13, 7.41it/s] [Step 5] Reference Enhancement: 22%|██▏ | 28/125 [00:04<00:13, 7.37it/s] [Step 5] Reference Enhancement: 23%|██▎ | 29/125 [00:04<00:12, 7.39it/s] [Step 5] Reference Enhancement: 24%|██▍ | 30/125 [00:05<00:12, 7.39it/s] [Step 5] Reference Enhancement: 25%|██▍ | 31/125 [00:05<00:12, 7.39it/s] [Step 5] Reference Enhancement: 26%|██▌ | 32/125 [00:05<00:12, 7.38it/s] [Step 5] Reference Enhancement: 26%|██▋ | 33/125 [00:05<00:12, 7.37it/s] [Step 5] Reference Enhancement: 27%|██▋ | 34/125 [00:05<00:12, 7.38it/s] [Step 5] Reference Enhancement: 28%|██▊ | 35/125 [00:05<00:12, 7.40it/s] [Step 5] Reference Enhancement: 29%|██▉ | 36/125 [00:05<00:12, 7.39it/s] [Step 5] Reference Enhancement: 30%|██▉ | 37/125 [00:05<00:11, 7.38it/s] [Step 5] Reference Enhancement: 30%|███ | 38/125 [00:06<00:11, 7.36it/s] [Step 5] Reference Enhancement: 31%|███ | 39/125 [00:06<00:11, 7.37it/s] [Step 5] Reference Enhancement: 32%|███▏ | 40/125 [00:06<00:11, 7.36it/s] [Step 5] Reference Enhancement: 33%|███▎ | 41/125 [00:06<00:11, 7.38it/s] [Step 5] Reference Enhancement: 34%|███▎ | 42/125 [00:06<00:11, 7.39it/s] [Step 5] Reference Enhancement: 34%|███▍ | 43/125 [00:06<00:11, 7.39it/s] [Step 5] Reference Enhancement: 35%|███▌ | 44/125 [00:06<00:11, 7.34it/s] [Step 5] Reference Enhancement: 36%|███▌ | 45/125 [00:07<00:10, 7.32it/s] [Step 5] Reference Enhancement: 37%|███▋ | 46/125 [00:07<00:10, 7.33it/s] [Step 5] Reference Enhancement: 38%|███▊ | 47/125 [00:07<00:10, 7.35it/s] [Step 5] Reference Enhancement: 38%|███▊ | 48/125 [00:07<00:10, 7.36it/s] [Step 5] Reference Enhancement: 39%|███▉ | 49/125 [00:07<00:10, 7.37it/s] [Step 5] Reference Enhancement: 40%|████ | 50/125 [00:07<00:10, 7.36it/s] [Step 5] Reference Enhancement: 41%|████ | 51/125 [00:07<00:10, 7.34it/s] [Step 5] Reference Enhancement: 42%|████▏ | 52/125 [00:08<00:09, 7.30it/s] [Step 5] Reference Enhancement: 42%|████▏ | 53/125 [00:08<00:09, 7.34it/s] [Step 5] Reference Enhancement: 43%|████▎ | 54/125 [00:08<00:09, 7.33it/s] [Step 5] Reference Enhancement: 44%|████▍ | 55/125 [00:08<00:09, 7.35it/s] [Step 5] Reference Enhancement: 45%|████▍ | 56/125 [00:08<00:09, 7.38it/s] [Step 5] Reference Enhancement: 46%|████▌ | 57/125 [00:08<00:09, 7.40it/s] [Step 5] Reference Enhancement: 46%|████▋ | 58/125 [00:08<00:09, 7.38it/s] [Step 5] Reference Enhancement: 47%|████▋ | 59/125 [00:08<00:08, 7.36it/s] [Step 5] Reference Enhancement: 48%|████▊ | 60/125 [00:09<00:08, 7.35it/s] [Step 5] Reference Enhancement: 49%|████▉ | 61/125 [00:09<00:08, 7.36it/s] [Step 5] Reference Enhancement: 50%|████▉ | 62/125 [00:09<00:08, 7.37it/s] [Step 5] Reference Enhancement: 50%|█████ | 63/125 [00:09<00:08, 7.38it/s] [Step 5] Reference Enhancement: 51%|█████ | 64/125 [00:09<00:08, 7.40it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 65/125 [00:09<00:08, 7.38it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 66/125 [00:09<00:08, 7.35it/s] [Step 5] Reference Enhancement: 54%|█████▎ | 67/125 [00:10<00:07, 7.35it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 68/125 [00:10<00:07, 7.37it/s] [Step 5] Reference Enhancement: 55%|█████▌ | 69/125 [00:10<00:07, 7.37it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 70/125 [00:10<00:07, 7.39it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 71/125 [00:10<00:07, 7.39it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 72/125 [00:10<00:07, 7.40it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 73/125 [00:10<00:07, 7.40it/s] [Step 5] Reference Enhancement: 59%|█████▉ | 74/125 [00:11<00:06, 7.36it/s] [Step 5] Reference Enhancement: 60%|██████ | 75/125 [00:11<00:06, 7.35it/s] [Step 5] Reference Enhancement: 61%|██████ | 76/125 [00:11<00:06, 7.36it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 77/125 [00:11<00:06, 7.37it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 78/125 [00:11<00:06, 7.38it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 79/125 [00:11<00:06, 7.39it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 80/125 [00:11<00:06, 7.37it/s] [Step 5] Reference Enhancement: 65%|██████▍ | 81/125 [00:11<00:05, 7.37it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 82/125 [00:12<00:05, 7.37it/s] [Step 5] Reference Enhancement: 66%|██████▋ | 83/125 [00:12<00:05, 7.38it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 84/125 [00:12<00:05, 7.37it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 85/125 [00:12<00:05, 7.38it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 86/125 [00:12<00:05, 7.40it/s] [Step 5] Reference Enhancement: 70%|██████▉ | 87/125 [00:12<00:05, 7.38it/s] [Step 5] Reference Enhancement: 70%|███████ | 88/125 [00:12<00:05, 7.38it/s] [Step 5] Reference Enhancement: 71%|███████ | 89/125 [00:13<00:04, 7.37it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 90/125 [00:13<00:04, 7.37it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 91/125 [00:13<00:04, 7.36it/s] [Step 5] Reference Enhancement: 74%|███████▎ | 92/125 [00:13<00:04, 7.37it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 93/125 [00:13<00:04, 7.38it/s] [Step 5] Reference Enhancement: 75%|███████▌ | 94/125 [00:13<00:04, 7.38it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 95/125 [00:13<00:04, 7.39it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 96/125 [00:14<00:03, 7.40it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 97/125 [00:14<00:03, 7.37it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 98/125 [00:14<00:03, 7.37it/s] [Step 5] Reference Enhancement: 79%|███████▉ | 99/125 [00:14<00:03, 7.36it/s] [Step 5] Reference Enhancement: 80%|████████ | 100/125 [00:14<00:03, 7.35it/s] [Step 5] Reference Enhancement: 81%|████████ | 101/125 [00:14<00:03, 7.37it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 102/125 [00:14<00:03, 7.38it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 103/125 [00:14<00:02, 7.38it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 104/125 [00:15<00:02, 7.31it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 105/125 [00:15<00:02, 7.33it/s] [Step 5] Reference Enhancement: 85%|████████▍ | 106/125 [00:15<00:02, 7.33it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 107/125 [00:15<00:02, 7.35it/s] [Step 5] Reference Enhancement: 86%|████████▋ | 108/125 [00:15<00:02, 7.37it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 109/125 [00:15<00:02, 7.37it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 110/125 [00:15<00:02, 7.37it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 111/125 [00:16<00:01, 7.36it/s] [Step 5] Reference Enhancement: 90%|████████▉ | 112/125 [00:16<00:01, 7.36it/s] [Step 5] Reference Enhancement: 90%|█████████ | 113/125 [00:16<00:01, 7.34it/s] [Step 5] Reference Enhancement: 91%|█████████ | 114/125 [00:16<00:01, 7.34it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 115/125 [00:16<00:01, 7.35it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 116/125 [00:16<00:01, 7.36it/s] [Step 5] Reference Enhancement: 94%|█████████▎| 117/125 [00:16<00:01, 7.36it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 118/125 [00:16<00:00, 7.35it/s] [Step 5] Reference Enhancement: 95%|█████████▌| 119/125 [00:17<00:00, 7.35it/s] [Step 5] Reference Enhancement: 96%|█████████▌| 120/125 [00:17<00:00, 7.36it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 121/125 [00:17<00:00, 7.38it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 122/125 [00:17<00:00, 7.38it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 123/125 [00:17<00:00, 7.36it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 124/125 [00:17<00:00, 7.36it/s] [Step 5] Reference Enhancement: 100%|██████████| 125/125 [00:17<00:00, 7.36it/s] [Step 5] Reference Enhancement: 100%|██████████| 125/125 [00:17<00:00, 6.97it/s] [Step 6] Lip Synthesis:: 0%| | 0/49 [00:00<?, ?it/s] landmark Det:: 0%| | 0/125 [00:00<?, ?it/s] landmark Det:: 1%| | 1/125 [00:00<00:22, 5.47it/s] landmark Det:: 2%|▏ | 2/125 [00:00<00:41, 2.98it/s] landmark Det:: 7%|▋ | 9/125 [00:00<00:07, 16.12it/s] landmark Det:: 13%|█▎ | 16/125 [00:00<00:03, 27.67it/s] landmark Det:: 18%|█▊ | 23/125 [00:00<00:02, 37.40it/s] landmark Det:: 24%|██▍ | 30/125 [00:01<00:02, 45.18it/s] landmark Det:: 30%|██▉ | 37/125 [00:01<00:01, 51.24it/s] landmark Det:: 35%|███▌ | 44/125 [00:01<00:01, 55.77it/s] landmark Det:: 41%|████ | 51/125 [00:01<00:01, 58.95it/s] landmark Det:: 46%|████▋ | 58/125 [00:01<00:01, 61.47it/s] landmark Det:: 52%|█████▏ | 65/125 [00:01<00:00, 62.27it/s] landmark Det:: 58%|█████▊ | 72/125 [00:01<00:00, 63.70it/s] landmark Det:: 63%|██████▎ | 79/125 [00:01<00:00, 64.75it/s] landmark Det:: 69%|██████▉ | 86/125 [00:01<00:00, 65.32it/s] landmark Det:: 74%|███████▍ | 93/125 [00:01<00:00, 65.96it/s] landmark Det:: 80%|████████ | 100/125 [00:02<00:00, 66.38it/s] landmark Det:: 86%|████████▌ | 107/125 [00:02<00:00, 66.59it/s] landmark Det:: 91%|█████████ | 114/125 [00:02<00:00, 66.84it/s] landmark Det:: 97%|█████████▋| 121/125 [00:02<00:00, 66.59it/s] landmark Det:: 100%|██████████| 125/125 [00:02<00:00, 50.71it/s] 0%| | 0/125 [00:00<?, ?it/s] 100%|██████████| 125/125 [00:00<00:00, 20998.40it/s] 0%| | 0/125 [00:00<?, ?it/s] 52%|█████▏ | 65/125 [00:00<00:00, 646.91it/s] 100%|██████████| 125/125 [00:00<00:00, 647.24it/s] FaceDet:: 0%| | 0/32 [00:00<?, ?it/s] FaceDet:: 3%|▎ | 1/32 [00:01<00:36, 1.16s/it] FaceDet:: 6%|▋ | 2/32 [00:01<00:18, 1.59it/s] FaceDet:: 9%|▉ | 3/32 [00:01<00:13, 2.20it/s] FaceDet:: 12%|█▎ | 4/32 [00:01<00:10, 2.64it/s] FaceDet:: 16%|█▌ | 5/32 [00:02<00:08, 3.01it/s] FaceDet:: 19%|█▉ | 6/32 [00:02<00:07, 3.42it/s] FaceDet:: 22%|██▏ | 7/32 [00:02<00:07, 3.52it/s] FaceDet:: 25%|██▌ | 8/32 [00:02<00:06, 3.60it/s] FaceDet:: 28%|██▊ | 9/32 [00:03<00:06, 3.70it/s] FaceDet:: 31%|███▏ | 10/32 [00:03<00:05, 3.86it/s] FaceDet:: 34%|███▍ | 11/32 [00:03<00:05, 3.94it/s] FaceDet:: 38%|███▊ | 12/32 [00:03<00:05, 3.85it/s] FaceDet:: 41%|████ | 13/32 [00:04<00:04, 3.92it/s] FaceDet:: 44%|████▍ | 14/32 [00:04<00:04, 4.12it/s] FaceDet:: 47%|████▋ | 15/32 [00:04<00:04, 4.07it/s] FaceDet:: 50%|█████ | 16/32 [00:04<00:04, 3.99it/s] FaceDet:: 53%|█████▎ | 17/32 [00:05<00:03, 4.02it/s] FaceDet:: 56%|█████▋ | 18/32 [00:05<00:03, 4.21it/s] FaceDet:: 59%|█████▉ | 19/32 [00:05<00:03, 4.09it/s] FaceDet:: 62%|██████▎ | 20/32 [00:05<00:03, 3.97it/s] FaceDet:: 66%|██████▌ | 21/32 [00:06<00:02, 3.91it/s] FaceDet:: 69%|██████▉ | 22/32 [00:06<00:02, 3.98it/s] FaceDet:: 72%|███████▏ | 23/32 [00:06<00:02, 3.92it/s] FaceDet:: 75%|███████▌ | 24/32 [00:06<00:02, 3.84it/s] FaceDet:: 78%|███████▊ | 25/32 [00:07<00:01, 3.91it/s] FaceDet:: 81%|████████▏ | 26/32 [00:07<00:01, 4.03it/s] FaceDet:: 84%|████████▍ | 27/32 [00:07<00:01, 4.00it/s] FaceDet:: 88%|████████▊ | 28/32 [00:07<00:01, 3.94it/s] FaceDet:: 91%|█████████ | 29/32 [00:08<00:00, 3.88it/s] FaceDet:: 94%|█████████▍| 30/32 [00:08<00:00, 4.04it/s] FaceDet:: 97%|█████████▋| 31/32 [00:08<00:00, 3.93it/s] FaceDet:: 100%|██████████| 32/32 [00:09<00:00, 3.25it/s] FaceDet:: 100%|██████████| 32/32 [00:09<00:00, 3.51it/s] [Step 6] Lip Synthesis:: 2%|▏ | 1/49 [00:27<21:45, 27.19s/it] [Step 6] Lip Synthesis:: 4%|▍ | 2/49 [00:33<11:54, 15.20s/it] [Step 6] Lip Synthesis:: 6%|▌ | 3/49 [00:40<08:43, 11.38s/it] [Step 6] Lip Synthesis:: 8%|▊ | 4/49 [00:47<07:12, 9.61s/it] [Step 6] Lip Synthesis:: 10%|█ | 5/49 [00:54<06:19, 8.64s/it] [Step 6] Lip Synthesis:: 12%|█▏ | 6/49 [01:01<05:48, 8.12s/it] [Step 6] Lip Synthesis:: 14%|█▍ | 7/49 [01:08<05:25, 7.74s/it] [Step 6] Lip Synthesis:: 16%|█▋ | 8/49 [01:15<05:06, 7.48s/it] [Step 6] Lip Synthesis:: 18%|█▊ | 9/49 [01:22<04:52, 7.31s/it] [Step 6] Lip Synthesis:: 20%|██ | 10/49 [01:29<04:39, 7.18s/it] [Step 6] Lip Synthesis:: 22%|██▏ | 11/49 [01:36<04:29, 7.10s/it] [Step 6] Lip Synthesis:: 24%|██▍ | 12/49 [01:43<04:20, 7.03s/it] [Step 6] Lip Synthesis:: 27%|██▋ | 13/49 [01:50<04:11, 6.99s/it] [Step 6] Lip Synthesis:: 29%|██▊ | 14/49 [01:57<04:03, 6.96s/it] [Step 6] Lip Synthesis:: 31%|███ | 15/49 [02:03<03:56, 6.95s/it] [Step 6] Lip Synthesis:: 33%|███▎ | 16/49 [02:10<03:49, 6.95s/it] [Step 6] Lip Synthesis:: 35%|███▍ | 17/49 [02:17<03:41, 6.94s/it] [Step 6] Lip Synthesis:: 37%|███▋ | 18/49 [02:24<03:35, 6.94s/it] [Step 6] Lip Synthesis:: 39%|███▉ | 19/49 [02:31<03:28, 6.94s/it] [Step 6] Lip Synthesis:: 41%|████ | 20/49 [02:38<03:21, 6.94s/it] [Step 6] Lip Synthesis:: 43%|████▎ | 21/49 [02:45<03:14, 6.95s/it] [Step 6] Lip Synthesis:: 45%|████▍ | 22/49 [02:52<03:07, 6.93s/it] [Step 6] Lip Synthesis:: 47%|████▋ | 23/49 [02:59<03:00, 6.92s/it] [Step 6] Lip Synthesis:: 49%|████▉ | 24/49 [03:06<02:53, 6.93s/it] [Step 6] Lip Synthesis:: 51%|█████ | 25/49 [03:13<02:46, 6.93s/it] [Step 6] Lip Synthesis:: 53%|█████▎ | 26/49 [03:20<02:39, 6.93s/it] [Step 6] Lip Synthesis:: 55%|█████▌ | 27/49 [03:27<02:32, 6.92s/it] [Step 6] Lip Synthesis:: 57%|█████▋ | 28/49 [03:33<02:25, 6.91s/it] [Step 6] Lip Synthesis:: 59%|█████▉ | 29/49 [03:40<02:18, 6.91s/it] [Step 6] Lip Synthesis:: 61%|██████ | 30/49 [03:47<02:11, 6.92s/it] [Step 6] Lip Synthesis:: 63%|██████▎ | 31/49 [03:54<02:04, 6.92s/it] [Step 6] Lip Synthesis:: 65%|██████▌ | 32/49 [04:01<01:57, 6.91s/it] [Step 6] Lip Synthesis:: 67%|██████▋ | 33/49 [04:08<01:50, 6.92s/it] [Step 6] Lip Synthesis:: 69%|██████▉ | 34/49 [04:15<01:43, 6.92s/it] [Step 6] Lip Synthesis:: 71%|███████▏ | 35/49 [04:22<01:36, 6.92s/it] [Step 6] Lip Synthesis:: 73%|███████▎ | 36/49 [04:29<01:29, 6.92s/it] [Step 6] Lip Synthesis:: 76%|███████▌ | 37/49 [04:36<01:23, 6.92s/it] [Step 6] Lip Synthesis:: 78%|███████▊ | 38/49 [04:43<01:16, 6.93s/it] [Step 6] Lip Synthesis:: 80%|███████▉ | 39/49 [04:50<01:09, 6.94s/it] [Step 6] Lip Synthesis:: 82%|████████▏ | 40/49 [04:57<01:02, 6.94s/it] [Step 6] Lip Synthesis:: 84%|████████▎ | 41/49 [05:04<00:55, 6.94s/it] [Step 6] Lip Synthesis:: 86%|████████▌ | 42/49 [05:10<00:48, 6.94s/it] [Step 6] Lip Synthesis:: 88%|████████▊ | 43/49 [05:17<00:41, 6.93s/it] [Step 6] Lip Synthesis:: 90%|████████▉ | 44/49 [05:24<00:34, 6.93s/it] [Step 6] Lip Synthesis:: 92%|█████████▏| 45/49 [05:31<00:27, 6.92s/it] [Step 6] Lip Synthesis:: 94%|█████████▍| 46/49 [05:38<00:20, 6.92s/it] [Step 6] Lip Synthesis:: 96%|█████████▌| 47/49 [05:45<00:13, 6.92s/it] [Step 6] Lip Synthesis:: 98%|█████████▊| 48/49 [05:52<00:06, 6.92s/it] [Step 6] Lip Synthesis:: 100%|██████████| 49/49 [05:54<00:00, 5.36s/it] [Step 6] Lip Synthesis:: 100%|██████████| 49/49 [05:54<00:00, 7.23s/it]Prediction
chenxwh/video-retalking:db5a650cIDaldzxslbu3otdt3qosjbgj76biStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", "input_audio": "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", input_audio: "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", "input_audio": "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", "input_audio": "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2023-11-01T17:26:11.488313Z", "created_at": "2023-11-01T17:21:30.391205Z", "data_removed": false, "error": null, "id": "aldzxslbu3otdt3qosjbgj76bi", "input": { "face": "https://replicate.delivery/pbxt/JnneVKEuPEHG56tEFONFhBWtoieacmuqallTatTjWukK0ufg/2.mp4", "input_audio": "https://replicate.delivery/pbxt/JnneVEjwjObCIZTh65ZxFww4e8KlKSEIo3e5HT8XM6XrKcF7/1.wav" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/125 [00:00<?, ?it/s]\nlandmark Det:: 6%|▌ | 7/125 [00:00<00:01, 62.63it/s]\nlandmark Det:: 11%|█ | 14/125 [00:00<00:01, 64.63it/s]\nlandmark Det:: 17%|█▋ | 21/125 [00:00<00:01, 64.26it/s]\nlandmark Det:: 22%|██▏ | 28/125 [00:00<00:01, 64.56it/s]\nlandmark Det:: 28%|██▊ | 35/125 [00:00<00:01, 62.70it/s]\nlandmark Det:: 34%|███▎ | 42/125 [00:00<00:01, 63.82it/s]\nlandmark Det:: 39%|███▉ | 49/125 [00:00<00:01, 64.73it/s]\nlandmark Det:: 45%|████▍ | 56/125 [00:00<00:01, 65.16it/s]\nlandmark Det:: 50%|█████ | 63/125 [00:00<00:00, 65.96it/s]\nlandmark Det:: 56%|█████▌ | 70/125 [00:01<00:00, 66.20it/s]\nlandmark Det:: 62%|██████▏ | 77/125 [00:01<00:00, 65.84it/s]\nlandmark Det:: 67%|██████▋ | 84/125 [00:01<00:00, 65.70it/s]\nlandmark Det:: 73%|███████▎ | 91/125 [00:01<00:00, 65.85it/s]\nlandmark Det:: 78%|███████▊ | 98/125 [00:01<00:00, 66.24it/s]\nlandmark Det:: 84%|████████▍ | 105/125 [00:01<00:00, 65.17it/s]\nlandmark Det:: 90%|████████▉ | 112/125 [00:01<00:00, 65.57it/s]\nlandmark Det:: 95%|█████████▌| 119/125 [00:01<00:00, 65.98it/s]\nlandmark Det:: 100%|██████████| 125/125 [00:01<00:00, 65.35it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 11%|█ | 14/125 [00:00<00:00, 132.06it/s]\n[Step 2] 3DMM Extraction In Video:: 22%|██▏ | 28/125 [00:00<00:00, 133.53it/s]\n[Step 2] 3DMM Extraction In Video:: 34%|███▎ | 42/125 [00:00<00:00, 134.13it/s]\n[Step 2] 3DMM Extraction In Video:: 45%|████▍ | 56/125 [00:00<00:00, 134.11it/s]\n[Step 2] 3DMM Extraction In Video:: 56%|█████▌ | 70/125 [00:00<00:00, 134.36it/s]\n[Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 84/125 [00:00<00:00, 129.57it/s]\n[Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 98/125 [00:00<00:00, 130.97it/s]\n[Step 2] 3DMM Extraction In Video:: 90%|████████▉ | 112/125 [00:00<00:00, 132.12it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:00<00:00, 132.48it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 2/125 [00:00<00:09, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 3%|▎ | 4/125 [00:00<00:09, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 5%|▍ | 6/125 [00:00<00:09, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 6%|▋ | 8/125 [00:00<00:09, 12.72it/s]\n[Step 3] Stabilize the expression In Video:: 8%|▊ | 10/125 [00:00<00:08, 12.80it/s]\n[Step 3] Stabilize the expression In Video:: 10%|▉ | 12/125 [00:00<00:08, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 11%|█ | 14/125 [00:01<00:08, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 13%|█▎ | 16/125 [00:01<00:08, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 14%|█▍ | 18/125 [00:01<00:08, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 16%|█▌ | 20/125 [00:01<00:08, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 18%|█▊ | 22/125 [00:01<00:07, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 19%|█▉ | 24/125 [00:01<00:07, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 21%|██ | 26/125 [00:02<00:07, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 22%|██▏ | 28/125 [00:02<00:07, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 24%|██▍ | 30/125 [00:02<00:07, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▌ | 32/125 [00:02<00:07, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 27%|██▋ | 34/125 [00:02<00:07, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 29%|██▉ | 36/125 [00:02<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 30%|███ | 38/125 [00:02<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 32%|███▏ | 40/125 [00:03<00:06, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 34%|███▎ | 42/125 [00:03<00:06, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 35%|███▌ | 44/125 [00:03<00:06, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 37%|███▋ | 46/125 [00:03<00:06, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 48/125 [00:03<00:06, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 40%|████ | 50/125 [00:03<00:05, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 42%|████▏ | 52/125 [00:04<00:05, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 43%|████▎ | 54/125 [00:04<00:05, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 45%|████▍ | 56/125 [00:04<00:05, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 46%|████▋ | 58/125 [00:04<00:05, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 48%|████▊ | 60/125 [00:04<00:05, 12.77it/s]\n[Step 3] Stabilize the expression In Video:: 50%|████▉ | 62/125 [00:04<00:04, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 51%|█████ | 64/125 [00:04<00:04, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 53%|█████▎ | 66/125 [00:05<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▍ | 68/125 [00:05<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 56%|█████▌ | 70/125 [00:05<00:04, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 58%|█████▊ | 72/125 [00:05<00:04, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 59%|█████▉ | 74/125 [00:05<00:03, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 61%|██████ | 76/125 [00:05<00:03, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 62%|██████▏ | 78/125 [00:06<00:03, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 64%|██████▍ | 80/125 [00:06<00:03, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▌ | 82/125 [00:06<00:03, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 67%|██████▋ | 84/125 [00:06<00:03, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 69%|██████▉ | 86/125 [00:06<00:03, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 70%|███████ | 88/125 [00:06<00:02, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 72%|███████▏ | 90/125 [00:06<00:02, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 74%|███████▎ | 92/125 [00:07<00:02, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 75%|███████▌ | 94/125 [00:07<00:02, 12.95it/s]\n[Step 3] Stabilize the expression In Video:: 77%|███████▋ | 96/125 [00:07<00:02, 12.95it/s]\n[Step 3] Stabilize the expression In Video:: 78%|███████▊ | 98/125 [00:07<00:02, 12.96it/s]\n[Step 3] Stabilize the expression In Video:: 80%|████████ | 100/125 [00:07<00:01, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 102/125 [00:07<00:01, 12.96it/s]\n[Step 3] Stabilize the expression In Video:: 83%|████████▎ | 104/125 [00:08<00:01, 12.96it/s]\n[Step 3] Stabilize the expression In Video:: 85%|████████▍ | 106/125 [00:08<00:01, 12.96it/s]\n[Step 3] Stabilize the expression In Video:: 86%|████████▋ | 108/125 [00:08<00:01, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 88%|████████▊ | 110/125 [00:08<00:01, 12.95it/s]\n[Step 3] Stabilize the expression In Video:: 90%|████████▉ | 112/125 [00:08<00:01, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 91%|█████████ | 114/125 [00:08<00:00, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 93%|█████████▎| 116/125 [00:08<00:00, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 94%|█████████▍| 118/125 [00:09<00:00, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 96%|█████████▌| 120/125 [00:09<00:00, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 98%|█████████▊| 122/125 [00:09<00:00, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 99%|█████████▉| 124/125 [00:09<00:00, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.90it/s]\n[Step 4] Load audio; Length of mel chunks: 122\n[Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/122 [00:00<00:18, 6.45it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:00<00:17, 6.84it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:00<00:16, 7.03it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:00<00:16, 7.04it/s]\n[Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:00<00:16, 7.03it/s]\n[Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:00<00:16, 7.05it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:01<00:16, 7.04it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:01<00:16, 7.04it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:01<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:01<00:15, 7.11it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:01<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:01<00:15, 7.07it/s]\n[Step 5] Reference Enhancement: 11%|█ | 13/122 [00:01<00:15, 7.08it/s]\n[Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:01<00:15, 7.08it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:02<00:15, 7.12it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:02<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:02<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:02<00:14, 7.08it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:02<00:14, 7.06it/s]\n[Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:02<00:14, 7.02it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:02<00:14, 7.04it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:03<00:14, 7.08it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:03<00:14, 7.05it/s]\n[Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:03<00:13, 7.02it/s]\n[Step 5] Reference Enhancement: 20%|██ | 25/122 [00:03<00:13, 7.05it/s]\n[Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:03<00:13, 7.04it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:03<00:13, 7.04it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:03<00:13, 6.98it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:04<00:13, 6.99it/s]\n[Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:04<00:13, 6.98it/s]\n[Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:04<00:12, 7.04it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:04<00:12, 7.05it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:04<00:12, 7.05it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:04<00:12, 7.04it/s]\n[Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:04<00:12, 7.06it/s]\n[Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:05<00:12, 7.08it/s]\n[Step 5] Reference Enhancement: 30%|███ | 37/122 [00:05<00:12, 7.08it/s]\n[Step 5] Reference Enhancement: 31%|███ | 38/122 [00:05<00:11, 7.06it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:05<00:11, 7.09it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:05<00:11, 7.09it/s]\n[Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:05<00:11, 7.09it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:05<00:11, 7.06it/s]\n[Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:06<00:11, 7.09it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:06<00:10, 7.10it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:06<00:10, 7.05it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:06<00:10, 7.07it/s]\n[Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:06<00:10, 7.08it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:06<00:10, 7.08it/s]\n[Step 5] Reference Enhancement: 40%|████ | 49/122 [00:06<00:10, 7.08it/s]\n[Step 5] Reference Enhancement: 41%|████ | 50/122 [00:07<00:10, 7.11it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:07<00:09, 7.11it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:07<00:09, 7.11it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:07<00:09, 7.09it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:07<00:09, 7.07it/s]\n[Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:07<00:09, 7.08it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:07<00:09, 7.11it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:08<00:09, 7.12it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:08<00:08, 7.12it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:08<00:08, 7.12it/s]\n[Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:08<00:08, 7.15it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:08<00:08, 7.14it/s]\n[Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:08<00:08, 7.16it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:08<00:08, 7.16it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:09<00:08, 7.22it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:09<00:07, 7.21it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:09<00:07, 7.19it/s]\n[Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:09<00:07, 7.19it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:09<00:07, 7.16it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:09<00:07, 7.14it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:09<00:07, 7.13it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:10<00:07, 7.14it/s]\n[Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:10<00:06, 7.15it/s]\n[Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:10<00:06, 7.14it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:10<00:06, 7.11it/s]\n[Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:10<00:06, 7.10it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:10<00:06, 7.17it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:10<00:06, 7.15it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.13it/s]\n[Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:11<00:06, 7.11it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:11<00:05, 7.12it/s]\n[Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:11<00:05, 7.17it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:11<00:05, 7.15it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:11<00:05, 7.09it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:11<00:05, 7.10it/s]\n[Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:11<00:05, 7.12it/s]\n[Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:12<00:05, 7.13it/s]\n[Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:12<00:04, 7.11it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:12<00:04, 7.11it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:12<00:04, 7.12it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:12<00:04, 7.11it/s]\n[Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:12<00:04, 7.11it/s]\n[Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:12<00:04, 7.11it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:13<00:04, 7.11it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:13<00:03, 7.11it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:13<00:03, 7.15it/s]\n[Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:13<00:03, 7.12it/s]\n[Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:13<00:03, 7.11it/s]\n[Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:13<00:03, 7.13it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:13<00:03, 7.13it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:14<00:03, 7.10it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:14<00:02, 7.08it/s]\n[Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:14<00:02, 7.07it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:14<00:02, 7.08it/s]\n[Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:14<00:02, 7.04it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:14<00:02, 7.07it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:14<00:02, 7.08it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:15<00:02, 7.06it/s]\n[Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:15<00:01, 7.09it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:15<00:01, 7.10it/s]\n[Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:15<00:01, 7.11it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:15<00:01, 7.12it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:15<00:01, 7.08it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:15<00:01, 7.07it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:16<00:01, 7.12it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:16<00:00, 7.11it/s]\n[Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:16<00:00, 7.15it/s]\n[Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:16<00:00, 7.15it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:16<00:00, 7.13it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:16<00:00, 7.14it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:16<00:00, 7.16it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:17<00:00, 7.17it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.16it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.10it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/122 [00:00<00:21, 5.50it/s]\u001b[A\nlandmark Det:: 2%|▏ | 2/122 [00:00<00:40, 3.00it/s]\u001b[A\nlandmark Det:: 7%|▋ | 9/122 [00:00<00:07, 16.13it/s]\u001b[A\nlandmark Det:: 13%|█▎ | 16/122 [00:00<00:03, 27.79it/s]\u001b[A\nlandmark Det:: 19%|█▉ | 23/122 [00:00<00:02, 37.54it/s]\u001b[A\nlandmark Det:: 25%|██▍ | 30/122 [00:01<00:02, 45.26it/s]\u001b[A\nlandmark Det:: 30%|███ | 37/122 [00:01<00:01, 51.22it/s]\u001b[A\nlandmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 54.36it/s]\u001b[A\nlandmark Det:: 42%|████▏ | 51/122 [00:01<00:01, 58.16it/s]\u001b[A\nlandmark Det:: 48%|████▊ | 58/122 [00:01<00:01, 60.47it/s]\u001b[A\nlandmark Det:: 53%|█████▎ | 65/122 [00:01<00:00, 62.55it/s]\u001b[A\nlandmark Det:: 59%|█████▉ | 72/122 [00:01<00:00, 64.14it/s]\u001b[A\nlandmark Det:: 65%|██████▍ | 79/122 [00:01<00:00, 65.02it/s]\u001b[A\nlandmark Det:: 70%|███████ | 86/122 [00:01<00:00, 65.87it/s]\u001b[A\nlandmark Det:: 76%|███████▌ | 93/122 [00:01<00:00, 66.49it/s]\u001b[A\nlandmark Det:: 82%|████████▏ | 100/122 [00:02<00:00, 66.88it/s]\u001b[A\nlandmark Det:: 88%|████████▊ | 107/122 [00:02<00:00, 67.14it/s]\u001b[A\nlandmark Det:: 93%|█████████▎| 114/122 [00:02<00:00, 66.10it/s]\u001b[A\nlandmark Det:: 99%|█████████▉| 121/122 [00:02<00:00, 66.64it/s]\u001b[A\nlandmark Det:: 100%|██████████| 122/122 [00:02<00:00, 50.42it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 20910.67it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n 54%|█████▍ | 66/122 [00:00<00:00, 655.27it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 656.65it/s]\nFaceDet:: 0%| | 0/31 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 3%|▎ | 1/31 [00:01<00:31, 1.07s/it]\u001b[A\nFaceDet:: 6%|▋ | 2/31 [00:01<00:16, 1.81it/s]\u001b[A\nFaceDet:: 10%|▉ | 3/31 [00:01<00:11, 2.43it/s]\u001b[A\nFaceDet:: 13%|█▎ | 4/31 [00:01<00:09, 2.87it/s]\u001b[A\nFaceDet:: 16%|█▌ | 5/31 [00:02<00:08, 3.16it/s]\u001b[A\nFaceDet:: 19%|█▉ | 6/31 [00:02<00:07, 3.48it/s]\u001b[A\nFaceDet:: 23%|██▎ | 7/31 [00:02<00:06, 3.58it/s]\u001b[A\nFaceDet:: 26%|██▌ | 8/31 [00:02<00:06, 3.68it/s]\u001b[A\nFaceDet:: 29%|██▉ | 9/31 [00:03<00:05, 3.69it/s]\u001b[A\nFaceDet:: 32%|███▏ | 10/31 [00:03<00:05, 3.97it/s]\u001b[A\nFaceDet:: 35%|███▌ | 11/31 [00:03<00:05, 3.90it/s]\u001b[A\nFaceDet:: 39%|███▊ | 12/31 [00:03<00:04, 3.85it/s]\u001b[A\nFaceDet:: 42%|████▏ | 13/31 [00:04<00:04, 3.81it/s]\u001b[A\nFaceDet:: 45%|████▌ | 14/31 [00:04<00:04, 3.83it/s]\u001b[A\nFaceDet:: 48%|████▊ | 15/31 [00:04<00:04, 3.82it/s]\u001b[A\nFaceDet:: 52%|█████▏ | 16/31 [00:04<00:03, 3.82it/s]\u001b[A\nFaceDet:: 55%|█████▍ | 17/31 [00:05<00:03, 3.85it/s]\u001b[A\nFaceDet:: 58%|█████▊ | 18/31 [00:05<00:03, 3.92it/s]\u001b[A\nFaceDet:: 61%|██████▏ | 19/31 [00:05<00:03, 3.89it/s]\u001b[A\nFaceDet:: 65%|██████▍ | 20/31 [00:05<00:02, 3.82it/s]\u001b[A\nFaceDet:: 68%|██████▊ | 21/31 [00:06<00:02, 3.75it/s]\u001b[A\nFaceDet:: 71%|███████ | 22/31 [00:06<00:02, 3.73it/s]\u001b[A\nFaceDet:: 74%|███████▍ | 23/31 [00:06<00:02, 3.74it/s]\u001b[A\nFaceDet:: 77%|███████▋ | 24/31 [00:06<00:01, 3.71it/s]\u001b[A\nFaceDet:: 81%|████████ | 25/31 [00:07<00:01, 3.86it/s]\u001b[A\nFaceDet:: 84%|████████▍ | 26/31 [00:07<00:01, 3.85it/s]\u001b[A\nFaceDet:: 87%|████████▋ | 27/31 [00:07<00:01, 3.84it/s]\u001b[A\nFaceDet:: 90%|█████████ | 28/31 [00:07<00:00, 3.80it/s]\u001b[A\nFaceDet:: 94%|█████████▎| 29/31 [00:08<00:00, 3.96it/s]\u001b[A\nFaceDet:: 97%|█████████▋| 30/31 [00:08<00:00, 3.85it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:09<00:00, 2.71it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:09<00:00, 3.41it/s]\n[Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:20<02:21, 20.15s/it]\n[Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:26<01:13, 12.21s/it]\n[Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:33<00:48, 9.72s/it]\n[Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:40<00:34, 8.51s/it]\n[Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:46<00:23, 7.85s/it]\n[Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:53<00:14, 7.48s/it]\n[Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [01:00<00:07, 7.22s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:04<00:00, 6.26s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:04<00:00, 8.07s/it]", "metrics": { "predict_time": 100.722522, "total_time": 281.097108 }, "output": "https://replicate.delivery/pbxt/R2UxFuDVjWKsIl4atCUEz7TfWasCOL6XeJj0skGFDCyywD0RA/output.mp4", "started_at": "2023-11-01T17:24:30.765791Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/aldzxslbu3otdt3qosjbgj76bi", "cancel": "https://api.replicate.com/v1/predictions/aldzxslbu3otdt3qosjbgj76bi/cancel" }, "version": "a0dbf0b26be3a3d249473aa11fe197126a05f12e439199a0074151ae1fa47c3c" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/125 [00:00<?, ?it/s] landmark Det:: 6%|▌ | 7/125 [00:00<00:01, 62.63it/s] landmark Det:: 11%|█ | 14/125 [00:00<00:01, 64.63it/s] landmark Det:: 17%|█▋ | 21/125 [00:00<00:01, 64.26it/s] landmark Det:: 22%|██▏ | 28/125 [00:00<00:01, 64.56it/s] landmark Det:: 28%|██▊ | 35/125 [00:00<00:01, 62.70it/s] landmark Det:: 34%|███▎ | 42/125 [00:00<00:01, 63.82it/s] landmark Det:: 39%|███▉ | 49/125 [00:00<00:01, 64.73it/s] landmark Det:: 45%|████▍ | 56/125 [00:00<00:01, 65.16it/s] landmark Det:: 50%|█████ | 63/125 [00:00<00:00, 65.96it/s] landmark Det:: 56%|█████▌ | 70/125 [00:01<00:00, 66.20it/s] landmark Det:: 62%|██████▏ | 77/125 [00:01<00:00, 65.84it/s] landmark Det:: 67%|██████▋ | 84/125 [00:01<00:00, 65.70it/s] landmark Det:: 73%|███████▎ | 91/125 [00:01<00:00, 65.85it/s] landmark Det:: 78%|███████▊ | 98/125 [00:01<00:00, 66.24it/s] landmark Det:: 84%|████████▍ | 105/125 [00:01<00:00, 65.17it/s] landmark Det:: 90%|████████▉ | 112/125 [00:01<00:00, 65.57it/s] landmark Det:: 95%|█████████▌| 119/125 [00:01<00:00, 65.98it/s] landmark Det:: 100%|██████████| 125/125 [00:01<00:00, 65.35it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 11%|█ | 14/125 [00:00<00:00, 132.06it/s] [Step 2] 3DMM Extraction In Video:: 22%|██▏ | 28/125 [00:00<00:00, 133.53it/s] [Step 2] 3DMM Extraction In Video:: 34%|███▎ | 42/125 [00:00<00:00, 134.13it/s] [Step 2] 3DMM Extraction In Video:: 45%|████▍ | 56/125 [00:00<00:00, 134.11it/s] [Step 2] 3DMM Extraction In Video:: 56%|█████▌ | 70/125 [00:00<00:00, 134.36it/s] [Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 84/125 [00:00<00:00, 129.57it/s] [Step 2] 3DMM Extraction In Video:: 78%|███████▊ | 98/125 [00:00<00:00, 130.97it/s] [Step 2] 3DMM Extraction In Video:: 90%|████████▉ | 112/125 [00:00<00:00, 132.12it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 125/125 [00:00<00:00, 132.48it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/125 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 2/125 [00:00<00:09, 12.85it/s] [Step 3] Stabilize the expression In Video:: 3%|▎ | 4/125 [00:00<00:09, 12.82it/s] [Step 3] Stabilize the expression In Video:: 5%|▍ | 6/125 [00:00<00:09, 12.87it/s] [Step 3] Stabilize the expression In Video:: 6%|▋ | 8/125 [00:00<00:09, 12.72it/s] [Step 3] Stabilize the expression In Video:: 8%|▊ | 10/125 [00:00<00:08, 12.80it/s] [Step 3] Stabilize the expression In Video:: 10%|▉ | 12/125 [00:00<00:08, 12.83it/s] [Step 3] Stabilize the expression In Video:: 11%|█ | 14/125 [00:01<00:08, 12.87it/s] [Step 3] Stabilize the expression In Video:: 13%|█▎ | 16/125 [00:01<00:08, 12.91it/s] [Step 3] Stabilize the expression In Video:: 14%|█▍ | 18/125 [00:01<00:08, 12.93it/s] [Step 3] Stabilize the expression In Video:: 16%|█▌ | 20/125 [00:01<00:08, 12.91it/s] [Step 3] Stabilize the expression In Video:: 18%|█▊ | 22/125 [00:01<00:07, 12.92it/s] [Step 3] Stabilize the expression In Video:: 19%|█▉ | 24/125 [00:01<00:07, 12.94it/s] [Step 3] Stabilize the expression In Video:: 21%|██ | 26/125 [00:02<00:07, 12.94it/s] [Step 3] Stabilize the expression In Video:: 22%|██▏ | 28/125 [00:02<00:07, 12.93it/s] [Step 3] Stabilize the expression In Video:: 24%|██▍ | 30/125 [00:02<00:07, 12.94it/s] [Step 3] Stabilize the expression In Video:: 26%|██▌ | 32/125 [00:02<00:07, 12.94it/s] [Step 3] Stabilize the expression In Video:: 27%|██▋ | 34/125 [00:02<00:07, 12.92it/s] [Step 3] Stabilize the expression In Video:: 29%|██▉ | 36/125 [00:02<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 30%|███ | 38/125 [00:02<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 32%|███▏ | 40/125 [00:03<00:06, 12.92it/s] [Step 3] Stabilize the expression In Video:: 34%|███▎ | 42/125 [00:03<00:06, 12.94it/s] [Step 3] Stabilize the expression In Video:: 35%|███▌ | 44/125 [00:03<00:06, 12.92it/s] [Step 3] Stabilize the expression In Video:: 37%|███▋ | 46/125 [00:03<00:06, 12.92it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 48/125 [00:03<00:06, 12.76it/s] [Step 3] Stabilize the expression In Video:: 40%|████ | 50/125 [00:03<00:05, 12.81it/s] [Step 3] Stabilize the expression In Video:: 42%|████▏ | 52/125 [00:04<00:05, 12.79it/s] [Step 3] Stabilize the expression In Video:: 43%|████▎ | 54/125 [00:04<00:05, 12.83it/s] [Step 3] Stabilize the expression In Video:: 45%|████▍ | 56/125 [00:04<00:05, 12.87it/s] [Step 3] Stabilize the expression In Video:: 46%|████▋ | 58/125 [00:04<00:05, 12.89it/s] [Step 3] Stabilize the expression In Video:: 48%|████▊ | 60/125 [00:04<00:05, 12.77it/s] [Step 3] Stabilize the expression In Video:: 50%|████▉ | 62/125 [00:04<00:04, 12.81it/s] [Step 3] Stabilize the expression In Video:: 51%|█████ | 64/125 [00:04<00:04, 12.84it/s] [Step 3] Stabilize the expression In Video:: 53%|█████▎ | 66/125 [00:05<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▍ | 68/125 [00:05<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 56%|█████▌ | 70/125 [00:05<00:04, 12.90it/s] [Step 3] Stabilize the expression In Video:: 58%|█████▊ | 72/125 [00:05<00:04, 12.93it/s] [Step 3] Stabilize the expression In Video:: 59%|█████▉ | 74/125 [00:05<00:03, 12.93it/s] [Step 3] Stabilize the expression In Video:: 61%|██████ | 76/125 [00:05<00:03, 12.92it/s] [Step 3] Stabilize the expression In Video:: 62%|██████▏ | 78/125 [00:06<00:03, 12.92it/s] [Step 3] Stabilize the expression In Video:: 64%|██████▍ | 80/125 [00:06<00:03, 12.86it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▌ | 82/125 [00:06<00:03, 12.87it/s] [Step 3] Stabilize the expression In Video:: 67%|██████▋ | 84/125 [00:06<00:03, 12.86it/s] [Step 3] Stabilize the expression In Video:: 69%|██████▉ | 86/125 [00:06<00:03, 12.88it/s] [Step 3] Stabilize the expression In Video:: 70%|███████ | 88/125 [00:06<00:02, 12.91it/s] [Step 3] Stabilize the expression In Video:: 72%|███████▏ | 90/125 [00:06<00:02, 12.94it/s] [Step 3] Stabilize the expression In Video:: 74%|███████▎ | 92/125 [00:07<00:02, 12.92it/s] [Step 3] Stabilize the expression In Video:: 75%|███████▌ | 94/125 [00:07<00:02, 12.95it/s] [Step 3] Stabilize the expression In Video:: 77%|███████▋ | 96/125 [00:07<00:02, 12.95it/s] [Step 3] Stabilize the expression In Video:: 78%|███████▊ | 98/125 [00:07<00:02, 12.96it/s] [Step 3] Stabilize the expression In Video:: 80%|████████ | 100/125 [00:07<00:01, 12.94it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 102/125 [00:07<00:01, 12.96it/s] [Step 3] Stabilize the expression In Video:: 83%|████████▎ | 104/125 [00:08<00:01, 12.96it/s] [Step 3] Stabilize the expression In Video:: 85%|████████▍ | 106/125 [00:08<00:01, 12.96it/s] [Step 3] Stabilize the expression In Video:: 86%|████████▋ | 108/125 [00:08<00:01, 12.94it/s] [Step 3] Stabilize the expression In Video:: 88%|████████▊ | 110/125 [00:08<00:01, 12.95it/s] [Step 3] Stabilize the expression In Video:: 90%|████████▉ | 112/125 [00:08<00:01, 12.93it/s] [Step 3] Stabilize the expression In Video:: 91%|█████████ | 114/125 [00:08<00:00, 12.92it/s] [Step 3] Stabilize the expression In Video:: 93%|█████████▎| 116/125 [00:08<00:00, 12.89it/s] [Step 3] Stabilize the expression In Video:: 94%|█████████▍| 118/125 [00:09<00:00, 12.90it/s] [Step 3] Stabilize the expression In Video:: 96%|█████████▌| 120/125 [00:09<00:00, 12.93it/s] [Step 3] Stabilize the expression In Video:: 98%|█████████▊| 122/125 [00:09<00:00, 12.93it/s] [Step 3] Stabilize the expression In Video:: 99%|█████████▉| 124/125 [00:09<00:00, 12.93it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 125/125 [00:09<00:00, 12.90it/s] [Step 4] Load audio; Length of mel chunks: 122 [Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/122 [00:00<00:18, 6.45it/s] [Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:00<00:17, 6.84it/s] [Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:00<00:16, 7.03it/s] [Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:00<00:16, 7.04it/s] [Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:00<00:16, 7.03it/s] [Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:00<00:16, 7.05it/s] [Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:01<00:16, 7.04it/s] [Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:01<00:16, 7.04it/s] [Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:01<00:15, 7.09it/s] [Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:01<00:15, 7.11it/s] [Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:01<00:15, 7.09it/s] [Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:01<00:15, 7.07it/s] [Step 5] Reference Enhancement: 11%|█ | 13/122 [00:01<00:15, 7.08it/s] [Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:01<00:15, 7.08it/s] [Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:02<00:15, 7.12it/s] [Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:02<00:14, 7.07it/s] [Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:02<00:14, 7.07it/s] [Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:02<00:14, 7.08it/s] [Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:02<00:14, 7.06it/s] [Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:02<00:14, 7.02it/s] [Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:02<00:14, 7.04it/s] [Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:03<00:14, 7.08it/s] [Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:03<00:14, 7.05it/s] [Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:03<00:13, 7.02it/s] [Step 5] Reference Enhancement: 20%|██ | 25/122 [00:03<00:13, 7.05it/s] [Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:03<00:13, 7.04it/s] [Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:03<00:13, 7.04it/s] [Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:03<00:13, 6.98it/s] [Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:04<00:13, 6.99it/s] [Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:04<00:13, 6.98it/s] [Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:04<00:12, 7.04it/s] [Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:04<00:12, 7.05it/s] [Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:04<00:12, 7.05it/s] [Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:04<00:12, 7.04it/s] [Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:04<00:12, 7.06it/s] [Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:05<00:12, 7.08it/s] [Step 5] Reference Enhancement: 30%|███ | 37/122 [00:05<00:12, 7.08it/s] [Step 5] Reference Enhancement: 31%|███ | 38/122 [00:05<00:11, 7.06it/s] [Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:05<00:11, 7.09it/s] [Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:05<00:11, 7.09it/s] [Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:05<00:11, 7.09it/s] [Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:05<00:11, 7.06it/s] [Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:06<00:11, 7.09it/s] [Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:06<00:10, 7.10it/s] [Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:06<00:10, 7.05it/s] [Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:06<00:10, 7.07it/s] [Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:06<00:10, 7.08it/s] [Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:06<00:10, 7.08it/s] [Step 5] Reference Enhancement: 40%|████ | 49/122 [00:06<00:10, 7.08it/s] [Step 5] Reference Enhancement: 41%|████ | 50/122 [00:07<00:10, 7.11it/s] [Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:07<00:09, 7.11it/s] [Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:07<00:09, 7.11it/s] [Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:07<00:09, 7.09it/s] [Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:07<00:09, 7.07it/s] [Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:07<00:09, 7.08it/s] [Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:07<00:09, 7.11it/s] [Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:08<00:09, 7.12it/s] [Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:08<00:08, 7.12it/s] [Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:08<00:08, 7.12it/s] [Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:08<00:08, 7.15it/s] [Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:08<00:08, 7.14it/s] [Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:08<00:08, 7.16it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:08<00:08, 7.16it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:09<00:08, 7.22it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:09<00:07, 7.21it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:09<00:07, 7.19it/s] [Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:09<00:07, 7.19it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:09<00:07, 7.16it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:09<00:07, 7.14it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:09<00:07, 7.13it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:10<00:07, 7.14it/s] [Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:10<00:06, 7.15it/s] [Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:10<00:06, 7.14it/s] [Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:10<00:06, 7.11it/s] [Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:10<00:06, 7.10it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:10<00:06, 7.17it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:10<00:06, 7.15it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.13it/s] [Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:11<00:06, 7.11it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:11<00:05, 7.12it/s] [Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:11<00:05, 7.17it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:11<00:05, 7.15it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:11<00:05, 7.09it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:11<00:05, 7.10it/s] [Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:11<00:05, 7.12it/s] [Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:12<00:05, 7.13it/s] [Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:12<00:04, 7.11it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:12<00:04, 7.11it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:12<00:04, 7.12it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:12<00:04, 7.11it/s] [Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:12<00:04, 7.11it/s] [Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:12<00:04, 7.11it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:13<00:04, 7.11it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:13<00:03, 7.11it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:13<00:03, 7.15it/s] [Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:13<00:03, 7.12it/s] [Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:13<00:03, 7.11it/s] [Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:13<00:03, 7.13it/s] [Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:13<00:03, 7.13it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:14<00:03, 7.10it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:14<00:02, 7.08it/s] [Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:14<00:02, 7.07it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:14<00:02, 7.08it/s] [Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:14<00:02, 7.04it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:14<00:02, 7.07it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:14<00:02, 7.08it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:15<00:02, 7.06it/s] [Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:15<00:01, 7.09it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:15<00:01, 7.10it/s] [Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:15<00:01, 7.11it/s] [Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:15<00:01, 7.12it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:15<00:01, 7.08it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:15<00:01, 7.07it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:16<00:01, 7.12it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:16<00:00, 7.11it/s] [Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:16<00:00, 7.15it/s] [Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:16<00:00, 7.15it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:16<00:00, 7.13it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:16<00:00, 7.14it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:16<00:00, 7.16it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:17<00:00, 7.17it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.16it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.10it/s] [Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s] landmark Det:: 0%| | 0/122 [00:00<?, ?it/s] landmark Det:: 1%| | 1/122 [00:00<00:21, 5.50it/s] landmark Det:: 2%|▏ | 2/122 [00:00<00:40, 3.00it/s] landmark Det:: 7%|▋ | 9/122 [00:00<00:07, 16.13it/s] landmark Det:: 13%|█▎ | 16/122 [00:00<00:03, 27.79it/s] landmark Det:: 19%|█▉ | 23/122 [00:00<00:02, 37.54it/s] landmark Det:: 25%|██▍ | 30/122 [00:01<00:02, 45.26it/s] landmark Det:: 30%|███ | 37/122 [00:01<00:01, 51.22it/s] landmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 54.36it/s] landmark Det:: 42%|████▏ | 51/122 [00:01<00:01, 58.16it/s] landmark Det:: 48%|████▊ | 58/122 [00:01<00:01, 60.47it/s] landmark Det:: 53%|█████▎ | 65/122 [00:01<00:00, 62.55it/s] landmark Det:: 59%|█████▉ | 72/122 [00:01<00:00, 64.14it/s] landmark Det:: 65%|██████▍ | 79/122 [00:01<00:00, 65.02it/s] landmark Det:: 70%|███████ | 86/122 [00:01<00:00, 65.87it/s] landmark Det:: 76%|███████▌ | 93/122 [00:01<00:00, 66.49it/s] landmark Det:: 82%|████████▏ | 100/122 [00:02<00:00, 66.88it/s] landmark Det:: 88%|████████▊ | 107/122 [00:02<00:00, 67.14it/s] landmark Det:: 93%|█████████▎| 114/122 [00:02<00:00, 66.10it/s] landmark Det:: 99%|█████████▉| 121/122 [00:02<00:00, 66.64it/s] landmark Det:: 100%|██████████| 122/122 [00:02<00:00, 50.42it/s] 0%| | 0/122 [00:00<?, ?it/s] 100%|██████████| 122/122 [00:00<00:00, 20910.67it/s] 0%| | 0/122 [00:00<?, ?it/s] 54%|█████▍ | 66/122 [00:00<00:00, 655.27it/s] 100%|██████████| 122/122 [00:00<00:00, 656.65it/s] FaceDet:: 0%| | 0/31 [00:00<?, ?it/s] FaceDet:: 3%|▎ | 1/31 [00:01<00:31, 1.07s/it] FaceDet:: 6%|▋ | 2/31 [00:01<00:16, 1.81it/s] FaceDet:: 10%|▉ | 3/31 [00:01<00:11, 2.43it/s] FaceDet:: 13%|█▎ | 4/31 [00:01<00:09, 2.87it/s] FaceDet:: 16%|█▌ | 5/31 [00:02<00:08, 3.16it/s] FaceDet:: 19%|█▉ | 6/31 [00:02<00:07, 3.48it/s] FaceDet:: 23%|██▎ | 7/31 [00:02<00:06, 3.58it/s] FaceDet:: 26%|██▌ | 8/31 [00:02<00:06, 3.68it/s] FaceDet:: 29%|██▉ | 9/31 [00:03<00:05, 3.69it/s] FaceDet:: 32%|███▏ | 10/31 [00:03<00:05, 3.97it/s] FaceDet:: 35%|███▌ | 11/31 [00:03<00:05, 3.90it/s] FaceDet:: 39%|███▊ | 12/31 [00:03<00:04, 3.85it/s] FaceDet:: 42%|████▏ | 13/31 [00:04<00:04, 3.81it/s] FaceDet:: 45%|████▌ | 14/31 [00:04<00:04, 3.83it/s] FaceDet:: 48%|████▊ | 15/31 [00:04<00:04, 3.82it/s] FaceDet:: 52%|█████▏ | 16/31 [00:04<00:03, 3.82it/s] FaceDet:: 55%|█████▍ | 17/31 [00:05<00:03, 3.85it/s] FaceDet:: 58%|█████▊ | 18/31 [00:05<00:03, 3.92it/s] FaceDet:: 61%|██████▏ | 19/31 [00:05<00:03, 3.89it/s] FaceDet:: 65%|██████▍ | 20/31 [00:05<00:02, 3.82it/s] FaceDet:: 68%|██████▊ | 21/31 [00:06<00:02, 3.75it/s] FaceDet:: 71%|███████ | 22/31 [00:06<00:02, 3.73it/s] FaceDet:: 74%|███████▍ | 23/31 [00:06<00:02, 3.74it/s] FaceDet:: 77%|███████▋ | 24/31 [00:06<00:01, 3.71it/s] FaceDet:: 81%|████████ | 25/31 [00:07<00:01, 3.86it/s] FaceDet:: 84%|████████▍ | 26/31 [00:07<00:01, 3.85it/s] FaceDet:: 87%|████████▋ | 27/31 [00:07<00:01, 3.84it/s] FaceDet:: 90%|█████████ | 28/31 [00:07<00:00, 3.80it/s] FaceDet:: 94%|█████████▎| 29/31 [00:08<00:00, 3.96it/s] FaceDet:: 97%|█████████▋| 30/31 [00:08<00:00, 3.85it/s] FaceDet:: 100%|██████████| 31/31 [00:09<00:00, 2.71it/s] FaceDet:: 100%|██████████| 31/31 [00:09<00:00, 3.41it/s] [Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:20<02:21, 20.15s/it] [Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:26<01:13, 12.21s/it] [Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:33<00:48, 9.72s/it] [Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:40<00:34, 8.51s/it] [Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:46<00:23, 7.85s/it] [Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:53<00:14, 7.48s/it] [Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [01:00<00:07, 7.22s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:04<00:00, 6.26s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [01:04<00:00, 8.07s/it]Prediction
chenxwh/video-retalking:db5a650cIDdo6wktlbqagabjedcomxkmwxvuStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/JnnkNFQKaM7MWAKKfweQR5Km1TjgivSV3IjwaKVGtiGvzTR6/4.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnkNFzPViBuEh03psz7C7TggZIN8DAvipf3vVI2hvsE0fSg/2.wav" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/JnnkNFQKaM7MWAKKfweQR5Km1TjgivSV3IjwaKVGtiGvzTR6/4.mp4", input_audio: "https://replicate.delivery/pbxt/JnnkNFzPViBuEh03psz7C7TggZIN8DAvipf3vVI2hvsE0fSg/2.wav" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/JnnkNFQKaM7MWAKKfweQR5Km1TjgivSV3IjwaKVGtiGvzTR6/4.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnkNFzPViBuEh03psz7C7TggZIN8DAvipf3vVI2hvsE0fSg/2.wav" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/JnnkNFQKaM7MWAKKfweQR5Km1TjgivSV3IjwaKVGtiGvzTR6/4.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnkNFzPViBuEh03psz7C7TggZIN8DAvipf3vVI2hvsE0fSg/2.wav" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2023-11-01T17:30:49.062407Z", "created_at": "2023-11-01T17:27:42.586607Z", "data_removed": false, "error": null, "id": "do6wktlbqagabjedcomxkmwxvu", "input": { "face": "https://replicate.delivery/pbxt/JnnkNFQKaM7MWAKKfweQR5Km1TjgivSV3IjwaKVGtiGvzTR6/4.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnkNFzPViBuEh03psz7C7TggZIN8DAvipf3vVI2hvsE0fSg/2.wav" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/199 [00:00<?, ?it/s]\nlandmark Det:: 4%|▎ | 7/199 [00:00<00:03, 60.95it/s]\nlandmark Det:: 7%|▋ | 14/199 [00:00<00:02, 64.46it/s]\nlandmark Det:: 11%|█ | 21/199 [00:00<00:02, 66.06it/s]\nlandmark Det:: 14%|█▍ | 28/199 [00:00<00:02, 65.33it/s]\nlandmark Det:: 18%|█▊ | 35/199 [00:00<00:02, 65.49it/s]\nlandmark Det:: 21%|██ | 42/199 [00:00<00:02, 65.65it/s]\nlandmark Det:: 25%|██▍ | 49/199 [00:00<00:02, 65.23it/s]\nlandmark Det:: 28%|██▊ | 56/199 [00:00<00:02, 64.87it/s]\nlandmark Det:: 32%|███▏ | 63/199 [00:00<00:02, 63.36it/s]\nlandmark Det:: 35%|███▌ | 70/199 [00:01<00:02, 63.46it/s]\nlandmark Det:: 39%|███▊ | 77/199 [00:01<00:01, 64.47it/s]\nlandmark Det:: 42%|████▏ | 84/199 [00:01<00:01, 64.34it/s]\nlandmark Det:: 46%|████▌ | 91/199 [00:01<00:01, 64.18it/s]\nlandmark Det:: 49%|████▉ | 98/199 [00:01<00:01, 64.97it/s]\nlandmark Det:: 53%|█████▎ | 105/199 [00:01<00:01, 65.16it/s]\nlandmark Det:: 56%|█████▋ | 112/199 [00:01<00:01, 64.74it/s]\nlandmark Det:: 60%|█████▉ | 119/199 [00:01<00:01, 64.51it/s]\nlandmark Det:: 63%|██████▎ | 126/199 [00:01<00:01, 63.82it/s]\nlandmark Det:: 67%|██████▋ | 133/199 [00:02<00:01, 64.76it/s]\nlandmark Det:: 70%|███████ | 140/199 [00:02<00:00, 65.41it/s]\nlandmark Det:: 74%|███████▍ | 147/199 [00:02<00:00, 65.08it/s]\nlandmark Det:: 77%|███████▋ | 154/199 [00:02<00:00, 64.62it/s]\nlandmark Det:: 81%|████████ | 161/199 [00:02<00:00, 62.77it/s]\nlandmark Det:: 84%|████████▍ | 168/199 [00:02<00:00, 62.87it/s]\nlandmark Det:: 88%|████████▊ | 175/199 [00:02<00:00, 63.09it/s]\nlandmark Det:: 91%|█████████▏| 182/199 [00:02<00:00, 64.05it/s]\nlandmark Det:: 95%|█████████▍| 189/199 [00:02<00:00, 62.42it/s]\nlandmark Det:: 98%|█████████▊| 196/199 [00:03<00:00, 63.24it/s]\nlandmark Det:: 100%|██████████| 199/199 [00:03<00:00, 64.23it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/199 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 7%|▋ | 14/199 [00:00<00:01, 129.82it/s]\n[Step 2] 3DMM Extraction In Video:: 14%|█▍ | 28/199 [00:00<00:01, 131.24it/s]\n[Step 2] 3DMM Extraction In Video:: 21%|██ | 42/199 [00:00<00:01, 131.97it/s]\n[Step 2] 3DMM Extraction In Video:: 28%|██▊ | 56/199 [00:00<00:01, 132.52it/s]\n[Step 2] 3DMM Extraction In Video:: 35%|███▌ | 70/199 [00:00<00:00, 132.31it/s]\n[Step 2] 3DMM Extraction In Video:: 42%|████▏ | 84/199 [00:00<00:00, 132.20it/s]\n[Step 2] 3DMM Extraction In Video:: 49%|████▉ | 98/199 [00:00<00:00, 132.38it/s]\n[Step 2] 3DMM Extraction In Video:: 56%|█████▋ | 112/199 [00:00<00:00, 127.93it/s]\n[Step 2] 3DMM Extraction In Video:: 63%|██████▎ | 126/199 [00:00<00:00, 128.82it/s]\n[Step 2] 3DMM Extraction In Video:: 70%|███████ | 140/199 [00:01<00:00, 129.71it/s]\n[Step 2] 3DMM Extraction In Video:: 77%|███████▋ | 154/199 [00:01<00:00, 130.16it/s]\n[Step 2] 3DMM Extraction In Video:: 84%|████████▍ | 168/199 [00:01<00:00, 130.97it/s]\n[Step 2] 3DMM Extraction In Video:: 91%|█████████▏| 182/199 [00:01<00:00, 131.32it/s]\n[Step 2] 3DMM Extraction In Video:: 98%|█████████▊| 196/199 [00:01<00:00, 131.93it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 199/199 [00:01<00:00, 131.09it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/199 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 1%| | 2/199 [00:00<00:15, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 4/199 [00:00<00:15, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 3%|▎ | 6/199 [00:00<00:14, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 4%|▍ | 8/199 [00:00<00:14, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 5%|▌ | 10/199 [00:00<00:14, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 6%|▌ | 12/199 [00:00<00:14, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 7%|▋ | 14/199 [00:01<00:14, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 8%|▊ | 16/199 [00:01<00:14, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 9%|▉ | 18/199 [00:01<00:13, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 10%|█ | 20/199 [00:01<00:13, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 11%|█ | 22/199 [00:01<00:13, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 12%|█▏ | 24/199 [00:01<00:13, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 13%|█▎ | 26/199 [00:02<00:13, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 14%|█▍ | 28/199 [00:02<00:13, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 15%|█▌ | 30/199 [00:02<00:13, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 16%|█▌ | 32/199 [00:02<00:12, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 17%|█▋ | 34/199 [00:02<00:12, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 18%|█▊ | 36/199 [00:02<00:12, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 19%|█▉ | 38/199 [00:02<00:12, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 20%|██ | 40/199 [00:03<00:12, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 21%|██ | 42/199 [00:03<00:12, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 22%|██▏ | 44/199 [00:03<00:12, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 23%|██▎ | 46/199 [00:03<00:11, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 24%|██▍ | 48/199 [00:03<00:11, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 25%|██▌ | 50/199 [00:03<00:11, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▌ | 52/199 [00:04<00:11, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 27%|██▋ | 54/199 [00:04<00:11, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 28%|██▊ | 56/199 [00:04<00:11, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 29%|██▉ | 58/199 [00:04<00:10, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 30%|███ | 60/199 [00:04<00:10, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 31%|███ | 62/199 [00:04<00:10, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 32%|███▏ | 64/199 [00:04<00:10, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 33%|███▎ | 66/199 [00:05<00:10, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 34%|███▍ | 68/199 [00:05<00:10, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 35%|███▌ | 70/199 [00:05<00:10, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 36%|███▌ | 72/199 [00:05<00:09, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 37%|███▋ | 74/199 [00:05<00:09, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 76/199 [00:05<00:09, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 39%|███▉ | 78/199 [00:06<00:09, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 40%|████ | 80/199 [00:06<00:09, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 41%|████ | 82/199 [00:06<00:09, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 42%|████▏ | 84/199 [00:06<00:08, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 43%|████▎ | 86/199 [00:06<00:09, 12.51it/s]\n[Step 3] Stabilize the expression In Video:: 44%|████▍ | 88/199 [00:06<00:08, 12.63it/s]\n[Step 3] Stabilize the expression In Video:: 45%|████▌ | 90/199 [00:06<00:08, 12.73it/s]\n[Step 3] Stabilize the expression In Video:: 46%|████▌ | 92/199 [00:07<00:08, 12.78it/s]\n[Step 3] Stabilize the expression In Video:: 47%|████▋ | 94/199 [00:07<00:08, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 48%|████▊ | 96/199 [00:07<00:07, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 49%|████▉ | 98/199 [00:07<00:07, 12.78it/s]\n[Step 3] Stabilize the expression In Video:: 50%|█████ | 100/199 [00:07<00:07, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 51%|█████▏ | 102/199 [00:07<00:07, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 52%|█████▏ | 104/199 [00:08<00:07, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 53%|█████▎ | 106/199 [00:08<00:07, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▍ | 108/199 [00:08<00:07, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 55%|█████▌ | 110/199 [00:08<00:06, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 56%|█████▋ | 112/199 [00:08<00:06, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 57%|█████▋ | 114/199 [00:08<00:06, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 58%|█████▊ | 116/199 [00:09<00:06, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 59%|█████▉ | 118/199 [00:09<00:06, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 60%|██████ | 120/199 [00:09<00:06, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 61%|██████▏ | 122/199 [00:09<00:05, 12.95it/s]\n[Step 3] Stabilize the expression In Video:: 62%|██████▏ | 124/199 [00:09<00:05, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 63%|██████▎ | 126/199 [00:09<00:05, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 64%|██████▍ | 128/199 [00:09<00:05, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 65%|██████▌ | 130/199 [00:10<00:05, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▋ | 132/199 [00:10<00:05, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 67%|██████▋ | 134/199 [00:10<00:05, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 68%|██████▊ | 136/199 [00:10<00:04, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 69%|██████▉ | 138/199 [00:10<00:04, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 70%|███████ | 140/199 [00:10<00:04, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 71%|███████▏ | 142/199 [00:11<00:04, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 72%|███████▏ | 144/199 [00:11<00:04, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 73%|███████▎ | 146/199 [00:11<00:04, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 74%|███████▍ | 148/199 [00:11<00:03, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 75%|███████▌ | 150/199 [00:11<00:03, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 76%|███████▋ | 152/199 [00:11<00:03, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 77%|███████▋ | 154/199 [00:11<00:03, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 78%|███████▊ | 156/199 [00:12<00:03, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 79%|███████▉ | 158/199 [00:12<00:03, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 80%|████████ | 160/199 [00:12<00:03, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 81%|████████▏ | 162/199 [00:12<00:02, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 164/199 [00:12<00:02, 12.75it/s]\n[Step 3] Stabilize the expression In Video:: 83%|████████▎ | 166/199 [00:12<00:02, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 84%|████████▍ | 168/199 [00:13<00:02, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 85%|████████▌ | 170/199 [00:13<00:02, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 86%|████████▋ | 172/199 [00:13<00:02, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 87%|████████▋ | 174/199 [00:13<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 88%|████████▊ | 176/199 [00:13<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 89%|████████▉ | 178/199 [00:13<00:01, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 90%|█████████ | 180/199 [00:13<00:01, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 91%|█████████▏| 182/199 [00:14<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 92%|█████████▏| 184/199 [00:14<00:01, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 93%|█████████▎| 186/199 [00:14<00:01, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 94%|█████████▍| 188/199 [00:14<00:00, 12.77it/s]\n[Step 3] Stabilize the expression In Video:: 95%|█████████▌| 190/199 [00:14<00:00, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 96%|█████████▋| 192/199 [00:14<00:00, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 97%|█████████▋| 194/199 [00:15<00:00, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 98%|█████████▊| 196/199 [00:15<00:00, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 99%|█████████▉| 198/199 [00:15<00:00, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 199/199 [00:15<00:00, 12.88it/s]\n[Step 4] Load audio; Length of mel chunks: 147\n[Step 5] Reference Enhancement: 0%| | 0/147 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/147 [00:00<00:22, 6.60it/s]\n[Step 5] Reference Enhancement: 1%|▏ | 2/147 [00:00<00:21, 6.85it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 3/147 [00:00<00:20, 6.95it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 4/147 [00:00<00:20, 6.95it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 5/147 [00:00<00:20, 6.95it/s]\n[Step 5] Reference Enhancement: 4%|▍ | 6/147 [00:00<00:20, 7.01it/s]\n[Step 5] Reference Enhancement: 5%|▍ | 7/147 [00:01<00:19, 7.00it/s]\n[Step 5] Reference Enhancement: 5%|▌ | 8/147 [00:01<00:19, 7.00it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 9/147 [00:01<00:19, 6.98it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 10/147 [00:01<00:19, 6.96it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 11/147 [00:01<00:19, 6.98it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 12/147 [00:01<00:19, 6.96it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 13/147 [00:01<00:19, 6.99it/s]\n[Step 5] Reference Enhancement: 10%|▉ | 14/147 [00:02<00:18, 7.03it/s]\n[Step 5] Reference Enhancement: 10%|█ | 15/147 [00:02<00:18, 7.05it/s]\n[Step 5] Reference Enhancement: 11%|█ | 16/147 [00:02<00:18, 6.99it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 17/147 [00:02<00:18, 7.02it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 18/147 [00:02<00:18, 7.02it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 19/147 [00:02<00:18, 7.04it/s]\n[Step 5] Reference Enhancement: 14%|█▎ | 20/147 [00:02<00:18, 7.00it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 21/147 [00:03<00:17, 7.04it/s]\n[Step 5] Reference Enhancement: 15%|█▍ | 22/147 [00:03<00:17, 7.05it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 23/147 [00:03<00:17, 7.05it/s]\n[Step 5] Reference Enhancement: 16%|█▋ | 24/147 [00:03<00:17, 7.06it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 25/147 [00:03<00:17, 7.01it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 26/147 [00:03<00:17, 7.01it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 27/147 [00:03<00:17, 7.02it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 28/147 [00:03<00:16, 7.02it/s]\n[Step 5] Reference Enhancement: 20%|█▉ | 29/147 [00:04<00:16, 7.00it/s]\n[Step 5] Reference Enhancement: 20%|██ | 30/147 [00:04<00:16, 7.02it/s]\n[Step 5] Reference Enhancement: 21%|██ | 31/147 [00:04<00:16, 7.04it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 32/147 [00:04<00:16, 7.04it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 33/147 [00:04<00:16, 7.00it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 34/147 [00:04<00:16, 6.99it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 35/147 [00:04<00:16, 7.00it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 36/147 [00:05<00:15, 7.03it/s]\n[Step 5] Reference Enhancement: 25%|██▌ | 37/147 [00:05<00:15, 7.05it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 38/147 [00:05<00:15, 7.07it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 39/147 [00:05<00:15, 7.07it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 40/147 [00:05<00:15, 7.04it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 41/147 [00:05<00:15, 7.05it/s]\n[Step 5] Reference Enhancement: 29%|██▊ | 42/147 [00:05<00:15, 7.00it/s]\n[Step 5] Reference Enhancement: 29%|██▉ | 43/147 [00:06<00:14, 6.98it/s]\n[Step 5] Reference Enhancement: 30%|██▉ | 44/147 [00:06<00:14, 7.02it/s]\n[Step 5] Reference Enhancement: 31%|███ | 45/147 [00:06<00:14, 7.01it/s]\n[Step 5] Reference Enhancement: 31%|███▏ | 46/147 [00:06<00:14, 7.03it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 47/147 [00:06<00:14, 7.01it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 48/147 [00:06<00:14, 7.03it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 49/147 [00:06<00:13, 7.02it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 50/147 [00:07<00:13, 7.01it/s]\n[Step 5] Reference Enhancement: 35%|███▍ | 51/147 [00:07<00:13, 7.03it/s]\n[Step 5] Reference Enhancement: 35%|███▌ | 52/147 [00:07<00:13, 7.02it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 53/147 [00:07<00:13, 7.02it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 54/147 [00:07<00:13, 6.95it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 55/147 [00:07<00:13, 6.98it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 56/147 [00:07<00:13, 7.00it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 57/147 [00:08<00:12, 6.99it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 58/147 [00:08<00:12, 7.04it/s]\n[Step 5] Reference Enhancement: 40%|████ | 59/147 [00:08<00:12, 7.01it/s]\n[Step 5] Reference Enhancement: 41%|████ | 60/147 [00:08<00:12, 7.04it/s]\n[Step 5] Reference Enhancement: 41%|████▏ | 61/147 [00:08<00:12, 7.05it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 62/147 [00:08<00:12, 7.04it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 63/147 [00:08<00:11, 7.02it/s]\n[Step 5] Reference Enhancement: 44%|████▎ | 64/147 [00:09<00:11, 7.02it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 65/147 [00:09<00:11, 7.02it/s]\n[Step 5] Reference Enhancement: 45%|████▍ | 66/147 [00:09<00:11, 7.04it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 67/147 [00:09<00:11, 7.05it/s]\n[Step 5] Reference Enhancement: 46%|████▋ | 68/147 [00:09<00:11, 7.03it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 69/147 [00:09<00:11, 7.03it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 70/147 [00:09<00:10, 7.04it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 71/147 [00:10<00:10, 7.02it/s]\n[Step 5] Reference Enhancement: 49%|████▉ | 72/147 [00:10<00:10, 7.03it/s]\n[Step 5] Reference Enhancement: 50%|████▉ | 73/147 [00:10<00:10, 7.07it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 74/147 [00:10<00:10, 7.04it/s]\n[Step 5] Reference Enhancement: 51%|█████ | 75/147 [00:10<00:10, 7.06it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 76/147 [00:10<00:10, 7.07it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 77/147 [00:10<00:09, 7.02it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 78/147 [00:11<00:09, 7.00it/s]\n[Step 5] Reference Enhancement: 54%|█████▎ | 79/147 [00:11<00:09, 7.02it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 80/147 [00:11<00:09, 7.04it/s]\n[Step 5] Reference Enhancement: 55%|█████▌ | 81/147 [00:11<00:09, 7.03it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 82/147 [00:11<00:09, 7.00it/s]\n[Step 5] Reference Enhancement: 56%|█████▋ | 83/147 [00:11<00:09, 6.98it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 84/147 [00:11<00:09, 7.00it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 85/147 [00:12<00:08, 7.04it/s]\n[Step 5] Reference Enhancement: 59%|█████▊ | 86/147 [00:12<00:08, 7.04it/s]\n[Step 5] Reference Enhancement: 59%|█████▉ | 87/147 [00:12<00:08, 7.06it/s]\n[Step 5] Reference Enhancement: 60%|█████▉ | 88/147 [00:12<00:08, 7.07it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 89/147 [00:12<00:08, 7.01it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 90/147 [00:12<00:08, 7.02it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 91/147 [00:12<00:07, 7.01it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 92/147 [00:13<00:07, 7.02it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 93/147 [00:13<00:07, 6.99it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 94/147 [00:13<00:07, 6.97it/s]\n[Step 5] Reference Enhancement: 65%|██████▍ | 95/147 [00:13<00:07, 7.00it/s]\n[Step 5] Reference Enhancement: 65%|██████▌ | 96/147 [00:13<00:07, 6.99it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 97/147 [00:13<00:07, 6.97it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 98/147 [00:13<00:07, 6.95it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 99/147 [00:14<00:06, 6.97it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 100/147 [00:14<00:06, 7.00it/s]\n[Step 5] Reference Enhancement: 69%|██████▊ | 101/147 [00:14<00:06, 6.97it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 102/147 [00:14<00:06, 6.98it/s]\n[Step 5] Reference Enhancement: 70%|███████ | 103/147 [00:14<00:06, 7.01it/s]\n[Step 5] Reference Enhancement: 71%|███████ | 104/147 [00:14<00:06, 7.00it/s]\n[Step 5] Reference Enhancement: 71%|███████▏ | 105/147 [00:14<00:06, 7.00it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 106/147 [00:15<00:05, 7.02it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 107/147 [00:15<00:05, 7.01it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 108/147 [00:15<00:05, 7.01it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 109/147 [00:15<00:05, 7.02it/s]\n[Step 5] Reference Enhancement: 75%|███████▍ | 110/147 [00:15<00:05, 7.04it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 111/147 [00:15<00:05, 7.00it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 112/147 [00:15<00:05, 6.99it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 113/147 [00:16<00:04, 6.98it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 114/147 [00:16<00:04, 7.02it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 115/147 [00:16<00:04, 7.01it/s]\n[Step 5] Reference Enhancement: 79%|███████▉ | 116/147 [00:16<00:04, 7.03it/s]\n[Step 5] Reference Enhancement: 80%|███████▉ | 117/147 [00:16<00:04, 7.05it/s]\n[Step 5] Reference Enhancement: 80%|████████ | 118/147 [00:16<00:04, 7.03it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 119/147 [00:16<00:03, 7.02it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 120/147 [00:17<00:03, 7.02it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 121/147 [00:17<00:03, 7.04it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 122/147 [00:17<00:03, 7.04it/s]\n[Step 5] Reference Enhancement: 84%|████████▎ | 123/147 [00:17<00:03, 7.05it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 124/147 [00:17<00:03, 7.03it/s]\n[Step 5] Reference Enhancement: 85%|████████▌ | 125/147 [00:17<00:03, 6.99it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 126/147 [00:17<00:02, 7.00it/s]\n[Step 5] Reference Enhancement: 86%|████████▋ | 127/147 [00:18<00:02, 7.01it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 128/147 [00:18<00:02, 7.01it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 129/147 [00:18<00:02, 7.03it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 130/147 [00:18<00:02, 7.01it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 131/147 [00:18<00:02, 6.95it/s]\n[Step 5] Reference Enhancement: 90%|████████▉ | 132/147 [00:18<00:02, 6.97it/s]\n[Step 5] Reference Enhancement: 90%|█████████ | 133/147 [00:18<00:01, 7.01it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 134/147 [00:19<00:01, 7.03it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 135/147 [00:19<00:01, 7.02it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 136/147 [00:19<00:01, 7.00it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 137/147 [00:19<00:01, 7.03it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 138/147 [00:19<00:01, 7.03it/s]\n[Step 5] Reference Enhancement: 95%|█████████▍| 139/147 [00:19<00:01, 7.01it/s]\n[Step 5] Reference Enhancement: 95%|█████████▌| 140/147 [00:19<00:00, 7.03it/s]\n[Step 5] Reference Enhancement: 96%|█████████▌| 141/147 [00:20<00:00, 7.02it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 142/147 [00:20<00:00, 7.05it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 143/147 [00:20<00:00, 7.02it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 144/147 [00:20<00:00, 7.01it/s]\n[Step 5] Reference Enhancement: 99%|█████████▊| 145/147 [00:20<00:00, 6.97it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 146/147 [00:20<00:00, 7.01it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 147/147 [00:20<00:00, 7.04it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 147/147 [00:20<00:00, 7.01it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/10 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/147 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/147 [00:00<00:27, 5.36it/s]\u001b[A\nlandmark Det:: 1%|▏ | 2/147 [00:00<00:48, 2.98it/s]\u001b[A\nlandmark Det:: 5%|▌ | 8/147 [00:00<00:09, 14.40it/s]\u001b[A\nlandmark Det:: 10%|█ | 15/147 [00:00<00:05, 26.24it/s]\u001b[A\nlandmark Det:: 15%|█▍ | 22/147 [00:00<00:03, 35.70it/s]\u001b[A\nlandmark Det:: 19%|█▉ | 28/147 [00:01<00:02, 41.66it/s]\u001b[A\nlandmark Det:: 24%|██▍ | 35/147 [00:01<00:02, 47.87it/s]\u001b[A\nlandmark Det:: 29%|██▊ | 42/147 [00:01<00:01, 52.81it/s]\u001b[A\nlandmark Det:: 33%|███▎ | 49/147 [00:01<00:01, 56.77it/s]\u001b[A\nlandmark Det:: 38%|███▊ | 56/147 [00:01<00:01, 58.48it/s]\u001b[A\nlandmark Det:: 43%|████▎ | 63/147 [00:01<00:01, 59.60it/s]\u001b[A\nlandmark Det:: 48%|████▊ | 70/147 [00:01<00:01, 60.72it/s]\u001b[A\nlandmark Det:: 52%|█████▏ | 77/147 [00:01<00:01, 61.70it/s]\u001b[A\nlandmark Det:: 57%|█████▋ | 84/147 [00:01<00:01, 62.77it/s]\u001b[A\nlandmark Det:: 62%|██████▏ | 91/147 [00:02<00:00, 61.95it/s]\u001b[A\nlandmark Det:: 67%|██████▋ | 98/147 [00:02<00:00, 62.86it/s]\u001b[A\nlandmark Det:: 71%|███████▏ | 105/147 [00:02<00:00, 62.60it/s]\u001b[A\nlandmark Det:: 76%|███████▌ | 112/147 [00:02<00:00, 63.19it/s]\u001b[A\nlandmark Det:: 81%|████████ | 119/147 [00:02<00:00, 63.44it/s]\u001b[A\nlandmark Det:: 86%|████████▌ | 126/147 [00:02<00:00, 64.89it/s]\u001b[A\nlandmark Det:: 90%|█████████ | 133/147 [00:02<00:00, 62.73it/s]\u001b[A\nlandmark Det:: 95%|█████████▌| 140/147 [00:02<00:00, 63.43it/s]\u001b[A\nlandmark Det:: 100%|██████████| 147/147 [00:02<00:00, 63.82it/s]\u001b[A\nlandmark Det:: 100%|██████████| 147/147 [00:02<00:00, 50.47it/s]\n 0%| | 0/147 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 147/147 [00:00<00:00, 21065.38it/s]\n 0%| | 0/147 [00:00<?, ?it/s]\u001b[A\n 46%|████▋ | 68/147 [00:00<00:00, 677.32it/s]\u001b[A\n 93%|█████████▎| 137/147 [00:00<00:00, 680.13it/s]\u001b[A\n100%|██████████| 147/147 [00:00<00:00, 674.05it/s]\nFaceDet:: 0%| | 0/37 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 3%|▎ | 1/37 [00:00<00:28, 1.28it/s]\u001b[A\nFaceDet:: 5%|▌ | 2/37 [00:00<00:14, 2.44it/s]\u001b[A\nFaceDet:: 8%|▊ | 3/37 [00:01<00:09, 3.52it/s]\u001b[A\nFaceDet:: 11%|█ | 4/37 [00:01<00:07, 4.37it/s]\u001b[A\nFaceDet:: 14%|█▎ | 5/37 [00:01<00:06, 5.11it/s]\u001b[A\nFaceDet:: 16%|█▌ | 6/37 [00:01<00:05, 5.69it/s]\u001b[A\nFaceDet:: 19%|█▉ | 7/37 [00:01<00:04, 6.16it/s]\u001b[A\nFaceDet:: 22%|██▏ | 8/37 [00:01<00:04, 6.44it/s]\u001b[A\nFaceDet:: 24%|██▍ | 9/37 [00:01<00:04, 6.56it/s]\u001b[A\nFaceDet:: 27%|██▋ | 10/37 [00:02<00:04, 6.72it/s]\u001b[A\nFaceDet:: 30%|██▉ | 11/37 [00:02<00:03, 6.84it/s]\u001b[A\nFaceDet:: 32%|███▏ | 12/37 [00:02<00:03, 6.91it/s]\u001b[A\nFaceDet:: 35%|███▌ | 13/37 [00:02<00:03, 7.03it/s]\u001b[A\nFaceDet:: 38%|███▊ | 14/37 [00:02<00:03, 7.03it/s]\u001b[A\nFaceDet:: 41%|████ | 15/37 [00:02<00:03, 7.11it/s]\u001b[A\nFaceDet:: 43%|████▎ | 16/37 [00:02<00:02, 7.09it/s]\u001b[A\nFaceDet:: 46%|████▌ | 17/37 [00:03<00:02, 7.26it/s]\u001b[A\nFaceDet:: 49%|████▊ | 18/37 [00:03<00:02, 7.27it/s]\u001b[A\nFaceDet:: 51%|█████▏ | 19/37 [00:03<00:02, 7.22it/s]\u001b[A\nFaceDet:: 54%|█████▍ | 20/37 [00:03<00:02, 7.17it/s]\u001b[A\nFaceDet:: 57%|█████▋ | 21/37 [00:03<00:02, 7.19it/s]\u001b[A\nFaceDet:: 59%|█████▉ | 22/37 [00:03<00:02, 7.08it/s]\u001b[A\nFaceDet:: 62%|██████▏ | 23/37 [00:03<00:01, 7.01it/s]\u001b[A\nFaceDet:: 65%|██████▍ | 24/37 [00:03<00:01, 7.20it/s]\u001b[A\nFaceDet:: 68%|██████▊ | 25/37 [00:04<00:01, 7.18it/s]\u001b[A\nFaceDet:: 70%|███████ | 26/37 [00:04<00:01, 7.17it/s]\u001b[A\nFaceDet:: 73%|███████▎ | 27/37 [00:04<00:01, 7.15it/s]\u001b[A\nFaceDet:: 76%|███████▌ | 28/37 [00:04<00:01, 7.18it/s]\u001b[A\nFaceDet:: 78%|███████▊ | 29/37 [00:04<00:01, 7.10it/s]\u001b[A\nFaceDet:: 81%|████████ | 30/37 [00:04<00:00, 7.11it/s]\u001b[A\nFaceDet:: 84%|████████▍ | 31/37 [00:04<00:00, 7.16it/s]\u001b[A\nFaceDet:: 86%|████████▋ | 32/37 [00:05<00:00, 7.13it/s]\u001b[A\nFaceDet:: 89%|████████▉ | 33/37 [00:05<00:00, 7.03it/s]\u001b[A\nFaceDet:: 92%|█████████▏| 34/37 [00:05<00:00, 6.97it/s]\u001b[A\nFaceDet:: 95%|█████████▍| 35/37 [00:05<00:00, 6.99it/s]\u001b[A\nFaceDet:: 97%|█████████▋| 36/37 [00:05<00:00, 6.95it/s]\u001b[A\nFaceDet:: 100%|██████████| 37/37 [00:06<00:00, 3.40it/s]\u001b[A\nFaceDet:: 100%|██████████| 37/37 [00:06<00:00, 5.83it/s]\n[Step 6] Lip Synthesis:: 10%|█ | 1/10 [00:17<02:33, 17.05s/it]\n[Step 6] Lip Synthesis:: 20%|██ | 2/10 [00:22<01:22, 10.34s/it]\n[Step 6] Lip Synthesis:: 30%|███ | 3/10 [00:28<00:57, 8.19s/it]\n[Step 6] Lip Synthesis:: 40%|████ | 4/10 [00:33<00:43, 7.17s/it]\n[Step 6] Lip Synthesis:: 50%|█████ | 5/10 [00:40<00:34, 6.93s/it]\n[Step 6] Lip Synthesis:: 60%|██████ | 6/10 [00:46<00:25, 6.49s/it]\n[Step 6] Lip Synthesis:: 70%|███████ | 7/10 [00:52<00:19, 6.53s/it]\n[Step 6] Lip Synthesis:: 80%|████████ | 8/10 [00:58<00:12, 6.26s/it]\n[Step 6] Lip Synthesis:: 90%|█████████ | 9/10 [01:04<00:06, 6.37s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 10/10 [01:08<00:00, 5.44s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 10/10 [01:08<00:00, 6.83s/it]", "metrics": { "predict_time": 115.985547, "total_time": 186.4758 }, "output": "https://replicate.delivery/pbxt/X1MfGXZNAMSoXyVfFMKE9oFRaSHewuHOuftYes51on09oeAdE/output.mp4", "started_at": "2023-11-01T17:28:53.076860Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/do6wktlbqagabjedcomxkmwxvu", "cancel": "https://api.replicate.com/v1/predictions/do6wktlbqagabjedcomxkmwxvu/cancel" }, "version": "a0dbf0b26be3a3d249473aa11fe197126a05f12e439199a0074151ae1fa47c3c" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/199 [00:00<?, ?it/s] landmark Det:: 4%|▎ | 7/199 [00:00<00:03, 60.95it/s] landmark Det:: 7%|▋ | 14/199 [00:00<00:02, 64.46it/s] landmark Det:: 11%|█ | 21/199 [00:00<00:02, 66.06it/s] landmark Det:: 14%|█▍ | 28/199 [00:00<00:02, 65.33it/s] landmark Det:: 18%|█▊ | 35/199 [00:00<00:02, 65.49it/s] landmark Det:: 21%|██ | 42/199 [00:00<00:02, 65.65it/s] landmark Det:: 25%|██▍ | 49/199 [00:00<00:02, 65.23it/s] landmark Det:: 28%|██▊ | 56/199 [00:00<00:02, 64.87it/s] landmark Det:: 32%|███▏ | 63/199 [00:00<00:02, 63.36it/s] landmark Det:: 35%|███▌ | 70/199 [00:01<00:02, 63.46it/s] landmark Det:: 39%|███▊ | 77/199 [00:01<00:01, 64.47it/s] landmark Det:: 42%|████▏ | 84/199 [00:01<00:01, 64.34it/s] landmark Det:: 46%|████▌ | 91/199 [00:01<00:01, 64.18it/s] landmark Det:: 49%|████▉ | 98/199 [00:01<00:01, 64.97it/s] landmark Det:: 53%|█████▎ | 105/199 [00:01<00:01, 65.16it/s] landmark Det:: 56%|█████▋ | 112/199 [00:01<00:01, 64.74it/s] landmark Det:: 60%|█████▉ | 119/199 [00:01<00:01, 64.51it/s] landmark Det:: 63%|██████▎ | 126/199 [00:01<00:01, 63.82it/s] landmark Det:: 67%|██████▋ | 133/199 [00:02<00:01, 64.76it/s] landmark Det:: 70%|███████ | 140/199 [00:02<00:00, 65.41it/s] landmark Det:: 74%|███████▍ | 147/199 [00:02<00:00, 65.08it/s] landmark Det:: 77%|███████▋ | 154/199 [00:02<00:00, 64.62it/s] landmark Det:: 81%|████████ | 161/199 [00:02<00:00, 62.77it/s] landmark Det:: 84%|████████▍ | 168/199 [00:02<00:00, 62.87it/s] landmark Det:: 88%|████████▊ | 175/199 [00:02<00:00, 63.09it/s] landmark Det:: 91%|█████████▏| 182/199 [00:02<00:00, 64.05it/s] landmark Det:: 95%|█████████▍| 189/199 [00:02<00:00, 62.42it/s] landmark Det:: 98%|█████████▊| 196/199 [00:03<00:00, 63.24it/s] landmark Det:: 100%|██████████| 199/199 [00:03<00:00, 64.23it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/199 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 7%|▋ | 14/199 [00:00<00:01, 129.82it/s] [Step 2] 3DMM Extraction In Video:: 14%|█▍ | 28/199 [00:00<00:01, 131.24it/s] [Step 2] 3DMM Extraction In Video:: 21%|██ | 42/199 [00:00<00:01, 131.97it/s] [Step 2] 3DMM Extraction In Video:: 28%|██▊ | 56/199 [00:00<00:01, 132.52it/s] [Step 2] 3DMM Extraction In Video:: 35%|███▌ | 70/199 [00:00<00:00, 132.31it/s] [Step 2] 3DMM Extraction In Video:: 42%|████▏ | 84/199 [00:00<00:00, 132.20it/s] [Step 2] 3DMM Extraction In Video:: 49%|████▉ | 98/199 [00:00<00:00, 132.38it/s] [Step 2] 3DMM Extraction In Video:: 56%|█████▋ | 112/199 [00:00<00:00, 127.93it/s] [Step 2] 3DMM Extraction In Video:: 63%|██████▎ | 126/199 [00:00<00:00, 128.82it/s] [Step 2] 3DMM Extraction In Video:: 70%|███████ | 140/199 [00:01<00:00, 129.71it/s] [Step 2] 3DMM Extraction In Video:: 77%|███████▋ | 154/199 [00:01<00:00, 130.16it/s] [Step 2] 3DMM Extraction In Video:: 84%|████████▍ | 168/199 [00:01<00:00, 130.97it/s] [Step 2] 3DMM Extraction In Video:: 91%|█████████▏| 182/199 [00:01<00:00, 131.32it/s] [Step 2] 3DMM Extraction In Video:: 98%|█████████▊| 196/199 [00:01<00:00, 131.93it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 199/199 [00:01<00:00, 131.09it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/199 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 1%| | 2/199 [00:00<00:15, 12.85it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 4/199 [00:00<00:15, 12.85it/s] [Step 3] Stabilize the expression In Video:: 3%|▎ | 6/199 [00:00<00:14, 12.91it/s] [Step 3] Stabilize the expression In Video:: 4%|▍ | 8/199 [00:00<00:14, 12.91it/s] [Step 3] Stabilize the expression In Video:: 5%|▌ | 10/199 [00:00<00:14, 12.93it/s] [Step 3] Stabilize the expression In Video:: 6%|▌ | 12/199 [00:00<00:14, 12.92it/s] [Step 3] Stabilize the expression In Video:: 7%|▋ | 14/199 [00:01<00:14, 12.92it/s] [Step 3] Stabilize the expression In Video:: 8%|▊ | 16/199 [00:01<00:14, 12.94it/s] [Step 3] Stabilize the expression In Video:: 9%|▉ | 18/199 [00:01<00:13, 12.94it/s] [Step 3] Stabilize the expression In Video:: 10%|█ | 20/199 [00:01<00:13, 12.93it/s] [Step 3] Stabilize the expression In Video:: 11%|█ | 22/199 [00:01<00:13, 12.89it/s] [Step 3] Stabilize the expression In Video:: 12%|█▏ | 24/199 [00:01<00:13, 12.87it/s] [Step 3] Stabilize the expression In Video:: 13%|█▎ | 26/199 [00:02<00:13, 12.89it/s] [Step 3] Stabilize the expression In Video:: 14%|█▍ | 28/199 [00:02<00:13, 12.89it/s] [Step 3] Stabilize the expression In Video:: 15%|█▌ | 30/199 [00:02<00:13, 12.90it/s] [Step 3] Stabilize the expression In Video:: 16%|█▌ | 32/199 [00:02<00:12, 12.91it/s] [Step 3] Stabilize the expression In Video:: 17%|█▋ | 34/199 [00:02<00:12, 12.92it/s] [Step 3] Stabilize the expression In Video:: 18%|█▊ | 36/199 [00:02<00:12, 12.93it/s] [Step 3] Stabilize the expression In Video:: 19%|█▉ | 38/199 [00:02<00:12, 12.94it/s] [Step 3] Stabilize the expression In Video:: 20%|██ | 40/199 [00:03<00:12, 12.94it/s] [Step 3] Stabilize the expression In Video:: 21%|██ | 42/199 [00:03<00:12, 12.93it/s] [Step 3] Stabilize the expression In Video:: 22%|██▏ | 44/199 [00:03<00:12, 12.91it/s] [Step 3] Stabilize the expression In Video:: 23%|██▎ | 46/199 [00:03<00:11, 12.91it/s] [Step 3] Stabilize the expression In Video:: 24%|██▍ | 48/199 [00:03<00:11, 12.92it/s] [Step 3] Stabilize the expression In Video:: 25%|██▌ | 50/199 [00:03<00:11, 12.93it/s] [Step 3] Stabilize the expression In Video:: 26%|██▌ | 52/199 [00:04<00:11, 12.87it/s] [Step 3] Stabilize the expression In Video:: 27%|██▋ | 54/199 [00:04<00:11, 12.89it/s] [Step 3] Stabilize the expression In Video:: 28%|██▊ | 56/199 [00:04<00:11, 12.91it/s] [Step 3] Stabilize the expression In Video:: 29%|██▉ | 58/199 [00:04<00:10, 12.92it/s] [Step 3] Stabilize the expression In Video:: 30%|███ | 60/199 [00:04<00:10, 12.90it/s] [Step 3] Stabilize the expression In Video:: 31%|███ | 62/199 [00:04<00:10, 12.92it/s] [Step 3] Stabilize the expression In Video:: 32%|███▏ | 64/199 [00:04<00:10, 12.93it/s] [Step 3] Stabilize the expression In Video:: 33%|███▎ | 66/199 [00:05<00:10, 12.93it/s] [Step 3] Stabilize the expression In Video:: 34%|███▍ | 68/199 [00:05<00:10, 12.87it/s] [Step 3] Stabilize the expression In Video:: 35%|███▌ | 70/199 [00:05<00:10, 12.88it/s] [Step 3] Stabilize the expression In Video:: 36%|███▌ | 72/199 [00:05<00:09, 12.90it/s] [Step 3] Stabilize the expression In Video:: 37%|███▋ | 74/199 [00:05<00:09, 12.90it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 76/199 [00:05<00:09, 12.87it/s] [Step 3] Stabilize the expression In Video:: 39%|███▉ | 78/199 [00:06<00:09, 12.90it/s] [Step 3] Stabilize the expression In Video:: 40%|████ | 80/199 [00:06<00:09, 12.87it/s] [Step 3] Stabilize the expression In Video:: 41%|████ | 82/199 [00:06<00:09, 12.82it/s] [Step 3] Stabilize the expression In Video:: 42%|████▏ | 84/199 [00:06<00:08, 12.82it/s] [Step 3] Stabilize the expression In Video:: 43%|████▎ | 86/199 [00:06<00:09, 12.51it/s] [Step 3] Stabilize the expression In Video:: 44%|████▍ | 88/199 [00:06<00:08, 12.63it/s] [Step 3] Stabilize the expression In Video:: 45%|████▌ | 90/199 [00:06<00:08, 12.73it/s] [Step 3] Stabilize the expression In Video:: 46%|████▌ | 92/199 [00:07<00:08, 12.78it/s] [Step 3] Stabilize the expression In Video:: 47%|████▋ | 94/199 [00:07<00:08, 12.83it/s] [Step 3] Stabilize the expression In Video:: 48%|████▊ | 96/199 [00:07<00:07, 12.88it/s] [Step 3] Stabilize the expression In Video:: 49%|████▉ | 98/199 [00:07<00:07, 12.78it/s] [Step 3] Stabilize the expression In Video:: 50%|█████ | 100/199 [00:07<00:07, 12.81it/s] [Step 3] Stabilize the expression In Video:: 51%|█████▏ | 102/199 [00:07<00:07, 12.86it/s] [Step 3] Stabilize the expression In Video:: 52%|█████▏ | 104/199 [00:08<00:07, 12.88it/s] [Step 3] Stabilize the expression In Video:: 53%|█████▎ | 106/199 [00:08<00:07, 12.91it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▍ | 108/199 [00:08<00:07, 12.91it/s] [Step 3] Stabilize the expression In Video:: 55%|█████▌ | 110/199 [00:08<00:06, 12.81it/s] [Step 3] Stabilize the expression In Video:: 56%|█████▋ | 112/199 [00:08<00:06, 12.84it/s] [Step 3] Stabilize the expression In Video:: 57%|█████▋ | 114/199 [00:08<00:06, 12.88it/s] [Step 3] Stabilize the expression In Video:: 58%|█████▊ | 116/199 [00:09<00:06, 12.87it/s] [Step 3] Stabilize the expression In Video:: 59%|█████▉ | 118/199 [00:09<00:06, 12.91it/s] [Step 3] Stabilize the expression In Video:: 60%|██████ | 120/199 [00:09<00:06, 12.93it/s] [Step 3] Stabilize the expression In Video:: 61%|██████▏ | 122/199 [00:09<00:05, 12.95it/s] [Step 3] Stabilize the expression In Video:: 62%|██████▏ | 124/199 [00:09<00:05, 12.91it/s] [Step 3] Stabilize the expression In Video:: 63%|██████▎ | 126/199 [00:09<00:05, 12.94it/s] [Step 3] Stabilize the expression In Video:: 64%|██████▍ | 128/199 [00:09<00:05, 12.92it/s] [Step 3] Stabilize the expression In Video:: 65%|██████▌ | 130/199 [00:10<00:05, 12.93it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▋ | 132/199 [00:10<00:05, 12.91it/s] [Step 3] Stabilize the expression In Video:: 67%|██████▋ | 134/199 [00:10<00:05, 12.92it/s] [Step 3] Stabilize the expression In Video:: 68%|██████▊ | 136/199 [00:10<00:04, 12.92it/s] [Step 3] Stabilize the expression In Video:: 69%|██████▉ | 138/199 [00:10<00:04, 12.93it/s] [Step 3] Stabilize the expression In Video:: 70%|███████ | 140/199 [00:10<00:04, 12.92it/s] [Step 3] Stabilize the expression In Video:: 71%|███████▏ | 142/199 [00:11<00:04, 12.93it/s] [Step 3] Stabilize the expression In Video:: 72%|███████▏ | 144/199 [00:11<00:04, 12.92it/s] [Step 3] Stabilize the expression In Video:: 73%|███████▎ | 146/199 [00:11<00:04, 12.94it/s] [Step 3] Stabilize the expression In Video:: 74%|███████▍ | 148/199 [00:11<00:03, 12.93it/s] [Step 3] Stabilize the expression In Video:: 75%|███████▌ | 150/199 [00:11<00:03, 12.92it/s] [Step 3] Stabilize the expression In Video:: 76%|███████▋ | 152/199 [00:11<00:03, 12.93it/s] [Step 3] Stabilize the expression In Video:: 77%|███████▋ | 154/199 [00:11<00:03, 12.94it/s] [Step 3] Stabilize the expression In Video:: 78%|███████▊ | 156/199 [00:12<00:03, 12.92it/s] [Step 3] Stabilize the expression In Video:: 79%|███████▉ | 158/199 [00:12<00:03, 12.94it/s] [Step 3] Stabilize the expression In Video:: 80%|████████ | 160/199 [00:12<00:03, 12.94it/s] [Step 3] Stabilize the expression In Video:: 81%|████████▏ | 162/199 [00:12<00:02, 12.81it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 164/199 [00:12<00:02, 12.75it/s] [Step 3] Stabilize the expression In Video:: 83%|████████▎ | 166/199 [00:12<00:02, 12.79it/s] [Step 3] Stabilize the expression In Video:: 84%|████████▍ | 168/199 [00:13<00:02, 12.85it/s] [Step 3] Stabilize the expression In Video:: 85%|████████▌ | 170/199 [00:13<00:02, 12.87it/s] [Step 3] Stabilize the expression In Video:: 86%|████████▋ | 172/199 [00:13<00:02, 12.87it/s] [Step 3] Stabilize the expression In Video:: 87%|████████▋ | 174/199 [00:13<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 88%|████████▊ | 176/199 [00:13<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 89%|████████▉ | 178/199 [00:13<00:01, 12.87it/s] [Step 3] Stabilize the expression In Video:: 90%|█████████ | 180/199 [00:13<00:01, 12.86it/s] [Step 3] Stabilize the expression In Video:: 91%|█████████▏| 182/199 [00:14<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 92%|█████████▏| 184/199 [00:14<00:01, 12.91it/s] [Step 3] Stabilize the expression In Video:: 93%|█████████▎| 186/199 [00:14<00:01, 12.92it/s] [Step 3] Stabilize the expression In Video:: 94%|█████████▍| 188/199 [00:14<00:00, 12.77it/s] [Step 3] Stabilize the expression In Video:: 95%|█████████▌| 190/199 [00:14<00:00, 12.82it/s] [Step 3] Stabilize the expression In Video:: 96%|█████████▋| 192/199 [00:14<00:00, 12.87it/s] [Step 3] Stabilize the expression In Video:: 97%|█████████▋| 194/199 [00:15<00:00, 12.89it/s] [Step 3] Stabilize the expression In Video:: 98%|█████████▊| 196/199 [00:15<00:00, 12.89it/s] [Step 3] Stabilize the expression In Video:: 99%|█████████▉| 198/199 [00:15<00:00, 12.86it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 199/199 [00:15<00:00, 12.88it/s] [Step 4] Load audio; Length of mel chunks: 147 [Step 5] Reference Enhancement: 0%| | 0/147 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/147 [00:00<00:22, 6.60it/s] [Step 5] Reference Enhancement: 1%|▏ | 2/147 [00:00<00:21, 6.85it/s] [Step 5] Reference Enhancement: 2%|▏ | 3/147 [00:00<00:20, 6.95it/s] [Step 5] Reference Enhancement: 3%|▎ | 4/147 [00:00<00:20, 6.95it/s] [Step 5] Reference Enhancement: 3%|▎ | 5/147 [00:00<00:20, 6.95it/s] [Step 5] Reference Enhancement: 4%|▍ | 6/147 [00:00<00:20, 7.01it/s] [Step 5] Reference Enhancement: 5%|▍ | 7/147 [00:01<00:19, 7.00it/s] [Step 5] Reference Enhancement: 5%|▌ | 8/147 [00:01<00:19, 7.00it/s] [Step 5] Reference Enhancement: 6%|▌ | 9/147 [00:01<00:19, 6.98it/s] [Step 5] Reference Enhancement: 7%|▋ | 10/147 [00:01<00:19, 6.96it/s] [Step 5] Reference Enhancement: 7%|▋ | 11/147 [00:01<00:19, 6.98it/s] [Step 5] Reference Enhancement: 8%|▊ | 12/147 [00:01<00:19, 6.96it/s] [Step 5] Reference Enhancement: 9%|▉ | 13/147 [00:01<00:19, 6.99it/s] [Step 5] Reference Enhancement: 10%|▉ | 14/147 [00:02<00:18, 7.03it/s] [Step 5] Reference Enhancement: 10%|█ | 15/147 [00:02<00:18, 7.05it/s] [Step 5] Reference Enhancement: 11%|█ | 16/147 [00:02<00:18, 6.99it/s] [Step 5] Reference Enhancement: 12%|█▏ | 17/147 [00:02<00:18, 7.02it/s] [Step 5] Reference Enhancement: 12%|█▏ | 18/147 [00:02<00:18, 7.02it/s] [Step 5] Reference Enhancement: 13%|█▎ | 19/147 [00:02<00:18, 7.04it/s] [Step 5] Reference Enhancement: 14%|█▎ | 20/147 [00:02<00:18, 7.00it/s] [Step 5] Reference Enhancement: 14%|█▍ | 21/147 [00:03<00:17, 7.04it/s] [Step 5] Reference Enhancement: 15%|█▍ | 22/147 [00:03<00:17, 7.05it/s] [Step 5] Reference Enhancement: 16%|█▌ | 23/147 [00:03<00:17, 7.05it/s] [Step 5] Reference Enhancement: 16%|█▋ | 24/147 [00:03<00:17, 7.06it/s] [Step 5] Reference Enhancement: 17%|█▋ | 25/147 [00:03<00:17, 7.01it/s] [Step 5] Reference Enhancement: 18%|█▊ | 26/147 [00:03<00:17, 7.01it/s] [Step 5] Reference Enhancement: 18%|█▊ | 27/147 [00:03<00:17, 7.02it/s] [Step 5] Reference Enhancement: 19%|█▉ | 28/147 [00:03<00:16, 7.02it/s] [Step 5] Reference Enhancement: 20%|█▉ | 29/147 [00:04<00:16, 7.00it/s] [Step 5] Reference Enhancement: 20%|██ | 30/147 [00:04<00:16, 7.02it/s] [Step 5] Reference Enhancement: 21%|██ | 31/147 [00:04<00:16, 7.04it/s] [Step 5] Reference Enhancement: 22%|██▏ | 32/147 [00:04<00:16, 7.04it/s] [Step 5] Reference Enhancement: 22%|██▏ | 33/147 [00:04<00:16, 7.00it/s] [Step 5] Reference Enhancement: 23%|██▎ | 34/147 [00:04<00:16, 6.99it/s] [Step 5] Reference Enhancement: 24%|██▍ | 35/147 [00:04<00:16, 7.00it/s] [Step 5] Reference Enhancement: 24%|██▍ | 36/147 [00:05<00:15, 7.03it/s] [Step 5] Reference Enhancement: 25%|██▌ | 37/147 [00:05<00:15, 7.05it/s] [Step 5] Reference Enhancement: 26%|██▌ | 38/147 [00:05<00:15, 7.07it/s] [Step 5] Reference Enhancement: 27%|██▋ | 39/147 [00:05<00:15, 7.07it/s] [Step 5] Reference Enhancement: 27%|██▋ | 40/147 [00:05<00:15, 7.04it/s] [Step 5] Reference Enhancement: 28%|██▊ | 41/147 [00:05<00:15, 7.05it/s] [Step 5] Reference Enhancement: 29%|██▊ | 42/147 [00:05<00:15, 7.00it/s] [Step 5] Reference Enhancement: 29%|██▉ | 43/147 [00:06<00:14, 6.98it/s] [Step 5] Reference Enhancement: 30%|██▉ | 44/147 [00:06<00:14, 7.02it/s] [Step 5] Reference Enhancement: 31%|███ | 45/147 [00:06<00:14, 7.01it/s] [Step 5] Reference Enhancement: 31%|███▏ | 46/147 [00:06<00:14, 7.03it/s] [Step 5] Reference Enhancement: 32%|███▏ | 47/147 [00:06<00:14, 7.01it/s] [Step 5] Reference Enhancement: 33%|███▎ | 48/147 [00:06<00:14, 7.03it/s] [Step 5] Reference Enhancement: 33%|███▎ | 49/147 [00:06<00:13, 7.02it/s] [Step 5] Reference Enhancement: 34%|███▍ | 50/147 [00:07<00:13, 7.01it/s] [Step 5] Reference Enhancement: 35%|███▍ | 51/147 [00:07<00:13, 7.03it/s] [Step 5] Reference Enhancement: 35%|███▌ | 52/147 [00:07<00:13, 7.02it/s] [Step 5] Reference Enhancement: 36%|███▌ | 53/147 [00:07<00:13, 7.02it/s] [Step 5] Reference Enhancement: 37%|███▋ | 54/147 [00:07<00:13, 6.95it/s] [Step 5] Reference Enhancement: 37%|███▋ | 55/147 [00:07<00:13, 6.98it/s] [Step 5] Reference Enhancement: 38%|███▊ | 56/147 [00:07<00:13, 7.00it/s] [Step 5] Reference Enhancement: 39%|███▉ | 57/147 [00:08<00:12, 6.99it/s] [Step 5] Reference Enhancement: 39%|███▉ | 58/147 [00:08<00:12, 7.04it/s] [Step 5] Reference Enhancement: 40%|████ | 59/147 [00:08<00:12, 7.01it/s] [Step 5] Reference Enhancement: 41%|████ | 60/147 [00:08<00:12, 7.04it/s] [Step 5] Reference Enhancement: 41%|████▏ | 61/147 [00:08<00:12, 7.05it/s] [Step 5] Reference Enhancement: 42%|████▏ | 62/147 [00:08<00:12, 7.04it/s] [Step 5] Reference Enhancement: 43%|████▎ | 63/147 [00:08<00:11, 7.02it/s] [Step 5] Reference Enhancement: 44%|████▎ | 64/147 [00:09<00:11, 7.02it/s] [Step 5] Reference Enhancement: 44%|████▍ | 65/147 [00:09<00:11, 7.02it/s] [Step 5] Reference Enhancement: 45%|████▍ | 66/147 [00:09<00:11, 7.04it/s] [Step 5] Reference Enhancement: 46%|████▌ | 67/147 [00:09<00:11, 7.05it/s] [Step 5] Reference Enhancement: 46%|████▋ | 68/147 [00:09<00:11, 7.03it/s] [Step 5] Reference Enhancement: 47%|████▋ | 69/147 [00:09<00:11, 7.03it/s] [Step 5] Reference Enhancement: 48%|████▊ | 70/147 [00:09<00:10, 7.04it/s] [Step 5] Reference Enhancement: 48%|████▊ | 71/147 [00:10<00:10, 7.02it/s] [Step 5] Reference Enhancement: 49%|████▉ | 72/147 [00:10<00:10, 7.03it/s] [Step 5] Reference Enhancement: 50%|████▉ | 73/147 [00:10<00:10, 7.07it/s] [Step 5] Reference Enhancement: 50%|█████ | 74/147 [00:10<00:10, 7.04it/s] [Step 5] Reference Enhancement: 51%|█████ | 75/147 [00:10<00:10, 7.06it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 76/147 [00:10<00:10, 7.07it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 77/147 [00:10<00:09, 7.02it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 78/147 [00:11<00:09, 7.00it/s] [Step 5] Reference Enhancement: 54%|█████▎ | 79/147 [00:11<00:09, 7.02it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 80/147 [00:11<00:09, 7.04it/s] [Step 5] Reference Enhancement: 55%|█████▌ | 81/147 [00:11<00:09, 7.03it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 82/147 [00:11<00:09, 7.00it/s] [Step 5] Reference Enhancement: 56%|█████▋ | 83/147 [00:11<00:09, 6.98it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 84/147 [00:11<00:09, 7.00it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 85/147 [00:12<00:08, 7.04it/s] [Step 5] Reference Enhancement: 59%|█████▊ | 86/147 [00:12<00:08, 7.04it/s] [Step 5] Reference Enhancement: 59%|█████▉ | 87/147 [00:12<00:08, 7.06it/s] [Step 5] Reference Enhancement: 60%|█████▉ | 88/147 [00:12<00:08, 7.07it/s] [Step 5] Reference Enhancement: 61%|██████ | 89/147 [00:12<00:08, 7.01it/s] [Step 5] Reference Enhancement: 61%|██████ | 90/147 [00:12<00:08, 7.02it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 91/147 [00:12<00:07, 7.01it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 92/147 [00:13<00:07, 7.02it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 93/147 [00:13<00:07, 6.99it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 94/147 [00:13<00:07, 6.97it/s] [Step 5] Reference Enhancement: 65%|██████▍ | 95/147 [00:13<00:07, 7.00it/s] [Step 5] Reference Enhancement: 65%|██████▌ | 96/147 [00:13<00:07, 6.99it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 97/147 [00:13<00:07, 6.97it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 98/147 [00:13<00:07, 6.95it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 99/147 [00:14<00:06, 6.97it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 100/147 [00:14<00:06, 7.00it/s] [Step 5] Reference Enhancement: 69%|██████▊ | 101/147 [00:14<00:06, 6.97it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 102/147 [00:14<00:06, 6.98it/s] [Step 5] Reference Enhancement: 70%|███████ | 103/147 [00:14<00:06, 7.01it/s] [Step 5] Reference Enhancement: 71%|███████ | 104/147 [00:14<00:06, 7.00it/s] [Step 5] Reference Enhancement: 71%|███████▏ | 105/147 [00:14<00:06, 7.00it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 106/147 [00:15<00:05, 7.02it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 107/147 [00:15<00:05, 7.01it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 108/147 [00:15<00:05, 7.01it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 109/147 [00:15<00:05, 7.02it/s] [Step 5] Reference Enhancement: 75%|███████▍ | 110/147 [00:15<00:05, 7.04it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 111/147 [00:15<00:05, 7.00it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 112/147 [00:15<00:05, 6.99it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 113/147 [00:16<00:04, 6.98it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 114/147 [00:16<00:04, 7.02it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 115/147 [00:16<00:04, 7.01it/s] [Step 5] Reference Enhancement: 79%|███████▉ | 116/147 [00:16<00:04, 7.03it/s] [Step 5] Reference Enhancement: 80%|███████▉ | 117/147 [00:16<00:04, 7.05it/s] [Step 5] Reference Enhancement: 80%|████████ | 118/147 [00:16<00:04, 7.03it/s] [Step 5] Reference Enhancement: 81%|████████ | 119/147 [00:16<00:03, 7.02it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 120/147 [00:17<00:03, 7.02it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 121/147 [00:17<00:03, 7.04it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 122/147 [00:17<00:03, 7.04it/s] [Step 5] Reference Enhancement: 84%|████████▎ | 123/147 [00:17<00:03, 7.05it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 124/147 [00:17<00:03, 7.03it/s] [Step 5] Reference Enhancement: 85%|████████▌ | 125/147 [00:17<00:03, 6.99it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 126/147 [00:17<00:02, 7.00it/s] [Step 5] Reference Enhancement: 86%|████████▋ | 127/147 [00:18<00:02, 7.01it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 128/147 [00:18<00:02, 7.01it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 129/147 [00:18<00:02, 7.03it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 130/147 [00:18<00:02, 7.01it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 131/147 [00:18<00:02, 6.95it/s] [Step 5] Reference Enhancement: 90%|████████▉ | 132/147 [00:18<00:02, 6.97it/s] [Step 5] Reference Enhancement: 90%|█████████ | 133/147 [00:18<00:01, 7.01it/s] [Step 5] Reference Enhancement: 91%|█████████ | 134/147 [00:19<00:01, 7.03it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 135/147 [00:19<00:01, 7.02it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 136/147 [00:19<00:01, 7.00it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 137/147 [00:19<00:01, 7.03it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 138/147 [00:19<00:01, 7.03it/s] [Step 5] Reference Enhancement: 95%|█████████▍| 139/147 [00:19<00:01, 7.01it/s] [Step 5] Reference Enhancement: 95%|█████████▌| 140/147 [00:19<00:00, 7.03it/s] [Step 5] Reference Enhancement: 96%|█████████▌| 141/147 [00:20<00:00, 7.02it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 142/147 [00:20<00:00, 7.05it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 143/147 [00:20<00:00, 7.02it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 144/147 [00:20<00:00, 7.01it/s] [Step 5] Reference Enhancement: 99%|█████████▊| 145/147 [00:20<00:00, 6.97it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 146/147 [00:20<00:00, 7.01it/s] [Step 5] Reference Enhancement: 100%|██████████| 147/147 [00:20<00:00, 7.04it/s] [Step 5] Reference Enhancement: 100%|██████████| 147/147 [00:20<00:00, 7.01it/s] [Step 6] Lip Synthesis:: 0%| | 0/10 [00:00<?, ?it/s] landmark Det:: 0%| | 0/147 [00:00<?, ?it/s] landmark Det:: 1%| | 1/147 [00:00<00:27, 5.36it/s] landmark Det:: 1%|▏ | 2/147 [00:00<00:48, 2.98it/s] landmark Det:: 5%|▌ | 8/147 [00:00<00:09, 14.40it/s] landmark Det:: 10%|█ | 15/147 [00:00<00:05, 26.24it/s] landmark Det:: 15%|█▍ | 22/147 [00:00<00:03, 35.70it/s] landmark Det:: 19%|█▉ | 28/147 [00:01<00:02, 41.66it/s] landmark Det:: 24%|██▍ | 35/147 [00:01<00:02, 47.87it/s] landmark Det:: 29%|██▊ | 42/147 [00:01<00:01, 52.81it/s] landmark Det:: 33%|███▎ | 49/147 [00:01<00:01, 56.77it/s] landmark Det:: 38%|███▊ | 56/147 [00:01<00:01, 58.48it/s] landmark Det:: 43%|████▎ | 63/147 [00:01<00:01, 59.60it/s] landmark Det:: 48%|████▊ | 70/147 [00:01<00:01, 60.72it/s] landmark Det:: 52%|█████▏ | 77/147 [00:01<00:01, 61.70it/s] landmark Det:: 57%|█████▋ | 84/147 [00:01<00:01, 62.77it/s] landmark Det:: 62%|██████▏ | 91/147 [00:02<00:00, 61.95it/s] landmark Det:: 67%|██████▋ | 98/147 [00:02<00:00, 62.86it/s] landmark Det:: 71%|███████▏ | 105/147 [00:02<00:00, 62.60it/s] landmark Det:: 76%|███████▌ | 112/147 [00:02<00:00, 63.19it/s] landmark Det:: 81%|████████ | 119/147 [00:02<00:00, 63.44it/s] landmark Det:: 86%|████████▌ | 126/147 [00:02<00:00, 64.89it/s] landmark Det:: 90%|█████████ | 133/147 [00:02<00:00, 62.73it/s] landmark Det:: 95%|█████████▌| 140/147 [00:02<00:00, 63.43it/s] landmark Det:: 100%|██████████| 147/147 [00:02<00:00, 63.82it/s] landmark Det:: 100%|██████████| 147/147 [00:02<00:00, 50.47it/s] 0%| | 0/147 [00:00<?, ?it/s] 100%|██████████| 147/147 [00:00<00:00, 21065.38it/s] 0%| | 0/147 [00:00<?, ?it/s] 46%|████▋ | 68/147 [00:00<00:00, 677.32it/s] 93%|█████████▎| 137/147 [00:00<00:00, 680.13it/s] 100%|██████████| 147/147 [00:00<00:00, 674.05it/s] FaceDet:: 0%| | 0/37 [00:00<?, ?it/s] FaceDet:: 3%|▎ | 1/37 [00:00<00:28, 1.28it/s] FaceDet:: 5%|▌ | 2/37 [00:00<00:14, 2.44it/s] FaceDet:: 8%|▊ | 3/37 [00:01<00:09, 3.52it/s] FaceDet:: 11%|█ | 4/37 [00:01<00:07, 4.37it/s] FaceDet:: 14%|█▎ | 5/37 [00:01<00:06, 5.11it/s] FaceDet:: 16%|█▌ | 6/37 [00:01<00:05, 5.69it/s] FaceDet:: 19%|█▉ | 7/37 [00:01<00:04, 6.16it/s] FaceDet:: 22%|██▏ | 8/37 [00:01<00:04, 6.44it/s] FaceDet:: 24%|██▍ | 9/37 [00:01<00:04, 6.56it/s] FaceDet:: 27%|██▋ | 10/37 [00:02<00:04, 6.72it/s] FaceDet:: 30%|██▉ | 11/37 [00:02<00:03, 6.84it/s] FaceDet:: 32%|███▏ | 12/37 [00:02<00:03, 6.91it/s] FaceDet:: 35%|███▌ | 13/37 [00:02<00:03, 7.03it/s] FaceDet:: 38%|███▊ | 14/37 [00:02<00:03, 7.03it/s] FaceDet:: 41%|████ | 15/37 [00:02<00:03, 7.11it/s] FaceDet:: 43%|████▎ | 16/37 [00:02<00:02, 7.09it/s] FaceDet:: 46%|████▌ | 17/37 [00:03<00:02, 7.26it/s] FaceDet:: 49%|████▊ | 18/37 [00:03<00:02, 7.27it/s] FaceDet:: 51%|█████▏ | 19/37 [00:03<00:02, 7.22it/s] FaceDet:: 54%|█████▍ | 20/37 [00:03<00:02, 7.17it/s] FaceDet:: 57%|█████▋ | 21/37 [00:03<00:02, 7.19it/s] FaceDet:: 59%|█████▉ | 22/37 [00:03<00:02, 7.08it/s] FaceDet:: 62%|██████▏ | 23/37 [00:03<00:01, 7.01it/s] FaceDet:: 65%|██████▍ | 24/37 [00:03<00:01, 7.20it/s] FaceDet:: 68%|██████▊ | 25/37 [00:04<00:01, 7.18it/s] FaceDet:: 70%|███████ | 26/37 [00:04<00:01, 7.17it/s] FaceDet:: 73%|███████▎ | 27/37 [00:04<00:01, 7.15it/s] FaceDet:: 76%|███████▌ | 28/37 [00:04<00:01, 7.18it/s] FaceDet:: 78%|███████▊ | 29/37 [00:04<00:01, 7.10it/s] FaceDet:: 81%|████████ | 30/37 [00:04<00:00, 7.11it/s] FaceDet:: 84%|████████▍ | 31/37 [00:04<00:00, 7.16it/s] FaceDet:: 86%|████████▋ | 32/37 [00:05<00:00, 7.13it/s] FaceDet:: 89%|████████▉ | 33/37 [00:05<00:00, 7.03it/s] FaceDet:: 92%|█████████▏| 34/37 [00:05<00:00, 6.97it/s] FaceDet:: 95%|█████████▍| 35/37 [00:05<00:00, 6.99it/s] FaceDet:: 97%|█████████▋| 36/37 [00:05<00:00, 6.95it/s] FaceDet:: 100%|██████████| 37/37 [00:06<00:00, 3.40it/s] FaceDet:: 100%|██████████| 37/37 [00:06<00:00, 5.83it/s] [Step 6] Lip Synthesis:: 10%|█ | 1/10 [00:17<02:33, 17.05s/it] [Step 6] Lip Synthesis:: 20%|██ | 2/10 [00:22<01:22, 10.34s/it] [Step 6] Lip Synthesis:: 30%|███ | 3/10 [00:28<00:57, 8.19s/it] [Step 6] Lip Synthesis:: 40%|████ | 4/10 [00:33<00:43, 7.17s/it] [Step 6] Lip Synthesis:: 50%|█████ | 5/10 [00:40<00:34, 6.93s/it] [Step 6] Lip Synthesis:: 60%|██████ | 6/10 [00:46<00:25, 6.49s/it] [Step 6] Lip Synthesis:: 70%|███████ | 7/10 [00:52<00:19, 6.53s/it] [Step 6] Lip Synthesis:: 80%|████████ | 8/10 [00:58<00:12, 6.26s/it] [Step 6] Lip Synthesis:: 90%|█████████ | 9/10 [01:04<00:06, 6.37s/it] [Step 6] Lip Synthesis:: 100%|██████████| 10/10 [01:08<00:00, 5.44s/it] [Step 6] Lip Synthesis:: 100%|██████████| 10/10 [01:08<00:00, 6.83s/it]Prediction
chenxwh/video-retalking:db5a650cIDahdxbb3bfocsz3cikrckqs6itiStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnmE0vax5PKpieqYb3HYrlFR4OdAEtQtvQK0ZlUxDlv9hhU/2.wav" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", input_audio: "https://replicate.delivery/pbxt/JnnmE0vax5PKpieqYb3HYrlFR4OdAEtQtvQK0ZlUxDlv9hhU/2.wav" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnmE0vax5PKpieqYb3HYrlFR4OdAEtQtvQK0ZlUxDlv9hhU/2.wav" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnmE0vax5PKpieqYb3HYrlFR4OdAEtQtvQK0ZlUxDlv9hhU/2.wav" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2023-11-01T17:32:23.536029Z", "created_at": "2023-11-01T17:29:39.502619Z", "data_removed": false, "error": null, "id": "ahdxbb3bfocsz3cikrckqs6iti", "input": { "face": "https://replicate.delivery/pbxt/JnnmEG1xdu68R2MTG3YAZCYNkHy4QrP5C45lVqaWD1PZtfJc/1.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnmE0vax5PKpieqYb3HYrlFR4OdAEtQtvQK0ZlUxDlv9hhU/2.wav" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/135 [00:00<?, ?it/s]\nlandmark Det:: 1%| | 1/135 [00:09<20:08, 9.02s/it]\nlandmark Det:: 1%|▏ | 2/135 [00:15<16:50, 7.60s/it]\nlandmark Det:: 6%|▌ | 8/135 [00:15<02:41, 1.27s/it]\nlandmark Det:: 11%|█ | 15/135 [00:15<01:04, 1.85it/s]\nlandmark Det:: 16%|█▋ | 22/135 [00:15<00:34, 3.30it/s]\nlandmark Det:: 21%|██▏ | 29/135 [00:16<00:20, 5.27it/s]\nlandmark Det:: 27%|██▋ | 36/135 [00:16<00:12, 7.88it/s]\nlandmark Det:: 32%|███▏ | 43/135 [00:16<00:08, 11.21it/s]\nlandmark Det:: 37%|███▋ | 50/135 [00:16<00:05, 15.30it/s]\nlandmark Det:: 42%|████▏ | 57/135 [00:16<00:03, 20.24it/s]\nlandmark Det:: 47%|████▋ | 64/135 [00:16<00:02, 25.80it/s]\nlandmark Det:: 53%|█████▎ | 71/135 [00:16<00:02, 31.77it/s]\nlandmark Det:: 58%|█████▊ | 78/135 [00:16<00:01, 37.63it/s]\nlandmark Det:: 63%|██████▎ | 85/135 [00:16<00:01, 43.11it/s]\nlandmark Det:: 68%|██████▊ | 92/135 [00:17<00:00, 47.93it/s]\nlandmark Det:: 73%|███████▎ | 99/135 [00:17<00:00, 52.06it/s]\nlandmark Det:: 79%|███████▊ | 106/135 [00:17<00:00, 55.42it/s]\nlandmark Det:: 84%|████████▎ | 113/135 [00:17<00:00, 57.92it/s]\nlandmark Det:: 89%|████████▉ | 120/135 [00:17<00:00, 59.12it/s]\nlandmark Det:: 94%|█████████▍| 127/135 [00:17<00:00, 60.94it/s]\nlandmark Det:: 99%|█████████▉| 134/135 [00:17<00:00, 62.30it/s]\nlandmark Det:: 100%|██████████| 135/135 [00:17<00:00, 7.63it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/135 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 1%| | 1/135 [00:00<00:27, 4.87it/s]\n[Step 2] 3DMM Extraction In Video:: 10%|█ | 14/135 [00:00<00:02, 55.49it/s]\n[Step 2] 3DMM Extraction In Video:: 20%|██ | 27/135 [00:00<00:01, 82.16it/s]\n[Step 2] 3DMM Extraction In Video:: 30%|██▉ | 40/135 [00:00<00:00, 97.78it/s]\n[Step 2] 3DMM Extraction In Video:: 39%|███▉ | 53/135 [00:00<00:00, 107.57it/s]\n[Step 2] 3DMM Extraction In Video:: 48%|████▊ | 65/135 [00:00<00:00, 109.94it/s]\n[Step 2] 3DMM Extraction In Video:: 58%|█████▊ | 78/135 [00:00<00:00, 115.39it/s]\n[Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 91/135 [00:00<00:00, 119.39it/s]\n[Step 2] 3DMM Extraction In Video:: 77%|███████▋ | 104/135 [00:01<00:00, 122.08it/s]\n[Step 2] 3DMM Extraction In Video:: 87%|████████▋ | 117/135 [00:01<00:00, 123.77it/s]\n[Step 2] 3DMM Extraction In Video:: 96%|█████████▋| 130/135 [00:01<00:00, 124.69it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 135/135 [00:01<00:00, 106.47it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/135 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 1%| | 1/135 [00:00<00:48, 2.78it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 3/135 [00:00<00:20, 6.56it/s]\n[Step 3] Stabilize the expression In Video:: 4%|▎ | 5/135 [00:00<00:14, 8.74it/s]\n[Step 3] Stabilize the expression In Video:: 5%|▌ | 7/135 [00:00<00:12, 10.11it/s]\n[Step 3] Stabilize the expression In Video:: 7%|▋ | 9/135 [00:00<00:11, 11.00it/s]\n[Step 3] Stabilize the expression In Video:: 8%|▊ | 11/135 [00:01<00:10, 11.57it/s]\n[Step 3] Stabilize the expression In Video:: 10%|▉ | 13/135 [00:01<00:10, 11.99it/s]\n[Step 3] Stabilize the expression In Video:: 11%|█ | 15/135 [00:01<00:09, 12.26it/s]\n[Step 3] Stabilize the expression In Video:: 13%|█▎ | 17/135 [00:01<00:09, 12.45it/s]\n[Step 3] Stabilize the expression In Video:: 14%|█▍ | 19/135 [00:01<00:09, 12.56it/s]\n[Step 3] Stabilize the expression In Video:: 16%|█▌ | 21/135 [00:01<00:09, 12.66it/s]\n[Step 3] Stabilize the expression In Video:: 17%|█▋ | 23/135 [00:02<00:08, 12.73it/s]\n[Step 3] Stabilize the expression In Video:: 19%|█▊ | 25/135 [00:02<00:08, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 20%|██ | 27/135 [00:02<00:08, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 21%|██▏ | 29/135 [00:02<00:08, 12.80it/s]\n[Step 3] Stabilize the expression In Video:: 23%|██▎ | 31/135 [00:02<00:08, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 24%|██▍ | 33/135 [00:02<00:07, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▌ | 35/135 [00:03<00:07, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 27%|██▋ | 37/135 [00:03<00:07, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 29%|██▉ | 39/135 [00:03<00:07, 12.80it/s]\n[Step 3] Stabilize the expression In Video:: 30%|███ | 41/135 [00:03<00:07, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 32%|███▏ | 43/135 [00:03<00:07, 12.80it/s]\n[Step 3] Stabilize the expression In Video:: 33%|███▎ | 45/135 [00:03<00:07, 12.74it/s]\n[Step 3] Stabilize the expression In Video:: 35%|███▍ | 47/135 [00:03<00:06, 12.74it/s]\n[Step 3] Stabilize the expression In Video:: 36%|███▋ | 49/135 [00:04<00:06, 12.73it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 51/135 [00:04<00:06, 12.75it/s]\n[Step 3] Stabilize the expression In Video:: 39%|███▉ | 53/135 [00:04<00:06, 12.79it/s]\n[Step 3] Stabilize the expression In Video:: 41%|████ | 55/135 [00:04<00:06, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 42%|████▏ | 57/135 [00:04<00:06, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 44%|████▎ | 59/135 [00:04<00:05, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 45%|████▌ | 61/135 [00:05<00:05, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 47%|████▋ | 63/135 [00:05<00:05, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 48%|████▊ | 65/135 [00:05<00:05, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 50%|████▉ | 67/135 [00:05<00:05, 12.80it/s]\n[Step 3] Stabilize the expression In Video:: 51%|█████ | 69/135 [00:05<00:05, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 53%|█████▎ | 71/135 [00:05<00:04, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▍ | 73/135 [00:05<00:04, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 56%|█████▌ | 75/135 [00:06<00:04, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 57%|█████▋ | 77/135 [00:06<00:04, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 59%|█████▊ | 79/135 [00:06<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 60%|██████ | 81/135 [00:06<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 61%|██████▏ | 83/135 [00:06<00:04, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 63%|██████▎ | 85/135 [00:06<00:03, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 64%|██████▍ | 87/135 [00:07<00:03, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▌ | 89/135 [00:07<00:03, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 67%|██████▋ | 91/135 [00:07<00:03, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 69%|██████▉ | 93/135 [00:07<00:03, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 70%|███████ | 95/135 [00:07<00:03, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 72%|███████▏ | 97/135 [00:07<00:02, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 73%|███████▎ | 99/135 [00:08<00:02, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 75%|███████▍ | 101/135 [00:08<00:02, 12.83it/s]\n[Step 3] Stabilize the expression In Video:: 76%|███████▋ | 103/135 [00:08<00:02, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 78%|███████▊ | 105/135 [00:08<00:02, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 79%|███████▉ | 107/135 [00:08<00:02, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 81%|████████ | 109/135 [00:08<00:02, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 111/135 [00:08<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 84%|████████▎ | 113/135 [00:09<00:01, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 85%|████████▌ | 115/135 [00:09<00:01, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 87%|████████▋ | 117/135 [00:09<00:01, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 88%|████████▊ | 119/135 [00:09<00:01, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 90%|████████▉ | 121/135 [00:09<00:01, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 91%|█████████ | 123/135 [00:09<00:00, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 93%|█████████▎| 125/135 [00:10<00:00, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 94%|█████████▍| 127/135 [00:10<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 96%|█████████▌| 129/135 [00:10<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 97%|█████████▋| 131/135 [00:10<00:00, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 99%|█████████▊| 133/135 [00:10<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 135/135 [00:10<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 135/135 [00:10<00:00, 12.50it/s]\n[Step 4] Load audio; Length of mel chunks: 109\n[Step 5] Reference Enhancement: 0%| | 0/109 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/109 [00:01<03:03, 1.70s/it]\n[Step 5] Reference Enhancement: 2%|▏ | 2/109 [00:01<01:24, 1.27it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 3/109 [00:01<00:52, 2.02it/s]\n[Step 5] Reference Enhancement: 4%|▎ | 4/109 [00:02<00:37, 2.80it/s]\n[Step 5] Reference Enhancement: 5%|▍ | 5/109 [00:02<00:29, 3.56it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 6/109 [00:02<00:24, 4.27it/s]\n[Step 5] Reference Enhancement: 6%|▋ | 7/109 [00:02<00:20, 4.90it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 8/109 [00:02<00:18, 5.44it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 9/109 [00:02<00:17, 5.87it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 10/109 [00:02<00:15, 6.20it/s]\n[Step 5] Reference Enhancement: 10%|█ | 11/109 [00:03<00:15, 6.45it/s]\n[Step 5] Reference Enhancement: 11%|█ | 12/109 [00:03<00:14, 6.61it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 13/109 [00:03<00:14, 6.76it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 14/109 [00:03<00:13, 6.90it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 15/109 [00:03<00:13, 6.94it/s]\n[Step 5] Reference Enhancement: 15%|█▍ | 16/109 [00:03<00:13, 7.02it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 17/109 [00:03<00:12, 7.11it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 18/109 [00:04<00:12, 7.16it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 19/109 [00:04<00:12, 7.11it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 20/109 [00:04<00:12, 7.15it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 21/109 [00:04<00:12, 7.12it/s]\n[Step 5] Reference Enhancement: 20%|██ | 22/109 [00:04<00:12, 7.13it/s]\n[Step 5] Reference Enhancement: 21%|██ | 23/109 [00:04<00:12, 7.11it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 24/109 [00:04<00:11, 7.12it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 25/109 [00:05<00:11, 7.10it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 26/109 [00:05<00:11, 7.10it/s]\n[Step 5] Reference Enhancement: 25%|██▍ | 27/109 [00:05<00:11, 7.09it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 28/109 [00:05<00:11, 7.11it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 29/109 [00:05<00:11, 7.08it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 30/109 [00:05<00:11, 7.09it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 31/109 [00:05<00:11, 7.08it/s]\n[Step 5] Reference Enhancement: 29%|██▉ | 32/109 [00:06<00:10, 7.12it/s]\n[Step 5] Reference Enhancement: 30%|███ | 33/109 [00:06<00:10, 7.12it/s]\n[Step 5] Reference Enhancement: 31%|███ | 34/109 [00:06<00:10, 7.11it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 35/109 [00:06<00:10, 7.09it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 36/109 [00:06<00:10, 7.12it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 37/109 [00:06<00:10, 7.10it/s]\n[Step 5] Reference Enhancement: 35%|███▍ | 38/109 [00:06<00:09, 7.13it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 39/109 [00:07<00:09, 7.14it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 40/109 [00:07<00:09, 7.12it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 41/109 [00:07<00:09, 7.13it/s]\n[Step 5] Reference Enhancement: 39%|███▊ | 42/109 [00:07<00:09, 7.12it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 43/109 [00:07<00:09, 7.09it/s]\n[Step 5] Reference Enhancement: 40%|████ | 44/109 [00:07<00:09, 7.13it/s]\n[Step 5] Reference Enhancement: 41%|████▏ | 45/109 [00:07<00:08, 7.12it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 46/109 [00:08<00:08, 7.15it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 47/109 [00:08<00:08, 7.13it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 48/109 [00:08<00:08, 7.09it/s]\n[Step 5] Reference Enhancement: 45%|████▍ | 49/109 [00:08<00:08, 7.05it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 50/109 [00:08<00:08, 7.08it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 51/109 [00:08<00:08, 7.09it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 52/109 [00:08<00:08, 7.11it/s]\n[Step 5] Reference Enhancement: 49%|████▊ | 53/109 [00:09<00:07, 7.14it/s]\n[Step 5] Reference Enhancement: 50%|████▉ | 54/109 [00:09<00:07, 7.10it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 55/109 [00:09<00:07, 7.12it/s]\n[Step 5] Reference Enhancement: 51%|█████▏ | 56/109 [00:09<00:07, 7.10it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 57/109 [00:09<00:07, 7.05it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 58/109 [00:09<00:07, 7.06it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 59/109 [00:09<00:07, 7.06it/s]\n[Step 5] Reference Enhancement: 55%|█████▌ | 60/109 [00:10<00:06, 7.10it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 61/109 [00:10<00:06, 7.08it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 62/109 [00:10<00:06, 7.08it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 63/109 [00:10<00:06, 7.08it/s]\n[Step 5] Reference Enhancement: 59%|█████▊ | 64/109 [00:10<00:06, 7.14it/s]\n[Step 5] Reference Enhancement: 60%|█████▉ | 65/109 [00:10<00:06, 7.13it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 66/109 [00:10<00:05, 7.19it/s]\n[Step 5] Reference Enhancement: 61%|██████▏ | 67/109 [00:11<00:05, 7.15it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 68/109 [00:11<00:05, 7.10it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 69/109 [00:11<00:05, 7.14it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 70/109 [00:11<00:05, 7.18it/s]\n[Step 5] Reference Enhancement: 65%|██████▌ | 71/109 [00:11<00:05, 7.14it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 72/109 [00:11<00:05, 7.13it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 73/109 [00:11<00:05, 7.15it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 74/109 [00:11<00:04, 7.14it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 75/109 [00:12<00:04, 7.17it/s]\n[Step 5] Reference Enhancement: 70%|██████▉ | 76/109 [00:12<00:04, 7.17it/s]\n[Step 5] Reference Enhancement: 71%|███████ | 77/109 [00:12<00:04, 7.13it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 78/109 [00:12<00:04, 7.14it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 79/109 [00:12<00:04, 7.10it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 80/109 [00:12<00:04, 7.08it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 81/109 [00:12<00:03, 7.09it/s]\n[Step 5] Reference Enhancement: 75%|███████▌ | 82/109 [00:13<00:03, 7.11it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 83/109 [00:13<00:03, 7.11it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 84/109 [00:13<00:03, 7.09it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 85/109 [00:13<00:03, 7.09it/s]\n[Step 5] Reference Enhancement: 79%|███████▉ | 86/109 [00:13<00:03, 7.06it/s]\n[Step 5] Reference Enhancement: 80%|███████▉ | 87/109 [00:13<00:03, 7.12it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 88/109 [00:13<00:02, 7.09it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 89/109 [00:14<00:02, 7.15it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 90/109 [00:14<00:02, 7.19it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 91/109 [00:14<00:02, 7.15it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 92/109 [00:14<00:02, 7.16it/s]\n[Step 5] Reference Enhancement: 85%|████████▌ | 93/109 [00:14<00:02, 7.13it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 94/109 [00:14<00:02, 7.12it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 95/109 [00:14<00:01, 7.14it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 96/109 [00:15<00:01, 7.15it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 97/109 [00:15<00:01, 7.10it/s]\n[Step 5] Reference Enhancement: 90%|████████▉ | 98/109 [00:15<00:01, 7.09it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 99/109 [00:15<00:01, 7.05it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 100/109 [00:15<00:01, 7.08it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 101/109 [00:15<00:01, 7.10it/s]\n[Step 5] Reference Enhancement: 94%|█████████▎| 102/109 [00:15<00:00, 7.14it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 103/109 [00:16<00:00, 7.12it/s]\n[Step 5] Reference Enhancement: 95%|█████████▌| 104/109 [00:16<00:00, 7.15it/s]\n[Step 5] Reference Enhancement: 96%|█████████▋| 105/109 [00:16<00:00, 7.16it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 106/109 [00:16<00:00, 7.21it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 107/109 [00:16<00:00, 7.17it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 108/109 [00:16<00:00, 7.14it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 109/109 [00:16<00:00, 7.13it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 109/109 [00:16<00:00, 6.45it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/7 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/109 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/109 [00:00<00:19, 5.44it/s]\u001b[A\nlandmark Det:: 2%|▏ | 2/109 [00:00<00:35, 2.98it/s]\u001b[A\nlandmark Det:: 8%|▊ | 9/109 [00:00<00:06, 16.15it/s]\u001b[A\nlandmark Det:: 15%|█▍ | 16/109 [00:00<00:03, 27.44it/s]\u001b[A\nlandmark Det:: 21%|██ | 23/109 [00:00<00:02, 36.76it/s]\u001b[A\nlandmark Det:: 28%|██▊ | 30/109 [00:01<00:01, 44.03it/s]\u001b[A\nlandmark Det:: 34%|███▍ | 37/109 [00:01<00:01, 49.62it/s]\u001b[A\nlandmark Det:: 40%|████ | 44/109 [00:01<00:01, 53.25it/s]\u001b[A\nlandmark Det:: 47%|████▋ | 51/109 [00:01<00:01, 56.15it/s]\u001b[A\nlandmark Det:: 53%|█████▎ | 58/109 [00:01<00:00, 58.88it/s]\u001b[A\nlandmark Det:: 60%|█████▉ | 65/109 [00:01<00:00, 51.52it/s]\u001b[A\nlandmark Det:: 65%|██████▌ | 71/109 [00:01<00:00, 51.34it/s]\u001b[A\nlandmark Det:: 72%|███████▏ | 78/109 [00:01<00:00, 54.51it/s]\u001b[A\nlandmark Det:: 78%|███████▊ | 85/109 [00:02<00:00, 57.19it/s]\u001b[A\nlandmark Det:: 84%|████████▍ | 92/109 [00:02<00:00, 59.09it/s]\u001b[A\nlandmark Det:: 91%|█████████ | 99/109 [00:02<00:00, 60.39it/s]\u001b[A\nlandmark Det:: 97%|█████████▋| 106/109 [00:02<00:00, 61.38it/s]\u001b[A\nlandmark Det:: 100%|██████████| 109/109 [00:02<00:00, 45.67it/s]\n 0%| | 0/109 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 109/109 [00:00<00:00, 19772.47it/s]\n 0%| | 0/109 [00:00<?, ?it/s]\u001b[A\n 61%|██████ | 66/109 [00:00<00:00, 656.02it/s]\u001b[A\n100%|██████████| 109/109 [00:00<00:00, 663.59it/s]\nFaceDet:: 0%| | 0/28 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 4%|▎ | 1/28 [00:00<00:21, 1.27it/s]\u001b[A\nFaceDet:: 7%|▋ | 2/28 [00:00<00:10, 2.48it/s]\u001b[A\nFaceDet:: 11%|█ | 3/28 [00:01<00:06, 3.58it/s]\u001b[A\nFaceDet:: 14%|█▍ | 4/28 [00:01<00:05, 4.53it/s]\u001b[A\nFaceDet:: 18%|█▊ | 5/28 [00:01<00:04, 5.31it/s]\u001b[A\nFaceDet:: 21%|██▏ | 6/28 [00:01<00:03, 5.96it/s]\u001b[A\nFaceDet:: 25%|██▌ | 7/28 [00:01<00:03, 6.43it/s]\u001b[A\nFaceDet:: 29%|██▊ | 8/28 [00:01<00:02, 6.75it/s]\u001b[A\nFaceDet:: 32%|███▏ | 9/28 [00:01<00:02, 6.93it/s]\u001b[A\nFaceDet:: 36%|███▌ | 10/28 [00:01<00:02, 7.13it/s]\u001b[A\nFaceDet:: 39%|███▉ | 11/28 [00:02<00:02, 7.24it/s]\u001b[A\nFaceDet:: 43%|████▎ | 12/28 [00:02<00:02, 7.33it/s]\u001b[A\nFaceDet:: 46%|████▋ | 13/28 [00:02<00:02, 7.42it/s]\u001b[A\nFaceDet:: 50%|█████ | 14/28 [00:02<00:01, 7.47it/s]\u001b[A\nFaceDet:: 54%|█████▎ | 15/28 [00:02<00:01, 7.53it/s]\u001b[A\nFaceDet:: 57%|█████▋ | 16/28 [00:02<00:01, 7.58it/s]\u001b[A\nFaceDet:: 61%|██████ | 17/28 [00:02<00:01, 7.60it/s]\u001b[A\nFaceDet:: 64%|██████▍ | 18/28 [00:03<00:01, 7.61it/s]\u001b[A\nFaceDet:: 68%|██████▊ | 19/28 [00:03<00:01, 7.64it/s]\u001b[A\nFaceDet:: 71%|███████▏ | 20/28 [00:03<00:01, 7.65it/s]\u001b[A\nFaceDet:: 75%|███████▌ | 21/28 [00:03<00:00, 7.54it/s]\u001b[A\nFaceDet:: 79%|███████▊ | 22/28 [00:03<00:00, 7.57it/s]\u001b[A\nFaceDet:: 82%|████████▏ | 23/28 [00:03<00:00, 7.60it/s]\u001b[A\nFaceDet:: 86%|████████▌ | 24/28 [00:03<00:00, 7.62it/s]\u001b[A\nFaceDet:: 89%|████████▉ | 25/28 [00:03<00:00, 7.65it/s]\u001b[A\nFaceDet:: 93%|█████████▎| 26/28 [00:04<00:00, 7.66it/s]\u001b[A\nFaceDet:: 96%|█████████▋| 27/28 [00:04<00:00, 7.66it/s]\u001b[A\nFaceDet:: 100%|██████████| 28/28 [00:04<00:00, 5.33it/s]\u001b[A\nFaceDet:: 100%|██████████| 28/28 [00:04<00:00, 6.19it/s]\n[Step 6] Lip Synthesis:: 14%|█▍ | 1/7 [00:21<02:08, 21.41s/it]\n[Step 6] Lip Synthesis:: 29%|██▊ | 2/7 [00:27<01:01, 12.36s/it]\n[Step 6] Lip Synthesis:: 43%|████▎ | 3/7 [00:33<00:38, 9.51s/it]\n[Step 6] Lip Synthesis:: 57%|█████▋ | 4/7 [00:39<00:24, 8.10s/it]\n[Step 6] Lip Synthesis:: 71%|███████▏ | 5/7 [00:45<00:14, 7.40s/it]\n[Step 6] Lip Synthesis:: 86%|████████▌ | 6/7 [00:51<00:06, 6.95s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 7/7 [01:01<00:00, 7.94s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 7/7 [01:01<00:00, 8.81s/it]", "metrics": { "predict_time": 114.969255, "total_time": 164.03341 }, "output": "https://replicate.delivery/pbxt/NI6sJnUJfTVYNSXQy1MkHwb5O3XKB1GNxRJzYHHjNnQT7B6IA/output.mp4", "started_at": "2023-11-01T17:30:28.566774Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/ahdxbb3bfocsz3cikrckqs6iti", "cancel": "https://api.replicate.com/v1/predictions/ahdxbb3bfocsz3cikrckqs6iti/cancel" }, "version": "a0dbf0b26be3a3d249473aa11fe197126a05f12e439199a0074151ae1fa47c3c" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/135 [00:00<?, ?it/s] landmark Det:: 1%| | 1/135 [00:09<20:08, 9.02s/it] landmark Det:: 1%|▏ | 2/135 [00:15<16:50, 7.60s/it] landmark Det:: 6%|▌ | 8/135 [00:15<02:41, 1.27s/it] landmark Det:: 11%|█ | 15/135 [00:15<01:04, 1.85it/s] landmark Det:: 16%|█▋ | 22/135 [00:15<00:34, 3.30it/s] landmark Det:: 21%|██▏ | 29/135 [00:16<00:20, 5.27it/s] landmark Det:: 27%|██▋ | 36/135 [00:16<00:12, 7.88it/s] landmark Det:: 32%|███▏ | 43/135 [00:16<00:08, 11.21it/s] landmark Det:: 37%|███▋ | 50/135 [00:16<00:05, 15.30it/s] landmark Det:: 42%|████▏ | 57/135 [00:16<00:03, 20.24it/s] landmark Det:: 47%|████▋ | 64/135 [00:16<00:02, 25.80it/s] landmark Det:: 53%|█████▎ | 71/135 [00:16<00:02, 31.77it/s] landmark Det:: 58%|█████▊ | 78/135 [00:16<00:01, 37.63it/s] landmark Det:: 63%|██████▎ | 85/135 [00:16<00:01, 43.11it/s] landmark Det:: 68%|██████▊ | 92/135 [00:17<00:00, 47.93it/s] landmark Det:: 73%|███████▎ | 99/135 [00:17<00:00, 52.06it/s] landmark Det:: 79%|███████▊ | 106/135 [00:17<00:00, 55.42it/s] landmark Det:: 84%|████████▎ | 113/135 [00:17<00:00, 57.92it/s] landmark Det:: 89%|████████▉ | 120/135 [00:17<00:00, 59.12it/s] landmark Det:: 94%|█████████▍| 127/135 [00:17<00:00, 60.94it/s] landmark Det:: 99%|█████████▉| 134/135 [00:17<00:00, 62.30it/s] landmark Det:: 100%|██████████| 135/135 [00:17<00:00, 7.63it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/135 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 1%| | 1/135 [00:00<00:27, 4.87it/s] [Step 2] 3DMM Extraction In Video:: 10%|█ | 14/135 [00:00<00:02, 55.49it/s] [Step 2] 3DMM Extraction In Video:: 20%|██ | 27/135 [00:00<00:01, 82.16it/s] [Step 2] 3DMM Extraction In Video:: 30%|██▉ | 40/135 [00:00<00:00, 97.78it/s] [Step 2] 3DMM Extraction In Video:: 39%|███▉ | 53/135 [00:00<00:00, 107.57it/s] [Step 2] 3DMM Extraction In Video:: 48%|████▊ | 65/135 [00:00<00:00, 109.94it/s] [Step 2] 3DMM Extraction In Video:: 58%|█████▊ | 78/135 [00:00<00:00, 115.39it/s] [Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 91/135 [00:00<00:00, 119.39it/s] [Step 2] 3DMM Extraction In Video:: 77%|███████▋ | 104/135 [00:01<00:00, 122.08it/s] [Step 2] 3DMM Extraction In Video:: 87%|████████▋ | 117/135 [00:01<00:00, 123.77it/s] [Step 2] 3DMM Extraction In Video:: 96%|█████████▋| 130/135 [00:01<00:00, 124.69it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 135/135 [00:01<00:00, 106.47it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/135 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 1%| | 1/135 [00:00<00:48, 2.78it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 3/135 [00:00<00:20, 6.56it/s] [Step 3] Stabilize the expression In Video:: 4%|▎ | 5/135 [00:00<00:14, 8.74it/s] [Step 3] Stabilize the expression In Video:: 5%|▌ | 7/135 [00:00<00:12, 10.11it/s] [Step 3] Stabilize the expression In Video:: 7%|▋ | 9/135 [00:00<00:11, 11.00it/s] [Step 3] Stabilize the expression In Video:: 8%|▊ | 11/135 [00:01<00:10, 11.57it/s] [Step 3] Stabilize the expression In Video:: 10%|▉ | 13/135 [00:01<00:10, 11.99it/s] [Step 3] Stabilize the expression In Video:: 11%|█ | 15/135 [00:01<00:09, 12.26it/s] [Step 3] Stabilize the expression In Video:: 13%|█▎ | 17/135 [00:01<00:09, 12.45it/s] [Step 3] Stabilize the expression In Video:: 14%|█▍ | 19/135 [00:01<00:09, 12.56it/s] [Step 3] Stabilize the expression In Video:: 16%|█▌ | 21/135 [00:01<00:09, 12.66it/s] [Step 3] Stabilize the expression In Video:: 17%|█▋ | 23/135 [00:02<00:08, 12.73it/s] [Step 3] Stabilize the expression In Video:: 19%|█▊ | 25/135 [00:02<00:08, 12.79it/s] [Step 3] Stabilize the expression In Video:: 20%|██ | 27/135 [00:02<00:08, 12.76it/s] [Step 3] Stabilize the expression In Video:: 21%|██▏ | 29/135 [00:02<00:08, 12.80it/s] [Step 3] Stabilize the expression In Video:: 23%|██▎ | 31/135 [00:02<00:08, 12.81it/s] [Step 3] Stabilize the expression In Video:: 24%|██▍ | 33/135 [00:02<00:07, 12.82it/s] [Step 3] Stabilize the expression In Video:: 26%|██▌ | 35/135 [00:03<00:07, 12.81it/s] [Step 3] Stabilize the expression In Video:: 27%|██▋ | 37/135 [00:03<00:07, 12.83it/s] [Step 3] Stabilize the expression In Video:: 29%|██▉ | 39/135 [00:03<00:07, 12.80it/s] [Step 3] Stabilize the expression In Video:: 30%|███ | 41/135 [00:03<00:07, 12.82it/s] [Step 3] Stabilize the expression In Video:: 32%|███▏ | 43/135 [00:03<00:07, 12.80it/s] [Step 3] Stabilize the expression In Video:: 33%|███▎ | 45/135 [00:03<00:07, 12.74it/s] [Step 3] Stabilize the expression In Video:: 35%|███▍ | 47/135 [00:03<00:06, 12.74it/s] [Step 3] Stabilize the expression In Video:: 36%|███▋ | 49/135 [00:04<00:06, 12.73it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 51/135 [00:04<00:06, 12.75it/s] [Step 3] Stabilize the expression In Video:: 39%|███▉ | 53/135 [00:04<00:06, 12.79it/s] [Step 3] Stabilize the expression In Video:: 41%|████ | 55/135 [00:04<00:06, 12.81it/s] [Step 3] Stabilize the expression In Video:: 42%|████▏ | 57/135 [00:04<00:06, 12.81it/s] [Step 3] Stabilize the expression In Video:: 44%|████▎ | 59/135 [00:04<00:05, 12.81it/s] [Step 3] Stabilize the expression In Video:: 45%|████▌ | 61/135 [00:05<00:05, 12.84it/s] [Step 3] Stabilize the expression In Video:: 47%|████▋ | 63/135 [00:05<00:05, 12.84it/s] [Step 3] Stabilize the expression In Video:: 48%|████▊ | 65/135 [00:05<00:05, 12.81it/s] [Step 3] Stabilize the expression In Video:: 50%|████▉ | 67/135 [00:05<00:05, 12.80it/s] [Step 3] Stabilize the expression In Video:: 51%|█████ | 69/135 [00:05<00:05, 12.81it/s] [Step 3] Stabilize the expression In Video:: 53%|█████▎ | 71/135 [00:05<00:04, 12.84it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▍ | 73/135 [00:05<00:04, 12.81it/s] [Step 3] Stabilize the expression In Video:: 56%|█████▌ | 75/135 [00:06<00:04, 12.82it/s] [Step 3] Stabilize the expression In Video:: 57%|█████▋ | 77/135 [00:06<00:04, 12.85it/s] [Step 3] Stabilize the expression In Video:: 59%|█████▊ | 79/135 [00:06<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 60%|██████ | 81/135 [00:06<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 61%|██████▏ | 83/135 [00:06<00:04, 12.87it/s] [Step 3] Stabilize the expression In Video:: 63%|██████▎ | 85/135 [00:06<00:03, 12.88it/s] [Step 3] Stabilize the expression In Video:: 64%|██████▍ | 87/135 [00:07<00:03, 12.89it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▌ | 89/135 [00:07<00:03, 12.87it/s] [Step 3] Stabilize the expression In Video:: 67%|██████▋ | 91/135 [00:07<00:03, 12.86it/s] [Step 3] Stabilize the expression In Video:: 69%|██████▉ | 93/135 [00:07<00:03, 12.84it/s] [Step 3] Stabilize the expression In Video:: 70%|███████ | 95/135 [00:07<00:03, 12.81it/s] [Step 3] Stabilize the expression In Video:: 72%|███████▏ | 97/135 [00:07<00:02, 12.83it/s] [Step 3] Stabilize the expression In Video:: 73%|███████▎ | 99/135 [00:08<00:02, 12.82it/s] [Step 3] Stabilize the expression In Video:: 75%|███████▍ | 101/135 [00:08<00:02, 12.83it/s] [Step 3] Stabilize the expression In Video:: 76%|███████▋ | 103/135 [00:08<00:02, 12.85it/s] [Step 3] Stabilize the expression In Video:: 78%|███████▊ | 105/135 [00:08<00:02, 12.87it/s] [Step 3] Stabilize the expression In Video:: 79%|███████▉ | 107/135 [00:08<00:02, 12.87it/s] [Step 3] Stabilize the expression In Video:: 81%|████████ | 109/135 [00:08<00:02, 12.87it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 111/135 [00:08<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 84%|████████▎ | 113/135 [00:09<00:01, 12.86it/s] [Step 3] Stabilize the expression In Video:: 85%|████████▌ | 115/135 [00:09<00:01, 12.84it/s] [Step 3] Stabilize the expression In Video:: 87%|████████▋ | 117/135 [00:09<00:01, 12.86it/s] [Step 3] Stabilize the expression In Video:: 88%|████████▊ | 119/135 [00:09<00:01, 12.87it/s] [Step 3] Stabilize the expression In Video:: 90%|████████▉ | 121/135 [00:09<00:01, 12.89it/s] [Step 3] Stabilize the expression In Video:: 91%|█████████ | 123/135 [00:09<00:00, 12.87it/s] [Step 3] Stabilize the expression In Video:: 93%|█████████▎| 125/135 [00:10<00:00, 12.89it/s] [Step 3] Stabilize the expression In Video:: 94%|█████████▍| 127/135 [00:10<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 96%|█████████▌| 129/135 [00:10<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 97%|█████████▋| 131/135 [00:10<00:00, 12.86it/s] [Step 3] Stabilize the expression In Video:: 99%|█████████▊| 133/135 [00:10<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 135/135 [00:10<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 135/135 [00:10<00:00, 12.50it/s] [Step 4] Load audio; Length of mel chunks: 109 [Step 5] Reference Enhancement: 0%| | 0/109 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/109 [00:01<03:03, 1.70s/it] [Step 5] Reference Enhancement: 2%|▏ | 2/109 [00:01<01:24, 1.27it/s] [Step 5] Reference Enhancement: 3%|▎ | 3/109 [00:01<00:52, 2.02it/s] [Step 5] Reference Enhancement: 4%|▎ | 4/109 [00:02<00:37, 2.80it/s] [Step 5] Reference Enhancement: 5%|▍ | 5/109 [00:02<00:29, 3.56it/s] [Step 5] Reference Enhancement: 6%|▌ | 6/109 [00:02<00:24, 4.27it/s] [Step 5] Reference Enhancement: 6%|▋ | 7/109 [00:02<00:20, 4.90it/s] [Step 5] Reference Enhancement: 7%|▋ | 8/109 [00:02<00:18, 5.44it/s] [Step 5] Reference Enhancement: 8%|▊ | 9/109 [00:02<00:17, 5.87it/s] [Step 5] Reference Enhancement: 9%|▉ | 10/109 [00:02<00:15, 6.20it/s] [Step 5] Reference Enhancement: 10%|█ | 11/109 [00:03<00:15, 6.45it/s] [Step 5] Reference Enhancement: 11%|█ | 12/109 [00:03<00:14, 6.61it/s] [Step 5] Reference Enhancement: 12%|█▏ | 13/109 [00:03<00:14, 6.76it/s] [Step 5] Reference Enhancement: 13%|█▎ | 14/109 [00:03<00:13, 6.90it/s] [Step 5] Reference Enhancement: 14%|█▍ | 15/109 [00:03<00:13, 6.94it/s] [Step 5] Reference Enhancement: 15%|█▍ | 16/109 [00:03<00:13, 7.02it/s] [Step 5] Reference Enhancement: 16%|█▌ | 17/109 [00:03<00:12, 7.11it/s] [Step 5] Reference Enhancement: 17%|█▋ | 18/109 [00:04<00:12, 7.16it/s] [Step 5] Reference Enhancement: 17%|█▋ | 19/109 [00:04<00:12, 7.11it/s] [Step 5] Reference Enhancement: 18%|█▊ | 20/109 [00:04<00:12, 7.15it/s] [Step 5] Reference Enhancement: 19%|█▉ | 21/109 [00:04<00:12, 7.12it/s] [Step 5] Reference Enhancement: 20%|██ | 22/109 [00:04<00:12, 7.13it/s] [Step 5] Reference Enhancement: 21%|██ | 23/109 [00:04<00:12, 7.11it/s] [Step 5] Reference Enhancement: 22%|██▏ | 24/109 [00:04<00:11, 7.12it/s] [Step 5] Reference Enhancement: 23%|██▎ | 25/109 [00:05<00:11, 7.10it/s] [Step 5] Reference Enhancement: 24%|██▍ | 26/109 [00:05<00:11, 7.10it/s] [Step 5] Reference Enhancement: 25%|██▍ | 27/109 [00:05<00:11, 7.09it/s] [Step 5] Reference Enhancement: 26%|██▌ | 28/109 [00:05<00:11, 7.11it/s] [Step 5] Reference Enhancement: 27%|██▋ | 29/109 [00:05<00:11, 7.08it/s] [Step 5] Reference Enhancement: 28%|██▊ | 30/109 [00:05<00:11, 7.09it/s] [Step 5] Reference Enhancement: 28%|██▊ | 31/109 [00:05<00:11, 7.08it/s] [Step 5] Reference Enhancement: 29%|██▉ | 32/109 [00:06<00:10, 7.12it/s] [Step 5] Reference Enhancement: 30%|███ | 33/109 [00:06<00:10, 7.12it/s] [Step 5] Reference Enhancement: 31%|███ | 34/109 [00:06<00:10, 7.11it/s] [Step 5] Reference Enhancement: 32%|███▏ | 35/109 [00:06<00:10, 7.09it/s] [Step 5] Reference Enhancement: 33%|███▎ | 36/109 [00:06<00:10, 7.12it/s] [Step 5] Reference Enhancement: 34%|███▍ | 37/109 [00:06<00:10, 7.10it/s] [Step 5] Reference Enhancement: 35%|███▍ | 38/109 [00:06<00:09, 7.13it/s] [Step 5] Reference Enhancement: 36%|███▌ | 39/109 [00:07<00:09, 7.14it/s] [Step 5] Reference Enhancement: 37%|███▋ | 40/109 [00:07<00:09, 7.12it/s] [Step 5] Reference Enhancement: 38%|███▊ | 41/109 [00:07<00:09, 7.13it/s] [Step 5] Reference Enhancement: 39%|███▊ | 42/109 [00:07<00:09, 7.12it/s] [Step 5] Reference Enhancement: 39%|███▉ | 43/109 [00:07<00:09, 7.09it/s] [Step 5] Reference Enhancement: 40%|████ | 44/109 [00:07<00:09, 7.13it/s] [Step 5] Reference Enhancement: 41%|████▏ | 45/109 [00:07<00:08, 7.12it/s] [Step 5] Reference Enhancement: 42%|████▏ | 46/109 [00:08<00:08, 7.15it/s] [Step 5] Reference Enhancement: 43%|████▎ | 47/109 [00:08<00:08, 7.13it/s] [Step 5] Reference Enhancement: 44%|████▍ | 48/109 [00:08<00:08, 7.09it/s] [Step 5] Reference Enhancement: 45%|████▍ | 49/109 [00:08<00:08, 7.05it/s] [Step 5] Reference Enhancement: 46%|████▌ | 50/109 [00:08<00:08, 7.08it/s] [Step 5] Reference Enhancement: 47%|████▋ | 51/109 [00:08<00:08, 7.09it/s] [Step 5] Reference Enhancement: 48%|████▊ | 52/109 [00:08<00:08, 7.11it/s] [Step 5] Reference Enhancement: 49%|████▊ | 53/109 [00:09<00:07, 7.14it/s] [Step 5] Reference Enhancement: 50%|████▉ | 54/109 [00:09<00:07, 7.10it/s] [Step 5] Reference Enhancement: 50%|█████ | 55/109 [00:09<00:07, 7.12it/s] [Step 5] Reference Enhancement: 51%|█████▏ | 56/109 [00:09<00:07, 7.10it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 57/109 [00:09<00:07, 7.05it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 58/109 [00:09<00:07, 7.06it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 59/109 [00:09<00:07, 7.06it/s] [Step 5] Reference Enhancement: 55%|█████▌ | 60/109 [00:10<00:06, 7.10it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 61/109 [00:10<00:06, 7.08it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 62/109 [00:10<00:06, 7.08it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 63/109 [00:10<00:06, 7.08it/s] [Step 5] Reference Enhancement: 59%|█████▊ | 64/109 [00:10<00:06, 7.14it/s] [Step 5] Reference Enhancement: 60%|█████▉ | 65/109 [00:10<00:06, 7.13it/s] [Step 5] Reference Enhancement: 61%|██████ | 66/109 [00:10<00:05, 7.19it/s] [Step 5] Reference Enhancement: 61%|██████▏ | 67/109 [00:11<00:05, 7.15it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 68/109 [00:11<00:05, 7.10it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 69/109 [00:11<00:05, 7.14it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 70/109 [00:11<00:05, 7.18it/s] [Step 5] Reference Enhancement: 65%|██████▌ | 71/109 [00:11<00:05, 7.14it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 72/109 [00:11<00:05, 7.13it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 73/109 [00:11<00:05, 7.15it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 74/109 [00:11<00:04, 7.14it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 75/109 [00:12<00:04, 7.17it/s] [Step 5] Reference Enhancement: 70%|██████▉ | 76/109 [00:12<00:04, 7.17it/s] [Step 5] Reference Enhancement: 71%|███████ | 77/109 [00:12<00:04, 7.13it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 78/109 [00:12<00:04, 7.14it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 79/109 [00:12<00:04, 7.10it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 80/109 [00:12<00:04, 7.08it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 81/109 [00:12<00:03, 7.09it/s] [Step 5] Reference Enhancement: 75%|███████▌ | 82/109 [00:13<00:03, 7.11it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 83/109 [00:13<00:03, 7.11it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 84/109 [00:13<00:03, 7.09it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 85/109 [00:13<00:03, 7.09it/s] [Step 5] Reference Enhancement: 79%|███████▉ | 86/109 [00:13<00:03, 7.06it/s] [Step 5] Reference Enhancement: 80%|███████▉ | 87/109 [00:13<00:03, 7.12it/s] [Step 5] Reference Enhancement: 81%|████████ | 88/109 [00:13<00:02, 7.09it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 89/109 [00:14<00:02, 7.15it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 90/109 [00:14<00:02, 7.19it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 91/109 [00:14<00:02, 7.15it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 92/109 [00:14<00:02, 7.16it/s] [Step 5] Reference Enhancement: 85%|████████▌ | 93/109 [00:14<00:02, 7.13it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 94/109 [00:14<00:02, 7.12it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 95/109 [00:14<00:01, 7.14it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 96/109 [00:15<00:01, 7.15it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 97/109 [00:15<00:01, 7.10it/s] [Step 5] Reference Enhancement: 90%|████████▉ | 98/109 [00:15<00:01, 7.09it/s] [Step 5] Reference Enhancement: 91%|█████████ | 99/109 [00:15<00:01, 7.05it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 100/109 [00:15<00:01, 7.08it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 101/109 [00:15<00:01, 7.10it/s] [Step 5] Reference Enhancement: 94%|█████████▎| 102/109 [00:15<00:00, 7.14it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 103/109 [00:16<00:00, 7.12it/s] [Step 5] Reference Enhancement: 95%|█████████▌| 104/109 [00:16<00:00, 7.15it/s] [Step 5] Reference Enhancement: 96%|█████████▋| 105/109 [00:16<00:00, 7.16it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 106/109 [00:16<00:00, 7.21it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 107/109 [00:16<00:00, 7.17it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 108/109 [00:16<00:00, 7.14it/s] [Step 5] Reference Enhancement: 100%|██████████| 109/109 [00:16<00:00, 7.13it/s] [Step 5] Reference Enhancement: 100%|██████████| 109/109 [00:16<00:00, 6.45it/s] [Step 6] Lip Synthesis:: 0%| | 0/7 [00:00<?, ?it/s] landmark Det:: 0%| | 0/109 [00:00<?, ?it/s] landmark Det:: 1%| | 1/109 [00:00<00:19, 5.44it/s] landmark Det:: 2%|▏ | 2/109 [00:00<00:35, 2.98it/s] landmark Det:: 8%|▊ | 9/109 [00:00<00:06, 16.15it/s] landmark Det:: 15%|█▍ | 16/109 [00:00<00:03, 27.44it/s] landmark Det:: 21%|██ | 23/109 [00:00<00:02, 36.76it/s] landmark Det:: 28%|██▊ | 30/109 [00:01<00:01, 44.03it/s] landmark Det:: 34%|███▍ | 37/109 [00:01<00:01, 49.62it/s] landmark Det:: 40%|████ | 44/109 [00:01<00:01, 53.25it/s] landmark Det:: 47%|████▋ | 51/109 [00:01<00:01, 56.15it/s] landmark Det:: 53%|█████▎ | 58/109 [00:01<00:00, 58.88it/s] landmark Det:: 60%|█████▉ | 65/109 [00:01<00:00, 51.52it/s] landmark Det:: 65%|██████▌ | 71/109 [00:01<00:00, 51.34it/s] landmark Det:: 72%|███████▏ | 78/109 [00:01<00:00, 54.51it/s] landmark Det:: 78%|███████▊ | 85/109 [00:02<00:00, 57.19it/s] landmark Det:: 84%|████████▍ | 92/109 [00:02<00:00, 59.09it/s] landmark Det:: 91%|█████████ | 99/109 [00:02<00:00, 60.39it/s] landmark Det:: 97%|█████████▋| 106/109 [00:02<00:00, 61.38it/s] landmark Det:: 100%|██████████| 109/109 [00:02<00:00, 45.67it/s] 0%| | 0/109 [00:00<?, ?it/s] 100%|██████████| 109/109 [00:00<00:00, 19772.47it/s] 0%| | 0/109 [00:00<?, ?it/s] 61%|██████ | 66/109 [00:00<00:00, 656.02it/s] 100%|██████████| 109/109 [00:00<00:00, 663.59it/s] FaceDet:: 0%| | 0/28 [00:00<?, ?it/s] FaceDet:: 4%|▎ | 1/28 [00:00<00:21, 1.27it/s] FaceDet:: 7%|▋ | 2/28 [00:00<00:10, 2.48it/s] FaceDet:: 11%|█ | 3/28 [00:01<00:06, 3.58it/s] FaceDet:: 14%|█▍ | 4/28 [00:01<00:05, 4.53it/s] FaceDet:: 18%|█▊ | 5/28 [00:01<00:04, 5.31it/s] FaceDet:: 21%|██▏ | 6/28 [00:01<00:03, 5.96it/s] FaceDet:: 25%|██▌ | 7/28 [00:01<00:03, 6.43it/s] FaceDet:: 29%|██▊ | 8/28 [00:01<00:02, 6.75it/s] FaceDet:: 32%|███▏ | 9/28 [00:01<00:02, 6.93it/s] FaceDet:: 36%|███▌ | 10/28 [00:01<00:02, 7.13it/s] FaceDet:: 39%|███▉ | 11/28 [00:02<00:02, 7.24it/s] FaceDet:: 43%|████▎ | 12/28 [00:02<00:02, 7.33it/s] FaceDet:: 46%|████▋ | 13/28 [00:02<00:02, 7.42it/s] FaceDet:: 50%|█████ | 14/28 [00:02<00:01, 7.47it/s] FaceDet:: 54%|█████▎ | 15/28 [00:02<00:01, 7.53it/s] FaceDet:: 57%|█████▋ | 16/28 [00:02<00:01, 7.58it/s] FaceDet:: 61%|██████ | 17/28 [00:02<00:01, 7.60it/s] FaceDet:: 64%|██████▍ | 18/28 [00:03<00:01, 7.61it/s] FaceDet:: 68%|██████▊ | 19/28 [00:03<00:01, 7.64it/s] FaceDet:: 71%|███████▏ | 20/28 [00:03<00:01, 7.65it/s] FaceDet:: 75%|███████▌ | 21/28 [00:03<00:00, 7.54it/s] FaceDet:: 79%|███████▊ | 22/28 [00:03<00:00, 7.57it/s] FaceDet:: 82%|████████▏ | 23/28 [00:03<00:00, 7.60it/s] FaceDet:: 86%|████████▌ | 24/28 [00:03<00:00, 7.62it/s] FaceDet:: 89%|████████▉ | 25/28 [00:03<00:00, 7.65it/s] FaceDet:: 93%|█████████▎| 26/28 [00:04<00:00, 7.66it/s] FaceDet:: 96%|█████████▋| 27/28 [00:04<00:00, 7.66it/s] FaceDet:: 100%|██████████| 28/28 [00:04<00:00, 5.33it/s] FaceDet:: 100%|██████████| 28/28 [00:04<00:00, 6.19it/s] [Step 6] Lip Synthesis:: 14%|█▍ | 1/7 [00:21<02:08, 21.41s/it] [Step 6] Lip Synthesis:: 29%|██▊ | 2/7 [00:27<01:01, 12.36s/it] [Step 6] Lip Synthesis:: 43%|████▎ | 3/7 [00:33<00:38, 9.51s/it] [Step 6] Lip Synthesis:: 57%|█████▋ | 4/7 [00:39<00:24, 8.10s/it] [Step 6] Lip Synthesis:: 71%|███████▏ | 5/7 [00:45<00:14, 7.40s/it] [Step 6] Lip Synthesis:: 86%|████████▌ | 6/7 [00:51<00:06, 6.95s/it] [Step 6] Lip Synthesis:: 100%|██████████| 7/7 [01:01<00:00, 7.94s/it] [Step 6] Lip Synthesis:: 100%|██████████| 7/7 [01:01<00:00, 8.81s/it]Prediction
chenxwh/video-retalking:db5a650cIDvgs4qulb2gggvnrs5777uoxniqStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- face
- input_audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "face": "https://replicate.delivery/pbxt/JnnkC50La9eVL1Q4RqfBeShyg1UJ9TzmJFPbOSxaC4e8OL6Z/5.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnkCFgdzCo7RvCGVnxnSj1ttjvmps3PCQZlL8ohbsIJXFcU/1.wav" }npm install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the clientimport Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", { input: { face: "https://replicate.delivery/pbxt/JnnkC50La9eVL1Q4RqfBeShyg1UJ9TzmJFPbOSxaC4e8OL6Z/5.mp4", input_audio: "https://replicate.delivery/pbxt/JnnkCFgdzCo7RvCGVnxnSj1ttjvmps3PCQZlL8ohbsIJXFcU/1.wav" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
pip install replicateSet theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the clientimport replicateRun chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "chenxwh/video-retalking:db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", input={ "face": "https://replicate.delivery/pbxt/JnnkC50La9eVL1Q4RqfBeShyg1UJ9TzmJFPbOSxaC4e8OL6Z/5.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnkCFgdzCo7RvCGVnxnSj1ttjvmps3PCQZlL8ohbsIJXFcU/1.wav" } ) print(output)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variableexport REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run chenxwh/video-retalking using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "db5a650c807b007dc5f9e5abe27c53e1b62880d1f94d218d27ce7fa802711d67", "input": { "face": "https://replicate.delivery/pbxt/JnnkC50La9eVL1Q4RqfBeShyg1UJ9TzmJFPbOSxaC4e8OL6Z/5.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnkCFgdzCo7RvCGVnxnSj1ttjvmps3PCQZlL8ohbsIJXFcU/1.wav" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
{ "completed_at": "2023-11-01T17:28:52.462831Z", "created_at": "2023-11-01T17:27:31.418917Z", "data_removed": false, "error": null, "id": "vgs4qulb2gggvnrs5777uoxniq", "input": { "face": "https://replicate.delivery/pbxt/JnnkC50La9eVL1Q4RqfBeShyg1UJ9TzmJFPbOSxaC4e8OL6Z/5.mp4", "input_audio": "https://replicate.delivery/pbxt/JnnkCFgdzCo7RvCGVnxnSj1ttjvmps3PCQZlL8ohbsIJXFcU/1.wav" }, "logs": "[Step 1] Landmarks Extraction in Video.\nlandmark Det:: 0%| | 0/122 [00:00<?, ?it/s]\nlandmark Det:: 5%|▍ | 6/122 [00:00<00:02, 56.01it/s]\nlandmark Det:: 11%|█ | 13/122 [00:00<00:01, 60.99it/s]\nlandmark Det:: 16%|█▋ | 20/122 [00:00<00:01, 63.92it/s]\nlandmark Det:: 22%|██▏ | 27/122 [00:00<00:01, 63.58it/s]\nlandmark Det:: 28%|██▊ | 34/122 [00:00<00:01, 63.32it/s]\nlandmark Det:: 34%|███▎ | 41/122 [00:00<00:01, 63.20it/s]\nlandmark Det:: 39%|███▉ | 48/122 [00:00<00:01, 63.09it/s]\nlandmark Det:: 45%|████▌ | 55/122 [00:00<00:01, 63.93it/s]\nlandmark Det:: 51%|█████ | 62/122 [00:00<00:00, 64.92it/s]\nlandmark Det:: 57%|█████▋ | 69/122 [00:01<00:00, 63.26it/s]\nlandmark Det:: 62%|██████▏ | 76/122 [00:01<00:00, 64.15it/s]\nlandmark Det:: 68%|██████▊ | 83/122 [00:01<00:00, 64.13it/s]\nlandmark Det:: 74%|███████▍ | 90/122 [00:01<00:00, 64.14it/s]\nlandmark Det:: 80%|███████▉ | 97/122 [00:01<00:00, 64.06it/s]\nlandmark Det:: 85%|████████▌ | 104/122 [00:01<00:00, 63.99it/s]\nlandmark Det:: 91%|█████████ | 111/122 [00:01<00:00, 63.82it/s]\nlandmark Det:: 97%|█████████▋| 118/122 [00:01<00:00, 64.56it/s]\nlandmark Det:: 100%|██████████| 122/122 [00:01<00:00, 63.65it/s]\n[Step 2] 3DMM Extraction In Video:: 0%| | 0/122 [00:00<?, ?it/s]\n[Step 2] 3DMM Extraction In Video:: 10%|▉ | 12/122 [00:00<00:00, 118.36it/s]\n[Step 2] 3DMM Extraction In Video:: 21%|██▏ | 26/122 [00:00<00:00, 125.83it/s]\n[Step 2] 3DMM Extraction In Video:: 33%|███▎ | 40/122 [00:00<00:00, 128.68it/s]\n[Step 2] 3DMM Extraction In Video:: 44%|████▍ | 54/122 [00:00<00:00, 130.13it/s]\n[Step 2] 3DMM Extraction In Video:: 56%|█████▌ | 68/122 [00:00<00:00, 131.22it/s]\n[Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 82/122 [00:00<00:00, 131.47it/s]\n[Step 2] 3DMM Extraction In Video:: 79%|███████▊ | 96/122 [00:00<00:00, 132.02it/s]\n[Step 2] 3DMM Extraction In Video:: 90%|█████████ | 110/122 [00:00<00:00, 132.14it/s]\n[Step 2] 3DMM Extraction In Video:: 100%|██████████| 122/122 [00:00<00:00, 130.68it/s]\nusing expression center\nLoad checkpoint from: checkpoints/DNet.pt\nLoad checkpoint from: checkpoints/LNet.pth\nLoad checkpoint from: checkpoints/ENet.pth\n[Step 3] Stabilize the expression In Video:: 0%| | 0/122 [00:00<?, ?it/s]\n[Step 3] Stabilize the expression In Video:: 2%|▏ | 2/122 [00:00<00:09, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 3%|▎ | 4/122 [00:00<00:09, 12.85it/s]\n[Step 3] Stabilize the expression In Video:: 5%|▍ | 6/122 [00:00<00:08, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 7%|▋ | 8/122 [00:00<00:08, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 8%|▊ | 10/122 [00:00<00:08, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 10%|▉ | 12/122 [00:00<00:08, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 11%|█▏ | 14/122 [00:01<00:08, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 13%|█▎ | 16/122 [00:01<00:08, 12.49it/s]\n[Step 3] Stabilize the expression In Video:: 15%|█▍ | 18/122 [00:01<00:08, 12.60it/s]\n[Step 3] Stabilize the expression In Video:: 16%|█▋ | 20/122 [00:01<00:08, 12.67it/s]\n[Step 3] Stabilize the expression In Video:: 18%|█▊ | 22/122 [00:01<00:07, 12.76it/s]\n[Step 3] Stabilize the expression In Video:: 20%|█▉ | 24/122 [00:01<00:07, 12.82it/s]\n[Step 3] Stabilize the expression In Video:: 21%|██▏ | 26/122 [00:02<00:07, 12.87it/s]\n[Step 3] Stabilize the expression In Video:: 23%|██▎ | 28/122 [00:02<00:07, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 25%|██▍ | 30/122 [00:02<00:07, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 26%|██▌ | 32/122 [00:02<00:07, 12.64it/s]\n[Step 3] Stabilize the expression In Video:: 28%|██▊ | 34/122 [00:02<00:06, 12.73it/s]\n[Step 3] Stabilize the expression In Video:: 30%|██▉ | 36/122 [00:02<00:06, 12.81it/s]\n[Step 3] Stabilize the expression In Video:: 31%|███ | 38/122 [00:02<00:06, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 33%|███▎ | 40/122 [00:03<00:06, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 34%|███▍ | 42/122 [00:03<00:06, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 36%|███▌ | 44/122 [00:03<00:06, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 38%|███▊ | 46/122 [00:03<00:05, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 39%|███▉ | 48/122 [00:03<00:05, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 41%|████ | 50/122 [00:03<00:05, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 43%|████▎ | 52/122 [00:04<00:05, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 44%|████▍ | 54/122 [00:04<00:05, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 46%|████▌ | 56/122 [00:04<00:05, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 48%|████▊ | 58/122 [00:04<00:04, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 49%|████▉ | 60/122 [00:04<00:04, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 51%|█████ | 62/122 [00:04<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 52%|█████▏ | 64/122 [00:04<00:04, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 54%|█████▍ | 66/122 [00:05<00:04, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 56%|█████▌ | 68/122 [00:05<00:04, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 57%|█████▋ | 70/122 [00:05<00:04, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 59%|█████▉ | 72/122 [00:05<00:03, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 61%|██████ | 74/122 [00:05<00:03, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 62%|██████▏ | 76/122 [00:05<00:03, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 64%|██████▍ | 78/122 [00:06<00:03, 12.92it/s]\n[Step 3] Stabilize the expression In Video:: 66%|██████▌ | 80/122 [00:06<00:03, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 67%|██████▋ | 82/122 [00:06<00:03, 12.96it/s]\n[Step 3] Stabilize the expression In Video:: 69%|██████▉ | 84/122 [00:06<00:02, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 70%|███████ | 86/122 [00:06<00:02, 12.96it/s]\n[Step 3] Stabilize the expression In Video:: 72%|███████▏ | 88/122 [00:06<00:02, 12.97it/s]\n[Step 3] Stabilize the expression In Video:: 74%|███████▍ | 90/122 [00:06<00:02, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 75%|███████▌ | 92/122 [00:07<00:02, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 77%|███████▋ | 94/122 [00:07<00:02, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 79%|███████▊ | 96/122 [00:07<00:02, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 80%|████████ | 98/122 [00:07<00:01, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 82%|████████▏ | 100/122 [00:07<00:01, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 84%|████████▎ | 102/122 [00:07<00:01, 12.91it/s]\n[Step 3] Stabilize the expression In Video:: 85%|████████▌ | 104/122 [00:08<00:01, 12.93it/s]\n[Step 3] Stabilize the expression In Video:: 87%|████████▋ | 106/122 [00:08<00:01, 12.94it/s]\n[Step 3] Stabilize the expression In Video:: 89%|████████▊ | 108/122 [00:08<00:01, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 90%|█████████ | 110/122 [00:08<00:00, 12.84it/s]\n[Step 3] Stabilize the expression In Video:: 92%|█████████▏| 112/122 [00:08<00:00, 12.86it/s]\n[Step 3] Stabilize the expression In Video:: 93%|█████████▎| 114/122 [00:08<00:00, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 95%|█████████▌| 116/122 [00:09<00:00, 12.88it/s]\n[Step 3] Stabilize the expression In Video:: 97%|█████████▋| 118/122 [00:09<00:00, 12.89it/s]\n[Step 3] Stabilize the expression In Video:: 98%|█████████▊| 120/122 [00:09<00:00, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 122/122 [00:09<00:00, 12.90it/s]\n[Step 3] Stabilize the expression In Video:: 100%|██████████| 122/122 [00:09<00:00, 12.88it/s]\n[Step 4] Load audio; Length of mel chunks: 122\n[Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s]\n[Step 5] Reference Enhancement: 1%| | 1/122 [00:00<00:18, 6.69it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:00<00:17, 6.91it/s]\n[Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:00<00:17, 6.98it/s]\n[Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:00<00:16, 7.01it/s]\n[Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:00<00:16, 7.06it/s]\n[Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:00<00:16, 7.07it/s]\n[Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:00<00:16, 7.08it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:01<00:16, 7.06it/s]\n[Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:01<00:16, 7.05it/s]\n[Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:01<00:15, 7.06it/s]\n[Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:01<00:15, 7.05it/s]\n[Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:01<00:15, 7.07it/s]\n[Step 5] Reference Enhancement: 11%|█ | 13/122 [00:01<00:15, 7.05it/s]\n[Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:01<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:02<00:15, 7.09it/s]\n[Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:02<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:02<00:14, 7.07it/s]\n[Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:02<00:14, 7.00it/s]\n[Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:02<00:14, 7.01it/s]\n[Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:02<00:14, 7.04it/s]\n[Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:02<00:14, 7.04it/s]\n[Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:03<00:14, 7.03it/s]\n[Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:03<00:14, 7.04it/s]\n[Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:03<00:13, 7.07it/s]\n[Step 5] Reference Enhancement: 20%|██ | 25/122 [00:03<00:13, 7.06it/s]\n[Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:03<00:13, 7.06it/s]\n[Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:03<00:13, 7.03it/s]\n[Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:03<00:13, 7.06it/s]\n[Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:04<00:13, 7.03it/s]\n[Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:04<00:13, 7.04it/s]\n[Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:04<00:12, 7.03it/s]\n[Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:04<00:12, 6.99it/s]\n[Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:04<00:12, 7.05it/s]\n[Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:04<00:12, 7.07it/s]\n[Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:04<00:12, 7.04it/s]\n[Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:05<00:12, 7.09it/s]\n[Step 5] Reference Enhancement: 30%|███ | 37/122 [00:05<00:12, 7.08it/s]\n[Step 5] Reference Enhancement: 31%|███ | 38/122 [00:05<00:11, 7.11it/s]\n[Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:05<00:11, 7.11it/s]\n[Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:05<00:11, 7.13it/s]\n[Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:05<00:11, 7.09it/s]\n[Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:05<00:11, 7.06it/s]\n[Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:06<00:11, 7.08it/s]\n[Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:06<00:11, 7.07it/s]\n[Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:06<00:10, 7.05it/s]\n[Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:06<00:10, 7.04it/s]\n[Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:06<00:10, 7.04it/s]\n[Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:06<00:10, 7.01it/s]\n[Step 5] Reference Enhancement: 40%|████ | 49/122 [00:06<00:10, 6.98it/s]\n[Step 5] Reference Enhancement: 41%|████ | 50/122 [00:07<00:10, 7.01it/s]\n[Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:07<00:10, 7.02it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:07<00:09, 7.06it/s]\n[Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:07<00:09, 7.07it/s]\n[Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:07<00:09, 7.07it/s]\n[Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:07<00:09, 7.03it/s]\n[Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:07<00:09, 7.06it/s]\n[Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:08<00:09, 7.07it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:08<00:09, 7.06it/s]\n[Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:08<00:08, 7.06it/s]\n[Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:08<00:08, 7.08it/s]\n[Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:08<00:08, 7.07it/s]\n[Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:08<00:08, 7.06it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:08<00:08, 7.03it/s]\n[Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:09<00:08, 7.04it/s]\n[Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:09<00:08, 7.05it/s]\n[Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:09<00:07, 7.05it/s]\n[Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:09<00:07, 7.02it/s]\n[Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:09<00:07, 7.04it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:09<00:07, 7.04it/s]\n[Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:09<00:07, 7.05it/s]\n[Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:10<00:07, 7.08it/s]\n[Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:10<00:07, 7.08it/s]\n[Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:10<00:06, 7.09it/s]\n[Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:10<00:06, 7.06it/s]\n[Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:10<00:06, 7.10it/s]\n[Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:10<00:06, 7.11it/s]\n[Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:10<00:06, 7.10it/s]\n[Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.06it/s]\n[Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:11<00:06, 7.02it/s]\n[Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:11<00:05, 7.04it/s]\n[Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:11<00:05, 7.03it/s]\n[Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:11<00:05, 7.03it/s]\n[Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:11<00:05, 7.05it/s]\n[Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:11<00:05, 7.07it/s]\n[Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:12<00:05, 7.09it/s]\n[Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:12<00:05, 7.06it/s]\n[Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:12<00:04, 7.07it/s]\n[Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:12<00:04, 7.13it/s]\n[Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:12<00:04, 7.08it/s]\n[Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:12<00:04, 7.07it/s]\n[Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:12<00:04, 7.05it/s]\n[Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:13<00:04, 7.07it/s]\n[Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:13<00:04, 7.07it/s]\n[Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:13<00:03, 7.11it/s]\n[Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:13<00:03, 7.10it/s]\n[Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:13<00:03, 7.09it/s]\n[Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:13<00:03, 7.09it/s]\n[Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:13<00:03, 7.09it/s]\n[Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:14<00:03, 7.08it/s]\n[Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:14<00:03, 7.06it/s]\n[Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:14<00:02, 7.08it/s]\n[Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:14<00:02, 7.07it/s]\n[Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:14<00:02, 7.04it/s]\n[Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:14<00:02, 7.06it/s]\n[Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:14<00:02, 7.08it/s]\n[Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:15<00:02, 7.10it/s]\n[Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:15<00:02, 7.11it/s]\n[Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:15<00:01, 7.08it/s]\n[Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:15<00:01, 7.09it/s]\n[Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:15<00:01, 7.08it/s]\n[Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:15<00:01, 7.09it/s]\n[Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:15<00:01, 7.06it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:16<00:01, 7.06it/s]\n[Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:16<00:01, 7.11it/s]\n[Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:16<00:00, 7.11it/s]\n[Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:16<00:00, 7.08it/s]\n[Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:16<00:00, 7.08it/s]\n[Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:16<00:00, 7.08it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:16<00:00, 7.10it/s]\n[Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:16<00:00, 7.07it/s]\n[Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:17<00:00, 7.07it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.05it/s]\n[Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.06it/s]\n[Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s]\nlandmark Det:: 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\nlandmark Det:: 1%| | 1/122 [00:00<00:21, 5.51it/s]\u001b[A\nlandmark Det:: 2%|▏ | 2/122 [00:00<00:39, 3.02it/s]\u001b[A\nlandmark Det:: 7%|▋ | 9/122 [00:00<00:06, 16.19it/s]\u001b[A\nlandmark Det:: 13%|█▎ | 16/122 [00:00<00:03, 27.73it/s]\u001b[A\nlandmark Det:: 19%|█▉ | 23/122 [00:00<00:02, 37.39it/s]\u001b[A\nlandmark Det:: 25%|██▍ | 30/122 [00:01<00:02, 44.89it/s]\u001b[A\nlandmark Det:: 30%|███ | 37/122 [00:01<00:01, 50.94it/s]\u001b[A\nlandmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 54.33it/s]\u001b[A\nlandmark Det:: 42%|████▏ | 51/122 [00:01<00:01, 56.96it/s]\u001b[A\nlandmark Det:: 48%|████▊ | 58/122 [00:01<00:01, 59.66it/s]\u001b[A\nlandmark Det:: 53%|█████▎ | 65/122 [00:01<00:00, 62.09it/s]\u001b[A\nlandmark Det:: 59%|█████▉ | 72/122 [00:01<00:00, 63.81it/s]\u001b[A\nlandmark Det:: 65%|██████▍ | 79/122 [00:01<00:00, 64.49it/s]\u001b[A\nlandmark Det:: 70%|███████ | 86/122 [00:01<00:00, 65.20it/s]\u001b[A\nlandmark Det:: 76%|███████▌ | 93/122 [00:02<00:00, 64.97it/s]\u001b[A\nlandmark Det:: 82%|████████▏ | 100/122 [00:02<00:00, 64.76it/s]\u001b[A\nlandmark Det:: 88%|████████▊ | 107/122 [00:02<00:00, 63.32it/s]\u001b[A\nlandmark Det:: 93%|█████████▎| 114/122 [00:02<00:00, 64.13it/s]\u001b[A\nlandmark Det:: 99%|█████████▉| 121/122 [00:02<00:00, 64.05it/s]\u001b[A\nlandmark Det:: 100%|██████████| 122/122 [00:02<00:00, 49.65it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 20666.60it/s]\n 0%| | 0/122 [00:00<?, ?it/s]\u001b[A\n 52%|█████▏ | 64/122 [00:00<00:00, 639.89it/s]\u001b[A\n100%|██████████| 122/122 [00:00<00:00, 642.65it/s]\nFaceDet:: 0%| | 0/31 [00:00<?, ?it/s]\u001b[A\nFaceDet:: 3%|▎ | 1/31 [00:00<00:16, 1.86it/s]\u001b[A\nFaceDet:: 10%|▉ | 3/31 [00:00<00:05, 4.80it/s]\u001b[A\nFaceDet:: 16%|█▌ | 5/31 [00:00<00:03, 6.92it/s]\u001b[A\nFaceDet:: 23%|██▎ | 7/31 [00:01<00:02, 8.23it/s]\u001b[A\nFaceDet:: 29%|██▉ | 9/31 [00:01<00:02, 9.20it/s]\u001b[A\nFaceDet:: 35%|███▌ | 11/31 [00:01<00:02, 9.65it/s]\u001b[A\nFaceDet:: 42%|████▏ | 13/31 [00:01<00:01, 10.12it/s]\u001b[A\nFaceDet:: 48%|████▊ | 15/31 [00:01<00:01, 10.44it/s]\u001b[A\nFaceDet:: 55%|█████▍ | 17/31 [00:01<00:01, 10.49it/s]\u001b[A\nFaceDet:: 61%|██████▏ | 19/31 [00:02<00:01, 10.56it/s]\u001b[A\nFaceDet:: 68%|██████▊ | 21/31 [00:02<00:00, 10.62it/s]\u001b[A\nFaceDet:: 74%|███████▍ | 23/31 [00:02<00:00, 10.76it/s]\u001b[A\nFaceDet:: 81%|████████ | 25/31 [00:02<00:00, 10.88it/s]\u001b[A\nFaceDet:: 87%|████████▋ | 27/31 [00:02<00:00, 11.03it/s]\u001b[A\nFaceDet:: 94%|█████████▎| 29/31 [00:03<00:00, 11.21it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:03<00:00, 7.98it/s]\u001b[A\nFaceDet:: 100%|██████████| 31/31 [00:03<00:00, 8.91it/s]\n[Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:12<01:29, 12.78s/it]\n[Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:17<00:48, 8.16s/it]\n[Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:22<00:33, 6.70s/it]\n[Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:27<00:23, 5.99s/it]\n[Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:32<00:16, 5.61s/it]\n[Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:37<00:10, 5.39s/it]\n[Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [00:42<00:05, 5.33s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [00:45<00:00, 4.62s/it]\n[Step 6] Lip Synthesis:: 100%|██████████| 8/8 [00:45<00:00, 5.72s/it]", "metrics": { "predict_time": 81.032523, "total_time": 81.043914 }, "output": "https://replicate.delivery/pbxt/Nr7sSoGRlEa9O1A3AcOjifxfXIxCfUKdDmUiPPztFVCnmHojA/output.mp4", "started_at": "2023-11-01T17:27:31.430308Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/vgs4qulb2gggvnrs5777uoxniq", "cancel": "https://api.replicate.com/v1/predictions/vgs4qulb2gggvnrs5777uoxniq/cancel" }, "version": "a0dbf0b26be3a3d249473aa11fe197126a05f12e439199a0074151ae1fa47c3c" }Generated in[Step 1] Landmarks Extraction in Video. landmark Det:: 0%| | 0/122 [00:00<?, ?it/s] landmark Det:: 5%|▍ | 6/122 [00:00<00:02, 56.01it/s] landmark Det:: 11%|█ | 13/122 [00:00<00:01, 60.99it/s] landmark Det:: 16%|█▋ | 20/122 [00:00<00:01, 63.92it/s] landmark Det:: 22%|██▏ | 27/122 [00:00<00:01, 63.58it/s] landmark Det:: 28%|██▊ | 34/122 [00:00<00:01, 63.32it/s] landmark Det:: 34%|███▎ | 41/122 [00:00<00:01, 63.20it/s] landmark Det:: 39%|███▉ | 48/122 [00:00<00:01, 63.09it/s] landmark Det:: 45%|████▌ | 55/122 [00:00<00:01, 63.93it/s] landmark Det:: 51%|█████ | 62/122 [00:00<00:00, 64.92it/s] landmark Det:: 57%|█████▋ | 69/122 [00:01<00:00, 63.26it/s] landmark Det:: 62%|██████▏ | 76/122 [00:01<00:00, 64.15it/s] landmark Det:: 68%|██████▊ | 83/122 [00:01<00:00, 64.13it/s] landmark Det:: 74%|███████▍ | 90/122 [00:01<00:00, 64.14it/s] landmark Det:: 80%|███████▉ | 97/122 [00:01<00:00, 64.06it/s] landmark Det:: 85%|████████▌ | 104/122 [00:01<00:00, 63.99it/s] landmark Det:: 91%|█████████ | 111/122 [00:01<00:00, 63.82it/s] landmark Det:: 97%|█████████▋| 118/122 [00:01<00:00, 64.56it/s] landmark Det:: 100%|██████████| 122/122 [00:01<00:00, 63.65it/s] [Step 2] 3DMM Extraction In Video:: 0%| | 0/122 [00:00<?, ?it/s] [Step 2] 3DMM Extraction In Video:: 10%|▉ | 12/122 [00:00<00:00, 118.36it/s] [Step 2] 3DMM Extraction In Video:: 21%|██▏ | 26/122 [00:00<00:00, 125.83it/s] [Step 2] 3DMM Extraction In Video:: 33%|███▎ | 40/122 [00:00<00:00, 128.68it/s] [Step 2] 3DMM Extraction In Video:: 44%|████▍ | 54/122 [00:00<00:00, 130.13it/s] [Step 2] 3DMM Extraction In Video:: 56%|█████▌ | 68/122 [00:00<00:00, 131.22it/s] [Step 2] 3DMM Extraction In Video:: 67%|██████▋ | 82/122 [00:00<00:00, 131.47it/s] [Step 2] 3DMM Extraction In Video:: 79%|███████▊ | 96/122 [00:00<00:00, 132.02it/s] [Step 2] 3DMM Extraction In Video:: 90%|█████████ | 110/122 [00:00<00:00, 132.14it/s] [Step 2] 3DMM Extraction In Video:: 100%|██████████| 122/122 [00:00<00:00, 130.68it/s] using expression center Load checkpoint from: checkpoints/DNet.pt Load checkpoint from: checkpoints/LNet.pth Load checkpoint from: checkpoints/ENet.pth [Step 3] Stabilize the expression In Video:: 0%| | 0/122 [00:00<?, ?it/s] [Step 3] Stabilize the expression In Video:: 2%|▏ | 2/122 [00:00<00:09, 12.84it/s] [Step 3] Stabilize the expression In Video:: 3%|▎ | 4/122 [00:00<00:09, 12.85it/s] [Step 3] Stabilize the expression In Video:: 5%|▍ | 6/122 [00:00<00:08, 12.89it/s] [Step 3] Stabilize the expression In Video:: 7%|▋ | 8/122 [00:00<00:08, 12.92it/s] [Step 3] Stabilize the expression In Video:: 8%|▊ | 10/122 [00:00<00:08, 12.93it/s] [Step 3] Stabilize the expression In Video:: 10%|▉ | 12/122 [00:00<00:08, 12.92it/s] [Step 3] Stabilize the expression In Video:: 11%|█▏ | 14/122 [00:01<00:08, 12.93it/s] [Step 3] Stabilize the expression In Video:: 13%|█▎ | 16/122 [00:01<00:08, 12.49it/s] [Step 3] Stabilize the expression In Video:: 15%|█▍ | 18/122 [00:01<00:08, 12.60it/s] [Step 3] Stabilize the expression In Video:: 16%|█▋ | 20/122 [00:01<00:08, 12.67it/s] [Step 3] Stabilize the expression In Video:: 18%|█▊ | 22/122 [00:01<00:07, 12.76it/s] [Step 3] Stabilize the expression In Video:: 20%|█▉ | 24/122 [00:01<00:07, 12.82it/s] [Step 3] Stabilize the expression In Video:: 21%|██▏ | 26/122 [00:02<00:07, 12.87it/s] [Step 3] Stabilize the expression In Video:: 23%|██▎ | 28/122 [00:02<00:07, 12.88it/s] [Step 3] Stabilize the expression In Video:: 25%|██▍ | 30/122 [00:02<00:07, 12.92it/s] [Step 3] Stabilize the expression In Video:: 26%|██▌ | 32/122 [00:02<00:07, 12.64it/s] [Step 3] Stabilize the expression In Video:: 28%|██▊ | 34/122 [00:02<00:06, 12.73it/s] [Step 3] Stabilize the expression In Video:: 30%|██▉ | 36/122 [00:02<00:06, 12.81it/s] [Step 3] Stabilize the expression In Video:: 31%|███ | 38/122 [00:02<00:06, 12.84it/s] [Step 3] Stabilize the expression In Video:: 33%|███▎ | 40/122 [00:03<00:06, 12.88it/s] [Step 3] Stabilize the expression In Video:: 34%|███▍ | 42/122 [00:03<00:06, 12.91it/s] [Step 3] Stabilize the expression In Video:: 36%|███▌ | 44/122 [00:03<00:06, 12.90it/s] [Step 3] Stabilize the expression In Video:: 38%|███▊ | 46/122 [00:03<00:05, 12.91it/s] [Step 3] Stabilize the expression In Video:: 39%|███▉ | 48/122 [00:03<00:05, 12.90it/s] [Step 3] Stabilize the expression In Video:: 41%|████ | 50/122 [00:03<00:05, 12.92it/s] [Step 3] Stabilize the expression In Video:: 43%|████▎ | 52/122 [00:04<00:05, 12.89it/s] [Step 3] Stabilize the expression In Video:: 44%|████▍ | 54/122 [00:04<00:05, 12.92it/s] [Step 3] Stabilize the expression In Video:: 46%|████▌ | 56/122 [00:04<00:05, 12.93it/s] [Step 3] Stabilize the expression In Video:: 48%|████▊ | 58/122 [00:04<00:04, 12.93it/s] [Step 3] Stabilize the expression In Video:: 49%|████▉ | 60/122 [00:04<00:04, 12.91it/s] [Step 3] Stabilize the expression In Video:: 51%|█████ | 62/122 [00:04<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 52%|█████▏ | 64/122 [00:04<00:04, 12.89it/s] [Step 3] Stabilize the expression In Video:: 54%|█████▍ | 66/122 [00:05<00:04, 12.91it/s] [Step 3] Stabilize the expression In Video:: 56%|█████▌ | 68/122 [00:05<00:04, 12.90it/s] [Step 3] Stabilize the expression In Video:: 57%|█████▋ | 70/122 [00:05<00:04, 12.88it/s] [Step 3] Stabilize the expression In Video:: 59%|█████▉ | 72/122 [00:05<00:03, 12.92it/s] [Step 3] Stabilize the expression In Video:: 61%|██████ | 74/122 [00:05<00:03, 12.93it/s] [Step 3] Stabilize the expression In Video:: 62%|██████▏ | 76/122 [00:05<00:03, 12.91it/s] [Step 3] Stabilize the expression In Video:: 64%|██████▍ | 78/122 [00:06<00:03, 12.92it/s] [Step 3] Stabilize the expression In Video:: 66%|██████▌ | 80/122 [00:06<00:03, 12.94it/s] [Step 3] Stabilize the expression In Video:: 67%|██████▋ | 82/122 [00:06<00:03, 12.96it/s] [Step 3] Stabilize the expression In Video:: 69%|██████▉ | 84/122 [00:06<00:02, 12.94it/s] [Step 3] Stabilize the expression In Video:: 70%|███████ | 86/122 [00:06<00:02, 12.96it/s] [Step 3] Stabilize the expression In Video:: 72%|███████▏ | 88/122 [00:06<00:02, 12.97it/s] [Step 3] Stabilize the expression In Video:: 74%|███████▍ | 90/122 [00:06<00:02, 12.93it/s] [Step 3] Stabilize the expression In Video:: 75%|███████▌ | 92/122 [00:07<00:02, 12.89it/s] [Step 3] Stabilize the expression In Video:: 77%|███████▋ | 94/122 [00:07<00:02, 12.90it/s] [Step 3] Stabilize the expression In Video:: 79%|███████▊ | 96/122 [00:07<00:02, 12.88it/s] [Step 3] Stabilize the expression In Video:: 80%|████████ | 98/122 [00:07<00:01, 12.90it/s] [Step 3] Stabilize the expression In Video:: 82%|████████▏ | 100/122 [00:07<00:01, 12.90it/s] [Step 3] Stabilize the expression In Video:: 84%|████████▎ | 102/122 [00:07<00:01, 12.91it/s] [Step 3] Stabilize the expression In Video:: 85%|████████▌ | 104/122 [00:08<00:01, 12.93it/s] [Step 3] Stabilize the expression In Video:: 87%|████████▋ | 106/122 [00:08<00:01, 12.94it/s] [Step 3] Stabilize the expression In Video:: 89%|████████▊ | 108/122 [00:08<00:01, 12.88it/s] [Step 3] Stabilize the expression In Video:: 90%|█████████ | 110/122 [00:08<00:00, 12.84it/s] [Step 3] Stabilize the expression In Video:: 92%|█████████▏| 112/122 [00:08<00:00, 12.86it/s] [Step 3] Stabilize the expression In Video:: 93%|█████████▎| 114/122 [00:08<00:00, 12.89it/s] [Step 3] Stabilize the expression In Video:: 95%|█████████▌| 116/122 [00:09<00:00, 12.88it/s] [Step 3] Stabilize the expression In Video:: 97%|█████████▋| 118/122 [00:09<00:00, 12.89it/s] [Step 3] Stabilize the expression In Video:: 98%|█████████▊| 120/122 [00:09<00:00, 12.90it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 122/122 [00:09<00:00, 12.90it/s] [Step 3] Stabilize the expression In Video:: 100%|██████████| 122/122 [00:09<00:00, 12.88it/s] [Step 4] Load audio; Length of mel chunks: 122 [Step 5] Reference Enhancement: 0%| | 0/122 [00:00<?, ?it/s] [Step 5] Reference Enhancement: 1%| | 1/122 [00:00<00:18, 6.69it/s] [Step 5] Reference Enhancement: 2%|▏ | 2/122 [00:00<00:17, 6.91it/s] [Step 5] Reference Enhancement: 2%|▏ | 3/122 [00:00<00:17, 6.98it/s] [Step 5] Reference Enhancement: 3%|▎ | 4/122 [00:00<00:16, 7.01it/s] [Step 5] Reference Enhancement: 4%|▍ | 5/122 [00:00<00:16, 7.06it/s] [Step 5] Reference Enhancement: 5%|▍ | 6/122 [00:00<00:16, 7.07it/s] [Step 5] Reference Enhancement: 6%|▌ | 7/122 [00:00<00:16, 7.08it/s] [Step 5] Reference Enhancement: 7%|▋ | 8/122 [00:01<00:16, 7.06it/s] [Step 5] Reference Enhancement: 7%|▋ | 9/122 [00:01<00:16, 7.05it/s] [Step 5] Reference Enhancement: 8%|▊ | 10/122 [00:01<00:15, 7.06it/s] [Step 5] Reference Enhancement: 9%|▉ | 11/122 [00:01<00:15, 7.05it/s] [Step 5] Reference Enhancement: 10%|▉ | 12/122 [00:01<00:15, 7.07it/s] [Step 5] Reference Enhancement: 11%|█ | 13/122 [00:01<00:15, 7.05it/s] [Step 5] Reference Enhancement: 11%|█▏ | 14/122 [00:01<00:15, 7.09it/s] [Step 5] Reference Enhancement: 12%|█▏ | 15/122 [00:02<00:15, 7.09it/s] [Step 5] Reference Enhancement: 13%|█▎ | 16/122 [00:02<00:14, 7.07it/s] [Step 5] Reference Enhancement: 14%|█▍ | 17/122 [00:02<00:14, 7.07it/s] [Step 5] Reference Enhancement: 15%|█▍ | 18/122 [00:02<00:14, 7.00it/s] [Step 5] Reference Enhancement: 16%|█▌ | 19/122 [00:02<00:14, 7.01it/s] [Step 5] Reference Enhancement: 16%|█▋ | 20/122 [00:02<00:14, 7.04it/s] [Step 5] Reference Enhancement: 17%|█▋ | 21/122 [00:02<00:14, 7.04it/s] [Step 5] Reference Enhancement: 18%|█▊ | 22/122 [00:03<00:14, 7.03it/s] [Step 5] Reference Enhancement: 19%|█▉ | 23/122 [00:03<00:14, 7.04it/s] [Step 5] Reference Enhancement: 20%|█▉ | 24/122 [00:03<00:13, 7.07it/s] [Step 5] Reference Enhancement: 20%|██ | 25/122 [00:03<00:13, 7.06it/s] [Step 5] Reference Enhancement: 21%|██▏ | 26/122 [00:03<00:13, 7.06it/s] [Step 5] Reference Enhancement: 22%|██▏ | 27/122 [00:03<00:13, 7.03it/s] [Step 5] Reference Enhancement: 23%|██▎ | 28/122 [00:03<00:13, 7.06it/s] [Step 5] Reference Enhancement: 24%|██▍ | 29/122 [00:04<00:13, 7.03it/s] [Step 5] Reference Enhancement: 25%|██▍ | 30/122 [00:04<00:13, 7.04it/s] [Step 5] Reference Enhancement: 25%|██▌ | 31/122 [00:04<00:12, 7.03it/s] [Step 5] Reference Enhancement: 26%|██▌ | 32/122 [00:04<00:12, 6.99it/s] [Step 5] Reference Enhancement: 27%|██▋ | 33/122 [00:04<00:12, 7.05it/s] [Step 5] Reference Enhancement: 28%|██▊ | 34/122 [00:04<00:12, 7.07it/s] [Step 5] Reference Enhancement: 29%|██▊ | 35/122 [00:04<00:12, 7.04it/s] [Step 5] Reference Enhancement: 30%|██▉ | 36/122 [00:05<00:12, 7.09it/s] [Step 5] Reference Enhancement: 30%|███ | 37/122 [00:05<00:12, 7.08it/s] [Step 5] Reference Enhancement: 31%|███ | 38/122 [00:05<00:11, 7.11it/s] [Step 5] Reference Enhancement: 32%|███▏ | 39/122 [00:05<00:11, 7.11it/s] [Step 5] Reference Enhancement: 33%|███▎ | 40/122 [00:05<00:11, 7.13it/s] [Step 5] Reference Enhancement: 34%|███▎ | 41/122 [00:05<00:11, 7.09it/s] [Step 5] Reference Enhancement: 34%|███▍ | 42/122 [00:05<00:11, 7.06it/s] [Step 5] Reference Enhancement: 35%|███▌ | 43/122 [00:06<00:11, 7.08it/s] [Step 5] Reference Enhancement: 36%|███▌ | 44/122 [00:06<00:11, 7.07it/s] [Step 5] Reference Enhancement: 37%|███▋ | 45/122 [00:06<00:10, 7.05it/s] [Step 5] Reference Enhancement: 38%|███▊ | 46/122 [00:06<00:10, 7.04it/s] [Step 5] Reference Enhancement: 39%|███▊ | 47/122 [00:06<00:10, 7.04it/s] [Step 5] Reference Enhancement: 39%|███▉ | 48/122 [00:06<00:10, 7.01it/s] [Step 5] Reference Enhancement: 40%|████ | 49/122 [00:06<00:10, 6.98it/s] [Step 5] Reference Enhancement: 41%|████ | 50/122 [00:07<00:10, 7.01it/s] [Step 5] Reference Enhancement: 42%|████▏ | 51/122 [00:07<00:10, 7.02it/s] [Step 5] Reference Enhancement: 43%|████▎ | 52/122 [00:07<00:09, 7.06it/s] [Step 5] Reference Enhancement: 43%|████▎ | 53/122 [00:07<00:09, 7.07it/s] [Step 5] Reference Enhancement: 44%|████▍ | 54/122 [00:07<00:09, 7.07it/s] [Step 5] Reference Enhancement: 45%|████▌ | 55/122 [00:07<00:09, 7.03it/s] [Step 5] Reference Enhancement: 46%|████▌ | 56/122 [00:07<00:09, 7.06it/s] [Step 5] Reference Enhancement: 47%|████▋ | 57/122 [00:08<00:09, 7.07it/s] [Step 5] Reference Enhancement: 48%|████▊ | 58/122 [00:08<00:09, 7.06it/s] [Step 5] Reference Enhancement: 48%|████▊ | 59/122 [00:08<00:08, 7.06it/s] [Step 5] Reference Enhancement: 49%|████▉ | 60/122 [00:08<00:08, 7.08it/s] [Step 5] Reference Enhancement: 50%|█████ | 61/122 [00:08<00:08, 7.07it/s] [Step 5] Reference Enhancement: 51%|█████ | 62/122 [00:08<00:08, 7.06it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 63/122 [00:08<00:08, 7.03it/s] [Step 5] Reference Enhancement: 52%|█████▏ | 64/122 [00:09<00:08, 7.04it/s] [Step 5] Reference Enhancement: 53%|█████▎ | 65/122 [00:09<00:08, 7.05it/s] [Step 5] Reference Enhancement: 54%|█████▍ | 66/122 [00:09<00:07, 7.05it/s] [Step 5] Reference Enhancement: 55%|█████▍ | 67/122 [00:09<00:07, 7.02it/s] [Step 5] Reference Enhancement: 56%|█████▌ | 68/122 [00:09<00:07, 7.04it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 69/122 [00:09<00:07, 7.04it/s] [Step 5] Reference Enhancement: 57%|█████▋ | 70/122 [00:09<00:07, 7.05it/s] [Step 5] Reference Enhancement: 58%|█████▊ | 71/122 [00:10<00:07, 7.08it/s] [Step 5] Reference Enhancement: 59%|█████▉ | 72/122 [00:10<00:07, 7.08it/s] [Step 5] Reference Enhancement: 60%|█████▉ | 73/122 [00:10<00:06, 7.09it/s] [Step 5] Reference Enhancement: 61%|██████ | 74/122 [00:10<00:06, 7.06it/s] [Step 5] Reference Enhancement: 61%|██████▏ | 75/122 [00:10<00:06, 7.10it/s] [Step 5] Reference Enhancement: 62%|██████▏ | 76/122 [00:10<00:06, 7.11it/s] [Step 5] Reference Enhancement: 63%|██████▎ | 77/122 [00:10<00:06, 7.10it/s] [Step 5] Reference Enhancement: 64%|██████▍ | 78/122 [00:11<00:06, 7.06it/s] [Step 5] Reference Enhancement: 65%|██████▍ | 79/122 [00:11<00:06, 7.02it/s] [Step 5] Reference Enhancement: 66%|██████▌ | 80/122 [00:11<00:05, 7.04it/s] [Step 5] Reference Enhancement: 66%|██████▋ | 81/122 [00:11<00:05, 7.03it/s] [Step 5] Reference Enhancement: 67%|██████▋ | 82/122 [00:11<00:05, 7.03it/s] [Step 5] Reference Enhancement: 68%|██████▊ | 83/122 [00:11<00:05, 7.05it/s] [Step 5] Reference Enhancement: 69%|██████▉ | 84/122 [00:11<00:05, 7.07it/s] [Step 5] Reference Enhancement: 70%|██████▉ | 85/122 [00:12<00:05, 7.09it/s] [Step 5] Reference Enhancement: 70%|███████ | 86/122 [00:12<00:05, 7.06it/s] [Step 5] Reference Enhancement: 71%|███████▏ | 87/122 [00:12<00:04, 7.07it/s] [Step 5] Reference Enhancement: 72%|███████▏ | 88/122 [00:12<00:04, 7.13it/s] [Step 5] Reference Enhancement: 73%|███████▎ | 89/122 [00:12<00:04, 7.08it/s] [Step 5] Reference Enhancement: 74%|███████▍ | 90/122 [00:12<00:04, 7.07it/s] [Step 5] Reference Enhancement: 75%|███████▍ | 91/122 [00:12<00:04, 7.05it/s] [Step 5] Reference Enhancement: 75%|███████▌ | 92/122 [00:13<00:04, 7.07it/s] [Step 5] Reference Enhancement: 76%|███████▌ | 93/122 [00:13<00:04, 7.07it/s] [Step 5] Reference Enhancement: 77%|███████▋ | 94/122 [00:13<00:03, 7.11it/s] [Step 5] Reference Enhancement: 78%|███████▊ | 95/122 [00:13<00:03, 7.10it/s] [Step 5] Reference Enhancement: 79%|███████▊ | 96/122 [00:13<00:03, 7.09it/s] [Step 5] Reference Enhancement: 80%|███████▉ | 97/122 [00:13<00:03, 7.09it/s] [Step 5] Reference Enhancement: 80%|████████ | 98/122 [00:13<00:03, 7.09it/s] [Step 5] Reference Enhancement: 81%|████████ | 99/122 [00:14<00:03, 7.08it/s] [Step 5] Reference Enhancement: 82%|████████▏ | 100/122 [00:14<00:03, 7.06it/s] [Step 5] Reference Enhancement: 83%|████████▎ | 101/122 [00:14<00:02, 7.08it/s] [Step 5] Reference Enhancement: 84%|████████▎ | 102/122 [00:14<00:02, 7.07it/s] [Step 5] Reference Enhancement: 84%|████████▍ | 103/122 [00:14<00:02, 7.04it/s] [Step 5] Reference Enhancement: 85%|████████▌ | 104/122 [00:14<00:02, 7.06it/s] [Step 5] Reference Enhancement: 86%|████████▌ | 105/122 [00:14<00:02, 7.08it/s] [Step 5] Reference Enhancement: 87%|████████▋ | 106/122 [00:15<00:02, 7.10it/s] [Step 5] Reference Enhancement: 88%|████████▊ | 107/122 [00:15<00:02, 7.11it/s] [Step 5] Reference Enhancement: 89%|████████▊ | 108/122 [00:15<00:01, 7.08it/s] [Step 5] Reference Enhancement: 89%|████████▉ | 109/122 [00:15<00:01, 7.09it/s] [Step 5] Reference Enhancement: 90%|█████████ | 110/122 [00:15<00:01, 7.08it/s] [Step 5] Reference Enhancement: 91%|█████████ | 111/122 [00:15<00:01, 7.09it/s] [Step 5] Reference Enhancement: 92%|█████████▏| 112/122 [00:15<00:01, 7.06it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 113/122 [00:16<00:01, 7.06it/s] [Step 5] Reference Enhancement: 93%|█████████▎| 114/122 [00:16<00:01, 7.11it/s] [Step 5] Reference Enhancement: 94%|█████████▍| 115/122 [00:16<00:00, 7.11it/s] [Step 5] Reference Enhancement: 95%|█████████▌| 116/122 [00:16<00:00, 7.08it/s] [Step 5] Reference Enhancement: 96%|█████████▌| 117/122 [00:16<00:00, 7.08it/s] [Step 5] Reference Enhancement: 97%|█████████▋| 118/122 [00:16<00:00, 7.08it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 119/122 [00:16<00:00, 7.10it/s] [Step 5] Reference Enhancement: 98%|█████████▊| 120/122 [00:16<00:00, 7.07it/s] [Step 5] Reference Enhancement: 99%|█████████▉| 121/122 [00:17<00:00, 7.07it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.05it/s] [Step 5] Reference Enhancement: 100%|██████████| 122/122 [00:17<00:00, 7.06it/s] [Step 6] Lip Synthesis:: 0%| | 0/8 [00:00<?, ?it/s] landmark Det:: 0%| | 0/122 [00:00<?, ?it/s] landmark Det:: 1%| | 1/122 [00:00<00:21, 5.51it/s] landmark Det:: 2%|▏ | 2/122 [00:00<00:39, 3.02it/s] landmark Det:: 7%|▋ | 9/122 [00:00<00:06, 16.19it/s] landmark Det:: 13%|█▎ | 16/122 [00:00<00:03, 27.73it/s] landmark Det:: 19%|█▉ | 23/122 [00:00<00:02, 37.39it/s] landmark Det:: 25%|██▍ | 30/122 [00:01<00:02, 44.89it/s] landmark Det:: 30%|███ | 37/122 [00:01<00:01, 50.94it/s] landmark Det:: 36%|███▌ | 44/122 [00:01<00:01, 54.33it/s] landmark Det:: 42%|████▏ | 51/122 [00:01<00:01, 56.96it/s] landmark Det:: 48%|████▊ | 58/122 [00:01<00:01, 59.66it/s] landmark Det:: 53%|█████▎ | 65/122 [00:01<00:00, 62.09it/s] landmark Det:: 59%|█████▉ | 72/122 [00:01<00:00, 63.81it/s] landmark Det:: 65%|██████▍ | 79/122 [00:01<00:00, 64.49it/s] landmark Det:: 70%|███████ | 86/122 [00:01<00:00, 65.20it/s] landmark Det:: 76%|███████▌ | 93/122 [00:02<00:00, 64.97it/s] landmark Det:: 82%|████████▏ | 100/122 [00:02<00:00, 64.76it/s] landmark Det:: 88%|████████▊ | 107/122 [00:02<00:00, 63.32it/s] landmark Det:: 93%|█████████▎| 114/122 [00:02<00:00, 64.13it/s] landmark Det:: 99%|█████████▉| 121/122 [00:02<00:00, 64.05it/s] landmark Det:: 100%|██████████| 122/122 [00:02<00:00, 49.65it/s] 0%| | 0/122 [00:00<?, ?it/s] 100%|██████████| 122/122 [00:00<00:00, 20666.60it/s] 0%| | 0/122 [00:00<?, ?it/s] 52%|█████▏ | 64/122 [00:00<00:00, 639.89it/s] 100%|██████████| 122/122 [00:00<00:00, 642.65it/s] FaceDet:: 0%| | 0/31 [00:00<?, ?it/s] FaceDet:: 3%|▎ | 1/31 [00:00<00:16, 1.86it/s] FaceDet:: 10%|▉ | 3/31 [00:00<00:05, 4.80it/s] FaceDet:: 16%|█▌ | 5/31 [00:00<00:03, 6.92it/s] FaceDet:: 23%|██▎ | 7/31 [00:01<00:02, 8.23it/s] FaceDet:: 29%|██▉ | 9/31 [00:01<00:02, 9.20it/s] FaceDet:: 35%|███▌ | 11/31 [00:01<00:02, 9.65it/s] FaceDet:: 42%|████▏ | 13/31 [00:01<00:01, 10.12it/s] FaceDet:: 48%|████▊ | 15/31 [00:01<00:01, 10.44it/s] FaceDet:: 55%|█████▍ | 17/31 [00:01<00:01, 10.49it/s] FaceDet:: 61%|██████▏ | 19/31 [00:02<00:01, 10.56it/s] FaceDet:: 68%|██████▊ | 21/31 [00:02<00:00, 10.62it/s] FaceDet:: 74%|███████▍ | 23/31 [00:02<00:00, 10.76it/s] FaceDet:: 81%|████████ | 25/31 [00:02<00:00, 10.88it/s] FaceDet:: 87%|████████▋ | 27/31 [00:02<00:00, 11.03it/s] FaceDet:: 94%|█████████▎| 29/31 [00:03<00:00, 11.21it/s] FaceDet:: 100%|██████████| 31/31 [00:03<00:00, 7.98it/s] FaceDet:: 100%|██████████| 31/31 [00:03<00:00, 8.91it/s] [Step 6] Lip Synthesis:: 12%|█▎ | 1/8 [00:12<01:29, 12.78s/it] [Step 6] Lip Synthesis:: 25%|██▌ | 2/8 [00:17<00:48, 8.16s/it] [Step 6] Lip Synthesis:: 38%|███▊ | 3/8 [00:22<00:33, 6.70s/it] [Step 6] Lip Synthesis:: 50%|█████ | 4/8 [00:27<00:23, 5.99s/it] [Step 6] Lip Synthesis:: 62%|██████▎ | 5/8 [00:32<00:16, 5.61s/it] [Step 6] Lip Synthesis:: 75%|███████▌ | 6/8 [00:37<00:10, 5.39s/it] [Step 6] Lip Synthesis:: 88%|████████▊ | 7/8 [00:42<00:05, 5.33s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [00:45<00:00, 4.62s/it] [Step 6] Lip Synthesis:: 100%|██████████| 8/8 [00:45<00:00, 5.72s/it]
Want to make some of these yourself?
Run this model