pipeline-examples/talking-avatar

A lip-syncing avatar for UGC/TikTok/Reels content

Public

166 runs

Run pipeline-examples/talking-avatar with an API

Use one of our client libraries to get started quickly. Clicking on a library will take you to the Playground tab where you can tweak different inputs, see the results, and copy the corresponding code to use in your own project.

Input schema

The fields you can use to run this model with an API. If you don't give a value for a field its default value will be used.

Field	Type	Default value	Description
image	string		Input image of a person for the talking avatar
audio	string		Audio file for lip synchronization (.mp3, .wav, .m4a, or .aac)
duration	None	10	duration of the video in seconds
resolution	None	720p	Video resolution
captions	boolean	True	Return video with captions

{
  "type": "object",
  "title": "Input",
  "required": [
    "image",
    "audio"
  ],
  "properties": {
    "audio": {
      "type": "string",
      "title": "Audio",
      "format": "uri",
      "x-order": 1,
      "description": "Audio file for lip synchronization (.mp3, .wav, .m4a, or .aac)"
    },
    "image": {
      "type": "string",
      "title": "Image",
      "format": "uri",
      "x-order": 0,
      "description": "Input image of a person for the talking avatar"
    },
    "captions": {
      "type": "boolean",
      "title": "Captions",
      "default": true,
      "x-order": 4,
      "description": "Return video with captions"
    },
    "duration": {
      "enum": [
        5,
        10
      ],
      "type": "integer",
      "title": "duration",
      "description": "duration of the video in seconds",
      "default": 10,
      "x-order": 2
    },
    "resolution": {
      "enum": [
        "480p",
        "720p",
        "1080p"
      ],
      "type": "string",
      "title": "resolution",
      "description": "Video resolution",
      "default": "720p",
      "x-order": 3
    }
  }
}

Output schema

The shape of the response you’ll get when you run this model with an API.

Schema

{
  "type": "string",
  "title": "Output",
  "format": "uri"
}

Example API response

View prediction

'https://replicate.delivery/xezq/RumsBSJxO8JxIhihtqTxe6PvRcf1DhiUm9WOP4Le54S176ZqA/output.mp4'