zsxkib/mimic-motion:2e7f79ed – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

zsxkib /mimic-motion:2e7f79ed

Playground API

Input

motion_video

*file

Reference video file containing the motion to be mimicked

appearance_image

*file

Reference image file for the appearance of the generated video

resolution

integer

(minimum: 64, maximum: 1024)

Height of the output video in pixels. Width is automatically calculated.

Default: 576

chunk_size

integer

(minimum: 2)

Number of frames to generate in each processing chunk

Default: 16

frames_overlap

integer

(minimum: 0)

Number of overlapping frames between chunks for smoother transitions

Default: 6

denoising_steps

integer

(minimum: 1, maximum: 100)

Number of denoising steps in the diffusion process. More steps can improve quality but increase processing time.

Default: 25

noise_strength

number

(minimum: 0, maximum: 1)

Strength of noise augmentation. Higher values add more variation but may reduce coherence with the reference.

Default: 0

guidance_scale

number

(minimum: 0.1, maximum: 10)

Strength of guidance towards the reference. Higher values adhere more closely to the reference but may reduce creativity.

Default: 2

sample_stride

integer

(minimum: 1)

Interval for sampling frames from the reference video. Higher values skip more frames.

Default: 2

output_frames_per_second

integer

(minimum: 1, maximum: 60)

Frames per second of the output video. Affects playback speed.

Default: 15

seed

integer

Random seed. Leave blank to randomize the seed

use_fp16

boolean

Use half-precision floating point (float16). Faster but slightly less accurate than float32.

Default: true

Run this model in Node.js with one line of code:

npx create-replicate --model=zsxkib/mimic-motion

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run zsxkib/mimic-motion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "zsxkib/mimic-motion:2e7f79edf416dd7edd32dce85b7835be98eeb1d8eca2bebb2b8db8c996e5efad",
  {
    input: {
      use_fp16: true,
      chunk_size: 16,
      resolution: 576,
      sample_stride: 2,
      frames_overlap: 6,
      guidance_scale: 2,
      noise_strength: 0,
      denoising_steps: 25,
      output_frames_per_second: 15
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run zsxkib/mimic-motion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "zsxkib/mimic-motion:2e7f79edf416dd7edd32dce85b7835be98eeb1d8eca2bebb2b8db8c996e5efad",
    input={
        "use_fp16": True,
        "chunk_size": 16,
        "resolution": 576,
        "sample_stride": 2,
        "frames_overlap": 6,
        "guidance_scale": 2,
        "noise_strength": 0,
        "denoising_steps": 25,
        "output_frames_per_second": 15
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run zsxkib/mimic-motion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "2e7f79edf416dd7edd32dce85b7835be98eeb1d8eca2bebb2b8db8c996e5efad",
    "input": {
      "use_fp16": true,
      "chunk_size": 16,
      "resolution": 576,
      "sample_stride": 2,
      "frames_overlap": 6,
      "guidance_scale": 2,
      "noise_strength": 0,
      "denoising_steps": 25,
      "output_frames_per_second": 15
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

No output yet! Press "Submit" to start a prediction.