tiger-ai-lab/anyv2v:30adf8ca – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

tiger-ai-lab /anyv2v:30adf8ca

Playground API

Input

video

*file

Input video

instruct_pix2pix_prompt

string

Shift + Return to add a new line

The first step invovles using timbrooks/instruct-pix2pix to edit the first frame. Specify the prompt for editing the first frame.

Default: "turn man into robot"

editing_prompt

string

Shift + Return to add a new line

a man doing exercises for the body and minda man doing exercises for the body and mind

Describe the input video

Default: "a man doing exercises for the body and mind"

editing_negative_prompt

string

Shift + Return to add a new line

Distorted, discontinuous, Ugly, blurry, low resolution, motionless, static, disfigured, disconnected limbs, Ugly faces, incomplete armsDistorted, discontinuous, Ugly, blurry, low resolution, motionless, static, disfigured, disconnected limbs, Ugly faces, incomplete arms

Things not to see int the edited video

Default: "Distorted, discontinuous, Ugly, blurry, low resolution, motionless, static, disfigured, disconnected limbs, Ugly faces, incomplete arms"

num_inference_steps

integer

(minimum: 1, maximum: 500)

Number of denoising steps

Default: 50

guidance_scale

number

(minimum: 1, maximum: 20)

Scale for classifier-free guidance

Default: 9

pnp_f_t

number

(minimum: 0, maximum: 1)

Specifies the proportion of time steps in the DDIM sampling process where the convolutional injection is applied. A higher value improves motion consistency. 1.0 indicates injection at every time step

Default: 1

pnp_spatial_attn_t

number

(minimum: 0, maximum: 1)

Specifies the proportion of time steps in the DDIM sampling process where the spatial attention injection is applied. A higher value improves motion consistency. 1.0 indicates injection at every time step

Default: 1

pnp_temp_attn_t

number

(minimum: 0, maximum: 1)

Specifies the proportion of time steps in the DDIM sampling process where the temporal attention injection is applied. A higher value improves motion consistency. 1.0 indicates injection at every time step

Default: 1

ddim_init_latents_t_idx

integer

(minimum: 0)

This parameter determines the time step index at which to begin sampling from the initial DDIM inversed latents, with a range of [0, num_inference_steps-1]. In the context of a DDIM sampling process where the sampling step is 50, the scheduler progresses through the time steps in the sequence [981, 961, 941, ..., 1]. Therefore, setting ddim_init_latents_t_idx to 0 initiates the sampling from t=981, whereas setting it to 1 starts the process at t=961. A higher index enhances motion consistency with the source video but may lead to flickering and cause the edited video to diverge from the edited first frame.

Default: 0

ddim_inversion_steps

integer

Number of ddim inversion steps

Default: 500

seed

integer

Random seed. Leave blank to randomize the seed

Run this model in Node.js with one line of code:

npx create-replicate --model=tiger-ai-lab/anyv2v

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run tiger-ai-lab/anyv2v using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "tiger-ai-lab/anyv2v:30adf8ca48b89945b7895eceeaa905ebe3034ca30060e6e727f5d7c9e9723962",
  {
    input: {
      pnp_f_t: 1,
      editing_prompt: "a man doing exercises for the body and mind",
      guidance_scale: 9,
      pnp_temp_attn_t: 1,
      pnp_spatial_attn_t: 1,
      num_inference_steps: 50,
      ddim_inversion_steps: 500,
      ddim_init_latents_t_idx: 0,
      editing_negative_prompt: "Distorted, discontinuous, Ugly, blurry, low resolution, motionless, static, disfigured, disconnected limbs, Ugly faces, incomplete arms",
      instruct_pix2pix_prompt: "turn man into robot"
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run tiger-ai-lab/anyv2v using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "tiger-ai-lab/anyv2v:30adf8ca48b89945b7895eceeaa905ebe3034ca30060e6e727f5d7c9e9723962",
    input={
        "pnp_f_t": 1,
        "editing_prompt": "a man doing exercises for the body and mind",
        "guidance_scale": 9,
        "pnp_temp_attn_t": 1,
        "pnp_spatial_attn_t": 1,
        "num_inference_steps": 50,
        "ddim_inversion_steps": 500,
        "ddim_init_latents_t_idx": 0,
        "editing_negative_prompt": "Distorted, discontinuous, Ugly, blurry, low resolution, motionless, static, disfigured, disconnected limbs, Ugly faces, incomplete arms",
        "instruct_pix2pix_prompt": "turn man into robot"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run tiger-ai-lab/anyv2v using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "30adf8ca48b89945b7895eceeaa905ebe3034ca30060e6e727f5d7c9e9723962",
    "input": {
      "pnp_f_t": 1,
      "editing_prompt": "a man doing exercises for the body and mind",
      "guidance_scale": 9,
      "pnp_temp_attn_t": 1,
      "pnp_spatial_attn_t": 1,
      "num_inference_steps": 50,
      "ddim_inversion_steps": 500,
      "ddim_init_latents_t_idx": 0,
      "editing_negative_prompt": "Distorted, discontinuous, Ugly, blurry, low resolution, motionless, static, disfigured, disconnected limbs, Ugly faces, incomplete arms",
      "instruct_pix2pix_prompt": "turn man into robot"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

No output yet! Press "Submit" to start a prediction.