zsxkib/animate-diff:6be04fc2 – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

zsxkib /animate-diff:6be04fc2

Input

prompt

string

Shift + Return to add a new line

photo of coastline, rocks, storm weather, wind, waves, lightning, 8k uhd, dslr, soft lighting, high quality, film grain, Fujifilm XT3photo of coastline, rocks, storm weather, wind, waves, lightning, 8k uhd, dslr, soft lighting, high quality, film grain, Fujifilm XT3

Input prompt

Default: "photo of coastline, rocks, storm weather, wind, waves, lightning, 8k uhd, dslr, soft lighting, high quality, film grain, Fujifilm XT3"

negative_prompt

string

Shift + Return to add a new line

blur, haze, deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime, mutated hands and fingers, deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, disconnected limbs, mutation, mutated, ugly, disgusting, amputationblur, haze, deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime, mutated hands and fingers, deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, disconnected limbs, mutation, mutated, ugly, disgusting, amputation

Negative prompt

Default: "blur, haze, deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime, mutated hands and fingers, deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, disconnected limbs, mutation, mutated, ugly, disgusting, amputation"

base_model

string

Select a base model (DreamBooth checkpoint)

Default: "realisticVisionV20_v20"

zoom_in_alpha

number

(minimum: 0, maximum: 1)

Alpha for the strength of Zoom In Motion LoRA.

Default: 0

zoom_out_alpha

number

(minimum: 0, maximum: 1)

Alpha for the strength of Zoom Out Motion LoRA.

Default: 0

pan_left_alpha

number

(minimum: 0, maximum: 1)

Alpha for the strength of Pan Left Motion LoRA.

Default: 0

pan_right_alpha

number

(minimum: 0, maximum: 1)

Alpha for the strength of Pan Right Motion LoRA.

Default: 0

pan_up_alpha

number

(minimum: 0, maximum: 1)

Alpha for the strength of Pan Up Motion LoRA.

Default: 0

pan_down_alpha

number

(minimum: 0, maximum: 1)

Alpha for the strength of Pan Down Motion LoRA.

Default: 0

rolling_clockwise_alpha

number

(minimum: 0, maximum: 1)

Alpha for the strength of Rolling Clockwise Motion LoRA.

Default: 0

rolling_anticlockwise_alpha

number

(minimum: 0, maximum: 1)

Alpha for the strength of Rolling Anticlockwise Motion LoRA.

Default: 0

steps

integer

(minimum: 1, maximum: 100)

Number of inference steps

Default: 25

guidance_scale

number

(minimum: 0, maximum: 20)

Guidance Scale. How closely do we want to adhere to the prompt and its contents.

Default: 7.5

frames

integer

(minimum: 1, maximum: 60)

Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)

Default: 16

width

integer

Width of generated video in pixels

Default: 512

height

integer

Height of generated video in pixels

Default: 512

seed

integer

(minimum: 0, maximum: 2147483647)

Seed (0 = random, maximum: 2147483647) for different images and reproducibility.

Default: 0

Run this model in Node.js with one line of code:

npx create-replicate --model=zsxkib/animate-diff

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run zsxkib/animate-diff using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "zsxkib/animate-diff:6be04fc21f604075b6928472eb14e374a6709c46d6044b18c82035a60cf1abfd",
  {
    input: {
      seed: 0,
      steps: 25,
      width: 512,
      frames: 16,
      height: 512,
      prompt: "photo of coastline, rocks, storm weather, wind, waves, lightning, 8k uhd, dslr, soft lighting, high quality, film grain, Fujifilm XT3",
      base_model: "realisticVisionV20_v20",
      pan_up_alpha: 0,
      zoom_in_alpha: 0,
      guidance_scale: 7.5,
      pan_down_alpha: 0,
      pan_left_alpha: 0,
      zoom_out_alpha: 0,
      negative_prompt: "blur, haze, deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime, mutated hands and fingers, deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, disconnected limbs, mutation, mutated, ugly, disgusting, amputation",
      pan_right_alpha: 0,
      rolling_clockwise_alpha: 0,
      rolling_anticlockwise_alpha: 0
    }
  }
);

// To access the file URL:
console.log(output[0].url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output[0]);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run zsxkib/animate-diff using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "zsxkib/animate-diff:6be04fc21f604075b6928472eb14e374a6709c46d6044b18c82035a60cf1abfd",
    input={
        "seed": 0,
        "steps": 25,
        "width": 512,
        "frames": 16,
        "height": 512,
        "prompt": "photo of coastline, rocks, storm weather, wind, waves, lightning, 8k uhd, dslr, soft lighting, high quality, film grain, Fujifilm XT3",
        "base_model": "realisticVisionV20_v20",
        "pan_up_alpha": 0,
        "zoom_in_alpha": 0,
        "guidance_scale": 7.5,
        "pan_down_alpha": 0,
        "pan_left_alpha": 0,
        "zoom_out_alpha": 0,
        "negative_prompt": "blur, haze, deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime, mutated hands and fingers, deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, disconnected limbs, mutation, mutated, ugly, disgusting, amputation",
        "pan_right_alpha": 0,
        "rolling_clockwise_alpha": 0,
        "rolling_anticlockwise_alpha": 0
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run zsxkib/animate-diff using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "6be04fc21f604075b6928472eb14e374a6709c46d6044b18c82035a60cf1abfd",
    "input": {
      "seed": 0,
      "steps": 25,
      "width": 512,
      "frames": 16,
      "height": 512,
      "prompt": "photo of coastline, rocks, storm weather, wind, waves, lightning, 8k uhd, dslr, soft lighting, high quality, film grain, Fujifilm XT3",
      "base_model": "realisticVisionV20_v20",
      "pan_up_alpha": 0,
      "zoom_in_alpha": 0,
      "guidance_scale": 7.5,
      "pan_down_alpha": 0,
      "pan_left_alpha": 0,
      "zoom_out_alpha": 0,
      "negative_prompt": "blur, haze, deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime, mutated hands and fingers, deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, disconnected limbs, mutation, mutated, ugly, disgusting, amputation",
      "pan_right_alpha": 0,
      "rolling_clockwise_alpha": 0,
      "rolling_anticlockwise_alpha": 0
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

No output yet! Press "Submit" to start a prediction.