@replicate-internal's cloneofsimo/hotshot-xl-lora-controlnet

Model

cloneofsimo/hotshot-xl-lora-controlnet:c447ef9f

fgfofdlbkrol52zhx3nvzzm4nq

Status

Succeeded

Source

Web

Hardware

A40 (Large)

Total duration

23.3s

Created

about 2 years ago

Webhook

–

Input

prompt: a close up of an anime character casting a spell
negative_prompt: Empty string
width: 672
height: 384
steps: 30
video_length: 8
video_duration: 1000
control_type: depth
gif: null
control_guidance_start: 0
control_guidance_end: 0.7
controlnet_conditioning_scale: 0.8
seed: 1001
replicate_weights_url: Empty string
hf_lora_url: null
original_width: 1920
original_height: 1080
target_width: 512
target_height: 512

{
  "control_guidance_end": 0.7,
  "control_guidance_start": 0,
  "control_type": "depth",
  "controlnet_conditioning_scale": 0.8,
  "gif": null,
  "height": 384,
  "hf_lora_url": null,
  "negative_prompt": "",
  "original_height": 1080,
  "original_width": 1920,
  "prompt": "a close up of an anime character casting a spell",
  "replicate_weights_url": "",
  "seed": 1001,
  "steps": 30,
  "target_height": 512,
  "target_width": 512,
  "video_duration": 1000,
  "video_length": 8,
  "width": 672
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_Ym5**********************************

This is your API token. Keep it to yourself.

Import and set up the client:

import Replicate from "replicate";
import fs from "node:fs";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run cloneofsimo/hotshot-xl-lora-controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "cloneofsimo/hotshot-xl-lora-controlnet:c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63",
  {
    input: {
      control_guidance_end: 0.7,
      control_guidance_start: 0,
      control_type: "depth",
      controlnet_conditioning_scale: 0.8,
      height: 384,
      negative_prompt: "",
      original_height: 1080,
      original_width: 1920,
      prompt: "a close up of an anime character casting a spell",
      replicate_weights_url: "",
      seed: 1001,
      steps: 30,
      target_height: 512,
      target_width: 512,
      video_duration: 1000,
      video_length: 8,
      width: 672
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_Ym5**********************************

This is your API token. Keep it to yourself.

Import the client:

import replicate

Run cloneofsimo/hotshot-xl-lora-controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "cloneofsimo/hotshot-xl-lora-controlnet:c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63",
    input={
        "control_guidance_end": 0.7,
        "control_guidance_start": 0,
        "control_type": "depth",
        "controlnet_conditioning_scale": 0.8,
        "height": 384,
        "negative_prompt": "",
        "original_height": 1080,
        "original_width": 1920,
        "prompt": "a close up of an anime character casting a spell",
        "replicate_weights_url": "",
        "seed": 1001,
        "steps": 30,
        "target_height": 512,
        "target_width": 512,
        "video_duration": 1000,
        "video_length": 8,
        "width": 672
    }
)

# To access the file URL:
print(output.url())
#=> "http://example.com"

# To write the file to disk:
with open("my-image.png", "wb") as file:
    file.write(output.read())

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_Ym5**********************************

This is your API token. Keep it to yourself.

Run cloneofsimo/hotshot-xl-lora-controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "cloneofsimo/hotshot-xl-lora-controlnet:c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63",
    "input": {
      "control_guidance_end": 0.7,
      "control_guidance_start": 0,
      "control_type": "depth",
      "controlnet_conditioning_scale": 0.8,
      "height": 384,
      "negative_prompt": "",
      "original_height": 1080,
      "original_width": 1920,
      "prompt": "a close up of an anime character casting a spell",
      "replicate_weights_url": "",
      "seed": 1001,
      "steps": 30,
      "target_height": 512,
      "target_width": 512,
      "video_duration": 1000,
      "video_length": 8,
      "width": 672
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

{
  "id": "fgfofdlbkrol52zhx3nvzzm4nq",
  "model": "cloneofsimo/hotshot-xl-lora-controlnet",
  "version": "c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63",
  "input": {
    "control_guidance_end": 0.7,
    "control_guidance_start": 0,
    "control_type": "depth",
    "controlnet_conditioning_scale": 0.8,
    "gif": null,
    "height": 384,
    "hf_lora_url": null,
    "negative_prompt": "",
    "original_height": 1080,
    "original_width": 1920,
    "prompt": "a close up of an anime character casting a spell",
    "replicate_weights_url": "",
    "seed": 1001,
    "steps": 30,
    "target_height": 512,
    "target_width": 512,
    "video_duration": 1000,
    "video_length": 8,
    "width": 672
  },
  "logs": "Warning - setting num_images_per_prompt = 1 because video_length = 8\n  0%|          | 0/30 [00:00<?, ?it/s]\n  3%|▎         | 1/30 [00:00<00:19,  1.45it/s]\n  7%|▋         | 2/30 [00:01<00:19,  1.46it/s]\n 10%|█         | 3/30 [00:02<00:18,  1.46it/s]\n 13%|█▎        | 4/30 [00:02<00:17,  1.46it/s]\n 17%|█▋        | 5/30 [00:03<00:17,  1.45it/s]\n 20%|██        | 6/30 [00:04<00:16,  1.45it/s]\n 23%|██▎       | 7/30 [00:04<00:15,  1.45it/s]\n 27%|██▋       | 8/30 [00:05<00:15,  1.45it/s]\n 30%|███       | 9/30 [00:06<00:14,  1.45it/s]\n 33%|███▎      | 10/30 [00:06<00:13,  1.45it/s]\n 37%|███▋      | 11/30 [00:07<00:13,  1.45it/s]\n 40%|████      | 12/30 [00:08<00:12,  1.45it/s]\n 43%|████▎     | 13/30 [00:08<00:11,  1.45it/s]\n 47%|████▋     | 14/30 [00:09<00:11,  1.45it/s]\n 50%|█████     | 15/30 [00:10<00:10,  1.45it/s]\n 53%|█████▎    | 16/30 [00:11<00:09,  1.45it/s]\n 57%|█████▋    | 17/30 [00:11<00:08,  1.45it/s]\n 60%|██████    | 18/30 [00:12<00:08,  1.45it/s]\n 63%|██████▎   | 19/30 [00:13<00:07,  1.45it/s]\n 67%|██████▋   | 20/30 [00:13<00:06,  1.45it/s]\n 70%|███████   | 21/30 [00:14<00:06,  1.45it/s]\n 73%|███████▎  | 22/30 [00:15<00:05,  1.45it/s]\n 77%|███████▋  | 23/30 [00:15<00:04,  1.45it/s]\n 80%|████████  | 24/30 [00:16<00:04,  1.45it/s]\n 83%|████████▎ | 25/30 [00:17<00:03,  1.45it/s]\n 87%|████████▋ | 26/30 [00:17<00:02,  1.45it/s]\n 90%|█████████ | 27/30 [00:18<00:02,  1.45it/s]\n 93%|█████████▎| 28/30 [00:19<00:01,  1.45it/s]\n 97%|█████████▋| 29/30 [00:19<00:00,  1.45it/s]\n100%|██████████| 30/30 [00:20<00:00,  1.45it/s]\n100%|██████████| 30/30 [00:20<00:00,  1.45it/s]\n  0%|          | 0/8 [00:00<?, ?it/s]\n 50%|█████     | 4/8 [00:00<00:00, 35.63it/s]\n100%|██████████| 8/8 [00:00<00:00, 19.59it/s]\n100%|██████████| 8/8 [00:00<00:00, 21.00it/s]",
  "output": "https://replicate.delivery/pbxt/uGxehLs9cfqYd0c6aHyfHjv0eA4VDzXOfL79rogAwopG3nlNC/tmp.gif",
  "data_removed": false,
  "error": null,
  "source": "web",
  "status": "succeeded",
  "created_at": "2023-10-10T09:47:14.48665Z",
  "started_at": "2023-10-10T09:47:14.510687Z",
  "completed_at": "2023-10-10T09:47:37.788732Z",
  "urls": {
    "cancel": "https://api.replicate.com/v1/predictions/fgfofdlbkrol52zhx3nvzzm4nq/cancel",
    "get": "https://api.replicate.com/v1/predictions/fgfofdlbkrol52zhx3nvzzm4nq"
  },
  "metrics": {
    "predict_time": 23.278045,
    "total_time": 23.302082
  }
}

Generated in

23.3 seconds

Tweak it Report

Warning - setting num_images_per_prompt = 1 because video_length = 8 0%| | 0/30 [00:00<?, ?it/s] 3%|▎ | 1/30 [00:00<00:19, 1.45it/s] 7%|▋ | 2/30 [00:01<00:19, 1.46it/s] 10%|█ | 3/30 [00:02<00:18, 1.46it/s] 13%|█▎ | 4/30 [00:02<00:17, 1.46it/s] 17%|█▋ | 5/30 [00:03<00:17, 1.45it/s] 20%|██ | 6/30 [00:04<00:16, 1.45it/s] 23%|██▎ | 7/30 [00:04<00:15, 1.45it/s] 27%|██▋ | 8/30 [00:05<00:15, 1.45it/s] 30%|███ | 9/30 [00:06<00:14, 1.45it/s] 33%|███▎ | 10/30 [00:06<00:13, 1.45it/s] 37%|███▋ | 11/30 [00:07<00:13, 1.45it/s] 40%|████ | 12/30 [00:08<00:12, 1.45it/s] 43%|████▎ | 13/30 [00:08<00:11, 1.45it/s] 47%|████▋ | 14/30 [00:09<00:11, 1.45it/s] 50%|█████ | 15/30 [00:10<00:10, 1.45it/s] 53%|█████▎ | 16/30 [00:11<00:09, 1.45it/s] 57%|█████▋ | 17/30 [00:11<00:08, 1.45it/s] 60%|██████ | 18/30 [00:12<00:08, 1.45it/s] 63%|██████▎ | 19/30 [00:13<00:07, 1.45it/s] 67%|██████▋ | 20/30 [00:13<00:06, 1.45it/s] 70%|███████ | 21/30 [00:14<00:06, 1.45it/s] 73%|███████▎ | 22/30 [00:15<00:05, 1.45it/s] 77%|███████▋ | 23/30 [00:15<00:04, 1.45it/s] 80%|████████ | 24/30 [00:16<00:04, 1.45it/s] 83%|████████▎ | 25/30 [00:17<00:03, 1.45it/s] 87%|████████▋ | 26/30 [00:17<00:02, 1.45it/s] 90%|█████████ | 27/30 [00:18<00:02, 1.45it/s] 93%|█████████▎| 28/30 [00:19<00:01, 1.45it/s] 97%|█████████▋| 29/30 [00:19<00:00, 1.45it/s] 100%|██████████| 30/30 [00:20<00:00, 1.45it/s] 100%|██████████| 30/30 [00:20<00:00, 1.45it/s] 0%| | 0/8 [00:00<?, ?it/s] 50%|█████ | 4/8 [00:00<00:00, 35.63it/s] 100%|██████████| 8/8 [00:00<00:00, 19.59it/s] 100%|██████████| 8/8 [00:00<00:00, 21.00it/s]