@replicate-internal's cloneofsimo/hotshot-xl-lora-controlnet

Model

cloneofsimo/hotshot-xl-lora-controlnet:c447ef9f

irlqj5lb2ilnbbdmrpxmjtutxu

Status

Succeeded

Source

Web

Hardware

A40 (Large)

Total duration

23.4s

Created

about 2 years ago by replicate-internal

Webhook

–

Input

prompt: anime, animated establishing shot of a volcano erupting, bright sunshine and snow
negative_prompt: dark, underexposed
width: 672
height: 384
steps: 30
video_length: 8
video_duration: 1000
control_type: depth
gif: null
control_guidance_start: 0
control_guidance_end: 0.7
controlnet_conditioning_scale: 0.8
seed: 1002
replicate_weights_url: Empty string
hf_lora_url: null
original_width: 1920
original_height: 1080
target_width: 512
target_height: 512

{
  "control_guidance_end": 0.7,
  "control_guidance_start": 0,
  "control_type": "depth",
  "controlnet_conditioning_scale": 0.8,
  "gif": null,
  "height": 384,
  "hf_lora_url": null,
  "negative_prompt": "dark, underexposed",
  "original_height": 1080,
  "original_width": 1920,
  "prompt": "anime, animated establishing shot of a volcano erupting, bright sunshine and snow",
  "replicate_weights_url": "",
  "seed": 1002,
  "steps": 30,
  "target_height": 512,
  "target_width": 512,
  "video_duration": 1000,
  "video_length": 8,
  "width": 672
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_1UQ**********************************

This is your API token. Keep it to yourself.

Import and set up the client:

import Replicate from "replicate";
import fs from "node:fs";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run cloneofsimo/hotshot-xl-lora-controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "cloneofsimo/hotshot-xl-lora-controlnet:c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63",
  {
    input: {
      control_guidance_end: 0.7,
      control_guidance_start: 0,
      control_type: "depth",
      controlnet_conditioning_scale: 0.8,
      height: 384,
      negative_prompt: "dark, underexposed",
      original_height: 1080,
      original_width: 1920,
      prompt: "anime, animated establishing shot of a volcano erupting, bright sunshine and snow",
      replicate_weights_url: "",
      seed: 1002,
      steps: 30,
      target_height: 512,
      target_width: 512,
      video_duration: 1000,
      video_length: 8,
      width: 672
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_1UQ**********************************

This is your API token. Keep it to yourself.

Import the client:

import replicate

Run cloneofsimo/hotshot-xl-lora-controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "cloneofsimo/hotshot-xl-lora-controlnet:c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63",
    input={
        "control_guidance_end": 0.7,
        "control_guidance_start": 0,
        "control_type": "depth",
        "controlnet_conditioning_scale": 0.8,
        "height": 384,
        "negative_prompt": "dark, underexposed",
        "original_height": 1080,
        "original_width": 1920,
        "prompt": "anime, animated establishing shot of a volcano erupting, bright sunshine and snow",
        "replicate_weights_url": "",
        "seed": 1002,
        "steps": 30,
        "target_height": 512,
        "target_width": 512,
        "video_duration": 1000,
        "video_length": 8,
        "width": 672
    }
)

# To access the file URL:
print(output.url())
#=> "http://example.com"

# To write the file to disk:
with open("my-image.png", "wb") as file:
    file.write(output.read())

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_1UQ**********************************

This is your API token. Keep it to yourself.

Run cloneofsimo/hotshot-xl-lora-controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "cloneofsimo/hotshot-xl-lora-controlnet:c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63",
    "input": {
      "control_guidance_end": 0.7,
      "control_guidance_start": 0,
      "control_type": "depth",
      "controlnet_conditioning_scale": 0.8,
      "height": 384,
      "negative_prompt": "dark, underexposed",
      "original_height": 1080,
      "original_width": 1920,
      "prompt": "anime, animated establishing shot of a volcano erupting, bright sunshine and snow",
      "replicate_weights_url": "",
      "seed": 1002,
      "steps": 30,
      "target_height": 512,
      "target_width": 512,
      "video_duration": 1000,
      "video_length": 8,
      "width": 672
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

{
  "id": "irlqj5lb2ilnbbdmrpxmjtutxu",
  "model": "cloneofsimo/hotshot-xl-lora-controlnet",
  "version": "c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63",
  "input": {
    "control_guidance_end": 0.7,
    "control_guidance_start": 0,
    "control_type": "depth",
    "controlnet_conditioning_scale": 0.8,
    "gif": null,
    "height": 384,
    "hf_lora_url": null,
    "negative_prompt": "dark, underexposed",
    "original_height": 1080,
    "original_width": 1920,
    "prompt": "anime, animated establishing shot of a volcano erupting, bright sunshine and snow",
    "replicate_weights_url": "",
    "seed": 1002,
    "steps": 30,
    "target_height": 512,
    "target_width": 512,
    "video_duration": 1000,
    "video_length": 8,
    "width": 672
  },
  "logs": "Warning - setting num_images_per_prompt = 1 because video_length = 8\n  0%|          | 0/30 [00:00<?, ?it/s]\n  3%|▎         | 1/30 [00:00<00:19,  1.45it/s]\n  7%|▋         | 2/30 [00:01<00:19,  1.45it/s]\n 10%|█         | 3/30 [00:02<00:18,  1.45it/s]\n 13%|█▎        | 4/30 [00:02<00:17,  1.45it/s]\n 17%|█▋        | 5/30 [00:03<00:17,  1.45it/s]\n 20%|██        | 6/30 [00:04<00:16,  1.45it/s]\n 23%|██▎       | 7/30 [00:04<00:15,  1.46it/s]\n 27%|██▋       | 8/30 [00:05<00:15,  1.46it/s]\n 30%|███       | 9/30 [00:06<00:14,  1.46it/s]\n 33%|███▎      | 10/30 [00:06<00:13,  1.46it/s]\n 37%|███▋      | 11/30 [00:07<00:13,  1.45it/s]\n 40%|████      | 12/30 [00:08<00:12,  1.45it/s]\n 43%|████▎     | 13/30 [00:08<00:11,  1.45it/s]\n 47%|████▋     | 14/30 [00:09<00:10,  1.45it/s]\n 50%|█████     | 15/30 [00:10<00:10,  1.45it/s]\n 53%|█████▎    | 16/30 [00:11<00:09,  1.45it/s]\n 57%|█████▋    | 17/30 [00:11<00:08,  1.45it/s]\n 60%|██████    | 18/30 [00:12<00:08,  1.45it/s]\n 63%|██████▎   | 19/30 [00:13<00:07,  1.45it/s]\n 67%|██████▋   | 20/30 [00:13<00:06,  1.45it/s]\n 70%|███████   | 21/30 [00:14<00:06,  1.45it/s]\n 73%|███████▎  | 22/30 [00:15<00:05,  1.45it/s]\n 77%|███████▋  | 23/30 [00:15<00:04,  1.45it/s]\n 80%|████████  | 24/30 [00:16<00:04,  1.45it/s]\n 83%|████████▎ | 25/30 [00:17<00:03,  1.45it/s]\n 87%|████████▋ | 26/30 [00:17<00:02,  1.45it/s]\n 90%|█████████ | 27/30 [00:18<00:02,  1.45it/s]\n 93%|█████████▎| 28/30 [00:19<00:01,  1.45it/s]\n 97%|█████████▋| 29/30 [00:19<00:00,  1.45it/s]\n100%|██████████| 30/30 [00:20<00:00,  1.45it/s]\n100%|██████████| 30/30 [00:20<00:00,  1.45it/s]\n  0%|          | 0/8 [00:00<?, ?it/s]\n 50%|█████     | 4/8 [00:00<00:00, 35.64it/s]\n100%|██████████| 8/8 [00:00<00:00, 19.58it/s]\n100%|██████████| 8/8 [00:00<00:00, 20.99it/s]",
  "output": "https://replicate.delivery/pbxt/RU9CI33SMCKMFBFQplELLexGPsOGNIU42VpauosBZZLkhW2IA/tmp.gif",
  "data_removed": false,
  "error": null,
  "source": "web",
  "status": "succeeded",
  "created_at": "2023-10-10T09:51:46.452704Z",
  "started_at": "2023-10-10T09:51:46.457278Z",
  "completed_at": "2023-10-10T09:52:09.87476Z",
  "urls": {
    "cancel": "https://api.replicate.com/v1/predictions/irlqj5lb2ilnbbdmrpxmjtutxu/cancel",
    "get": "https://api.replicate.com/v1/predictions/irlqj5lb2ilnbbdmrpxmjtutxu"
  },
  "metrics": {
    "predict_time": 23.417482,
    "total_time": 23.422056
  }
}

Generated in

23.4 seconds

Tweak it Report

Warning - setting num_images_per_prompt = 1 because video_length = 8 0%| | 0/30 [00:00<?, ?it/s] 3%|▎ | 1/30 [00:00<00:19, 1.45it/s] 7%|▋ | 2/30 [00:01<00:19, 1.45it/s] 10%|█ | 3/30 [00:02<00:18, 1.45it/s] 13%|█▎ | 4/30 [00:02<00:17, 1.45it/s] 17%|█▋ | 5/30 [00:03<00:17, 1.45it/s] 20%|██ | 6/30 [00:04<00:16, 1.45it/s] 23%|██▎ | 7/30 [00:04<00:15, 1.46it/s] 27%|██▋ | 8/30 [00:05<00:15, 1.46it/s] 30%|███ | 9/30 [00:06<00:14, 1.46it/s] 33%|███▎ | 10/30 [00:06<00:13, 1.46it/s] 37%|███▋ | 11/30 [00:07<00:13, 1.45it/s] 40%|████ | 12/30 [00:08<00:12, 1.45it/s] 43%|████▎ | 13/30 [00:08<00:11, 1.45it/s] 47%|████▋ | 14/30 [00:09<00:10, 1.45it/s] 50%|█████ | 15/30 [00:10<00:10, 1.45it/s] 53%|█████▎ | 16/30 [00:11<00:09, 1.45it/s] 57%|█████▋ | 17/30 [00:11<00:08, 1.45it/s] 60%|██████ | 18/30 [00:12<00:08, 1.45it/s] 63%|██████▎ | 19/30 [00:13<00:07, 1.45it/s] 67%|██████▋ | 20/30 [00:13<00:06, 1.45it/s] 70%|███████ | 21/30 [00:14<00:06, 1.45it/s] 73%|███████▎ | 22/30 [00:15<00:05, 1.45it/s] 77%|███████▋ | 23/30 [00:15<00:04, 1.45it/s] 80%|████████ | 24/30 [00:16<00:04, 1.45it/s] 83%|████████▎ | 25/30 [00:17<00:03, 1.45it/s] 87%|████████▋ | 26/30 [00:17<00:02, 1.45it/s] 90%|█████████ | 27/30 [00:18<00:02, 1.45it/s] 93%|█████████▎| 28/30 [00:19<00:01, 1.45it/s] 97%|█████████▋| 29/30 [00:19<00:00, 1.45it/s] 100%|██████████| 30/30 [00:20<00:00, 1.45it/s] 100%|██████████| 30/30 [00:20<00:00, 1.45it/s] 0%| | 0/8 [00:00<?, ?it/s] 50%|█████ | 4/8 [00:00<00:00, 35.64it/s] 100%|██████████| 8/8 [00:00<00:00, 19.58it/s] 100%|██████████| 8/8 [00:00<00:00, 20.99it/s]