hvision-nku/storydiffusion:d0faed1e – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

hvision-nku /storydiffusion:d0faed1e

Playground API

Input

sd_model

string

Choose a model

Default: "Unstable"

ref_image

file

Reference image for the character

character_description

string

Shift + Return to add a new line

General description of the character. If ref_image above is provided, making sure to follow the class word you want to customize with the trigger word 'img', such as: 'man img' or 'woman img' or 'girl img'

Default: "a man, wearing black suit"

negative_prompt

string

Shift + Return to add a new line

bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbsbad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs

Describe things you do not want to see in the output

Default: "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs"

comic_description

string

Shift + Return to add a new line

at home, read new paper #at home, The newspaper says there is a treasure house in the forest.
on the road, near the forest
[NC] The car on the road, near the forest #He drives to the forest in search of treasure.
[NC]A tiger appeared in the forest, at night 
very frightened, open mouth, in the forest, at night
running very fast, in the forest, at night
[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!
in the house filled with  treasure, laughing, at night #He is overjoyed inside the house.at home, read new paper #at home, The newspaper says there is a treasure house in the forest.
on the road, near the forest
[NC] The car on the road, near the forest #He drives to the forest in search of treasure.
[NC]A tiger appeared in the forest, at night 
very frightened, open mouth, in the forest, at night
running very fast, in the forest, at night
[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!
in the house filled with  treasure, laughing, at night #He is overjoyed inside the house.

Comic Description. Each frame is divided by a new line. Only the first 10 prompts are valid for demo speed! For comic_description NOT using ref_image: (1) Support Typesetting Style and Captioning. By default, the prompt is used as the caption for each image. If you need to change the caption, add a '#' at the end of each line. Only the part after the '#' will be added as a caption to the image. (2) The [NC] symbol is used as a flag to indicate that no characters should be present in the generated scene images. If you want do that, prepend the '[NC]' at the beginning of the line.

Default: "at home, read new paper #at home, The newspaper says there is a treasure house in the forest.\non the road, near the forest\n[NC] The car on the road, near the forest #He drives to the forest in search of treasure.\n[NC]A tiger appeared in the forest, at night \nvery frightened, open mouth, in the forest, at night\nrunning very fast, in the forest, at night\n[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!\nin the house filled with treasure, laughing, at night #He is overjoyed inside the house."

style_name

string

Style template

Default: "Japanese Anime"

comic_style

string

Select the comic style for the combined comic

Default: "Classic Comic Style"

style_strength_ratio

integer

(minimum: 15, maximum: 50)

Style strength of Ref Image (%), only used if ref_image is provided

Default: 20

image_width

integer

Width of output image

Default: 768

image_height

integer

Height of output image

Default: 768

num_steps

integer

(minimum: 25, maximum: 50)

Number of sample steps

Default: 50

guidance_scale

number

(minimum: 0.1, maximum: 10)

Scale for classifier-free guidance

Default: 5

seed

integer

Random seed. Leave blank to randomize the seed

sa32_setting

number

(minimum: 0, maximum: 1)

The degree of Paired Attention at 32 x 32 self-attention layers

Default: 0.7

sa64_setting

number

(minimum: 0, maximum: 1)

The degree of Paired Attention at 64 x 64 self-attention layers

Default: 0.7

num_ids

integer

Number of id images in total images. This should not exceed total number of line-separated prompts

Default: 3

output_format

string

Format of the output images

Default: "webp"

output_quality

integer

(minimum: 0, maximum: 100)

Quality of the output images, from 0 to 100. 100 is best quality, 0 is lowest quality

Default: 80

Run this model in Node.js with one line of code:

npx create-replicate --model=hvision-nku/storydiffusion

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run hvision-nku/storydiffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "hvision-nku/storydiffusion:d0faed1e8b5779d4d060c5bb0afac8e52c704700f7bee9e4341b0684a8feda04",
  {
    input: {
      num_ids: 3,
      sd_model: "Unstable",
      num_steps: 25,
      style_name: "Disney Charactor",
      comic_style: "Classic Comic Style",
      image_width: 768,
      image_height: 768,
      sa32_setting: 0.7,
      sa64_setting: 0.7,
      output_format: "webp",
      guidance_scale: 5,
      output_quality: 80,
      negative_prompt: "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
      comic_description: "at home, read new paper #at home, The newspaper says there is a treasure house in the forest.\non the road, near the forest\n[NC] The car on the road, near the forest #He drives to the forest in search of treasure.\n[NC]A tiger appeared in the forest, at night \nvery frightened, open mouth, in the forest, at night\nrunning very fast, in the forest, at night\n[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!\nin the house filled with  treasure, laughing, at night #He is overjoyed inside the house.",
      style_strength_ratio: 20,
      character_description: "a man, wearing black suit"
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run hvision-nku/storydiffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "hvision-nku/storydiffusion:d0faed1e8b5779d4d060c5bb0afac8e52c704700f7bee9e4341b0684a8feda04",
    input={
        "num_ids": 3,
        "sd_model": "Unstable",
        "num_steps": 25,
        "style_name": "Disney Charactor",
        "comic_style": "Classic Comic Style",
        "image_width": 768,
        "image_height": 768,
        "sa32_setting": 0.7,
        "sa64_setting": 0.7,
        "output_format": "webp",
        "guidance_scale": 5,
        "output_quality": 80,
        "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
        "comic_description": "at home, read new paper #at home, The newspaper says there is a treasure house in the forest.\non the road, near the forest\n[NC] The car on the road, near the forest #He drives to the forest in search of treasure.\n[NC]A tiger appeared in the forest, at night \nvery frightened, open mouth, in the forest, at night\nrunning very fast, in the forest, at night\n[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!\nin the house filled with  treasure, laughing, at night #He is overjoyed inside the house.",
        "style_strength_ratio": 20,
        "character_description": "a man, wearing black suit"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run hvision-nku/storydiffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "d0faed1e8b5779d4d060c5bb0afac8e52c704700f7bee9e4341b0684a8feda04",
    "input": {
      "num_ids": 3,
      "sd_model": "Unstable",
      "num_steps": 25,
      "style_name": "Disney Charactor",
      "comic_style": "Classic Comic Style",
      "image_width": 768,
      "image_height": 768,
      "sa32_setting": 0.7,
      "sa64_setting": 0.7,
      "output_format": "webp",
      "guidance_scale": 5,
      "output_quality": 80,
      "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
      "comic_description": "at home, read new paper #at home, The newspaper says there is a treasure house in the forest.\\non the road, near the forest\\n[NC] The car on the road, near the forest #He drives to the forest in search of treasure.\\n[NC]A tiger appeared in the forest, at night \\nvery frightened, open mouth, in the forest, at night\\nrunning very fast, in the forest, at night\\n[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!\\nin the house filled with  treasure, laughing, at night #He is overjoyed inside the house.",
      "style_strength_ratio": 20,
      "character_description": "a man, wearing black suit"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/cjwbw/storydiffusion@sha256:d0faed1e8b5779d4d060c5bb0afac8e52c704700f7bee9e4341b0684a8feda04 \
  -i 'num_ids=3' \
  -i 'sd_model="Unstable"' \
  -i 'num_steps=25' \
  -i 'style_name="Disney Charactor"' \
  -i 'comic_style="Classic Comic Style"' \
  -i 'image_width=768' \
  -i 'image_height=768' \
  -i 'sa32_setting=0.7' \
  -i 'sa64_setting=0.7' \
  -i 'output_format="webp"' \
  -i 'guidance_scale=5' \
  -i 'output_quality=80' \
  -i 'negative_prompt="bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs"' \
  -i $'comic_description="at home, read new paper #at home, The newspaper says there is a treasure house in the forest.\\non the road, near the forest\\n[NC] The car on the road, near the forest #He drives to the forest in search of treasure.\\n[NC]A tiger appeared in the forest, at night \\nvery frightened, open mouth, in the forest, at night\\nrunning very fast, in the forest, at night\\n[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!\\nin the house filled with  treasure, laughing, at night #He is overjoyed inside the house."' \
  -i 'style_strength_ratio=20' \
  -i 'character_description="a man, wearing black suit"'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/cjwbw/storydiffusion@sha256:d0faed1e8b5779d4d060c5bb0afac8e52c704700f7bee9e4341b0684a8feda04
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "num_ids": 3,
      "sd_model": "Unstable",
      "num_steps": 25,
      "style_name": "Disney Charactor",
      "comic_style": "Classic Comic Style",
      "image_width": 768,
      "image_height": 768,
      "sa32_setting": 0.7,
      "sa64_setting": 0.7,
      "output_format": "webp",
      "guidance_scale": 5,
      "output_quality": 80,
      "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
      "comic_description": "at home, read new paper #at home, The newspaper says there is a treasure house in the forest.\\non the road, near the forest\\n[NC] The car on the road, near the forest #He drives to the forest in search of treasure.\\n[NC]A tiger appeared in the forest, at night \\nvery frightened, open mouth, in the forest, at night\\nrunning very fast, in the forest, at night\\n[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!\\nin the house filled with  treasure, laughing, at night #He is overjoyed inside the house.",
      "style_strength_ratio": 20,
      "character_description": "a man, wearing black suit"
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

comic

individual_images

{
  "completed_at": "2024-05-04T22:52:48.274267Z",
  "created_at": "2024-05-04T22:51:14.003000Z",
  "data_removed": false,
  "error": null,
  "id": "x0mfgjfatdrgm0cf8q6v5rbb3m",
  "input": {
    "num_ids": 3,
    "sd_model": "Unstable",
    "num_steps": 25,
    "style_name": "Disney Charactor",
    "comic_style": "Classic Comic Style",
    "image_width": 768,
    "image_height": 768,
    "sa32_setting": 0.7,
    "sa64_setting": 0.7,
    "output_format": "webp",
    "guidance_scale": 5,
    "output_quality": 80,
    "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
    "comic_description": "at home, read new paper #at home, The newspaper says there is a treasure house in the forest.\non the road, near the forest\n[NC] The car on the road, near the forest #He drives to the forest in search of treasure.\n[NC]A tiger appeared in the forest, at night \nvery frightened, open mouth, in the forest, at night\nrunning very fast, in the forest, at night\n[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!\nin the house filled with  treasure, laughing, at night #He is overjoyed inside the house.",
    "style_strength_ratio": 20,
    "character_description": "a man, wearing black suit"
  },
  "logs": "['at home, read new paper #at home, The newspaper says there is a treasure house in the forest.', 'on the road, near the forest', '[NC] The car on the road, near the forest #He drives to the forest in search of treasure.', '[NC]A tiger appeared in the forest, at night ', 'very frightened, open mouth, in the forest, at night', 'running very fast, in the forest, at night', '[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!', 'in the house filled with  treasure, laughing, at night #He is overjoyed inside the house.']\n['a man, wearing black suit,at home, read new paper #at home, The newspaper says there is a treasure house in the forest.', 'a man, wearing black suit,on the road, near the forest', ' The car on the road, near the forest #He drives to the forest in search of treasure.', 'A tiger appeared in the forest, at night ', 'a man, wearing black suit,very frightened, open mouth, in the forest, at night', 'a man, wearing black suit,running very fast, in the forest, at night', ' A house in the forest, at night #Suddenly, he discovers the treasure house!', 'a man, wearing black suit,in the house filled with  treasure, laughing, at night #He is overjoyed inside the house.']\n['a man, wearing black suit,at home, read new paper', 'a man, wearing black suit,on the road, near the forest', 'The car on the road, near the forest', 'A tiger appeared in the forest, at night', 'a man, wearing black suit,very frightened, open mouth, in the forest, at night', 'a man, wearing black suit,running very fast, in the forest, at night', 'A house in the forest, at night', 'a man, wearing black suit,in the house filled with  treasure, laughing, at night']\nUsing seed: 26420\nSuccessfully load paired self-attention\nNumber of the processor : 36\n  0%|          | 0/25 [00:00<?, ?it/s]\n  4%|▍         | 1/25 [00:00<00:19,  1.21it/s]\n  8%|▊         | 2/25 [00:00<00:10,  2.27it/s]\n 12%|█▏        | 3/25 [00:01<00:07,  3.14it/s]\n 16%|█▌        | 4/25 [00:01<00:05,  3.82it/s]\n 20%|██        | 5/25 [00:01<00:04,  4.34it/s]\n 24%|██▍       | 6/25 [00:01<00:04,  4.09it/s]\n 28%|██▊       | 7/25 [00:02<00:04,  4.00it/s]\n 32%|███▏      | 8/25 [00:02<00:04,  3.92it/s]\n 36%|███▌      | 9/25 [00:02<00:04,  3.89it/s]\n 40%|████      | 10/25 [00:02<00:03,  3.88it/s]\n 44%|████▍     | 11/25 [00:03<00:03,  3.88it/s]\n 48%|████▊     | 12/25 [00:03<00:03,  3.87it/s]\n 52%|█████▏    | 13/25 [00:03<00:03,  3.89it/s]\n 56%|█████▌    | 14/25 [00:03<00:02,  3.90it/s]\n 60%|██████    | 15/25 [00:04<00:02,  3.82it/s]\n 64%|██████▍   | 16/25 [00:04<00:02,  3.69it/s]\n 68%|██████▊   | 17/25 [00:04<00:02,  3.60it/s]\n 72%|███████▏  | 18/25 [00:05<00:01,  3.58it/s]\n 76%|███████▌  | 19/25 [00:05<00:01,  3.64it/s]\n 80%|████████  | 20/25 [00:05<00:01,  3.58it/s]\n 84%|████████▍ | 21/25 [00:05<00:01,  3.48it/s]\n 88%|████████▊ | 22/25 [00:06<00:00,  3.41it/s]\n 92%|█████████▏| 23/25 [00:06<00:00,  3.36it/s]\n 96%|█████████▌| 24/25 [00:06<00:00,  3.34it/s]\n100%|██████████| 25/25 [00:07<00:00,  3.32it/s]\n100%|██████████| 25/25 [00:07<00:00,  3.52it/s]\n  0%|          | 0/25 [00:00<?, ?it/s]\n  4%|▍         | 1/25 [00:00<00:03,  6.92it/s]\n 12%|█▏        | 3/25 [00:00<00:02,  9.37it/s]\n 20%|██        | 5/25 [00:00<00:01, 10.09it/s]\n 24%|██▍       | 6/25 [00:00<00:02,  9.26it/s]\n 28%|██▊       | 7/25 [00:00<00:02,  8.76it/s]\n 32%|███▏      | 8/25 [00:00<00:02,  8.46it/s]\n 36%|███▌      | 9/25 [00:01<00:01,  8.45it/s]\n 40%|████      | 10/25 [00:01<00:01,  8.32it/s]\n 44%|████▍     | 11/25 [00:01<00:01,  8.12it/s]\n 48%|████▊     | 12/25 [00:01<00:01,  8.09it/s]\n 52%|█████▏    | 13/25 [00:01<00:01,  8.04it/s]\n 56%|█████▌    | 14/25 [00:01<00:01,  7.89it/s]\n 60%|██████    | 15/25 [00:01<00:01,  7.93it/s]\n 64%|██████▍   | 16/25 [00:01<00:01,  7.98it/s]\n 68%|██████▊   | 17/25 [00:02<00:00,  8.38it/s]\n 72%|███████▏  | 18/25 [00:02<00:00,  8.23it/s]\n 76%|███████▌  | 19/25 [00:02<00:00,  8.21it/s]\n 80%|████████  | 20/25 [00:02<00:00,  7.95it/s]\n 84%|████████▍ | 21/25 [00:02<00:00,  7.68it/s]\n 88%|████████▊ | 22/25 [00:02<00:00,  7.74it/s]\n 92%|█████████▏| 23/25 [00:02<00:00,  7.51it/s]\n 96%|█████████▌| 24/25 [00:02<00:00,  7.40it/s]\n100%|██████████| 25/25 [00:03<00:00,  7.49it/s]\n100%|██████████| 25/25 [00:03<00:00,  8.12it/s]\n  0%|          | 0/25 [00:00<?, ?it/s]\n  8%|▊         | 2/25 [00:00<00:02, 10.77it/s]\n 16%|█▌        | 4/25 [00:00<00:01, 10.83it/s]\n 24%|██▍       | 6/25 [00:00<00:01, 10.10it/s]\n 32%|███▏      | 8/25 [00:00<00:01,  9.13it/s]\n 36%|███▌      | 9/25 [00:00<00:01,  9.03it/s]\n 40%|████      | 10/25 [00:01<00:01,  8.84it/s]\n 44%|████▍     | 11/25 [00:01<00:01,  8.62it/s]\n 48%|████▊     | 12/25 [00:01<00:01,  8.66it/s]\n 52%|█████▏    | 13/25 [00:01<00:01,  8.59it/s]\n 56%|█████▌    | 14/25 [00:01<00:01,  8.49it/s]\n 60%|██████    | 15/25 [00:01<00:01,  8.50it/s]\n 64%|██████▍   | 16/25 [00:01<00:01,  8.32it/s]\n 68%|██████▊   | 17/25 [00:01<00:00,  8.21it/s]\n 72%|███████▏  | 18/25 [00:02<00:00,  8.37it/s]\n 76%|███████▌  | 19/25 [00:02<00:00,  8.27it/s]\n 80%|████████  | 20/25 [00:02<00:00,  8.33it/s]\n 84%|████████▍ | 21/25 [00:02<00:00,  7.99it/s]\n 88%|████████▊ | 22/25 [00:02<00:00,  7.77it/s]\n 92%|█████████▏| 23/25 [00:02<00:00,  7.54it/s]\n 96%|█████████▌| 24/25 [00:02<00:00,  7.50it/s]\n100%|██████████| 25/25 [00:02<00:00,  7.48it/s]\n100%|██████████| 25/25 [00:02<00:00,  8.45it/s]\n  0%|          | 0/25 [00:00<?, ?it/s]\n  8%|▊         | 2/25 [00:00<00:02, 10.80it/s]\n 16%|█▌        | 4/25 [00:00<00:01, 10.82it/s]\n 24%|██▍       | 6/25 [00:00<00:01, 10.16it/s]\n 32%|███▏      | 8/25 [00:00<00:01,  9.63it/s]\n 36%|███▌      | 9/25 [00:00<00:01,  9.26it/s]\n 40%|████      | 10/25 [00:01<00:01,  8.89it/s]\n 44%|████▍     | 11/25 [00:01<00:01,  8.54it/s]\n 48%|████▊     | 12/25 [00:01<00:01,  8.53it/s]\n 52%|█████▏    | 13/25 [00:01<00:01,  8.35it/s]\n 56%|█████▌    | 14/25 [00:01<00:01,  8.32it/s]\n 60%|██████    | 15/25 [00:01<00:01,  8.33it/s]\n 64%|██████▍   | 16/25 [00:01<00:01,  8.30it/s]\n 68%|██████▊   | 17/25 [00:01<00:00,  8.20it/s]\n 72%|███████▏  | 18/25 [00:02<00:00,  8.11it/s]\n 76%|███████▌  | 19/25 [00:02<00:00,  7.93it/s]\n 80%|████████  | 20/25 [00:02<00:00,  8.07it/s]\n 84%|████████▍ | 21/25 [00:02<00:00,  8.03it/s]\n 88%|████████▊ | 22/25 [00:02<00:00,  7.81it/s]\n 92%|█████████▏| 23/25 [00:02<00:00,  7.57it/s]\n 96%|█████████▌| 24/25 [00:02<00:00,  7.58it/s]\n100%|██████████| 25/25 [00:02<00:00,  7.50it/s]\n100%|██████████| 25/25 [00:02<00:00,  8.42it/s]\n  0%|          | 0/25 [00:00<?, ?it/s]\n  8%|▊         | 2/25 [00:00<00:02, 10.73it/s]\n 16%|█▌        | 4/25 [00:00<00:01, 10.83it/s]\n 24%|██▍       | 6/25 [00:00<00:01, 10.47it/s]\n 32%|███▏      | 8/25 [00:00<00:01,  9.35it/s]\n 36%|███▌      | 9/25 [00:00<00:01,  8.95it/s]\n 40%|████      | 10/25 [00:01<00:01,  8.58it/s]\n 44%|████▍     | 11/25 [00:01<00:01,  8.33it/s]\n 48%|████▊     | 12/25 [00:01<00:01,  8.53it/s]\n 52%|█████▏    | 13/25 [00:01<00:01,  8.63it/s]\n 56%|█████▌    | 14/25 [00:01<00:01,  8.46it/s]\n 60%|██████    | 15/25 [00:01<00:01,  8.44it/s]\n 64%|██████▍   | 16/25 [00:01<00:01,  8.30it/s]\n 68%|██████▊   | 17/25 [00:01<00:00,  8.19it/s]\n 72%|███████▏  | 18/25 [00:02<00:00,  8.03it/s]\n 76%|███████▌  | 19/25 [00:02<00:00,  7.97it/s]\n 80%|████████  | 20/25 [00:02<00:00,  7.92it/s]\n 84%|████████▍ | 21/25 [00:02<00:00,  7.75it/s]\n 88%|████████▊ | 22/25 [00:02<00:00,  7.63it/s]\n 92%|█████████▏| 23/25 [00:02<00:00,  7.57it/s]\n 96%|█████████▌| 24/25 [00:02<00:00,  7.51it/s]\n100%|██████████| 25/25 [00:02<00:00,  7.44it/s]\n100%|██████████| 25/25 [00:02<00:00,  8.36it/s]\n  0%|          | 0/25 [00:00<?, ?it/s]\n  8%|▊         | 2/25 [00:00<00:02, 10.76it/s]\n 16%|█▌        | 4/25 [00:00<00:01, 10.82it/s]\n 24%|██▍       | 6/25 [00:00<00:01, 10.03it/s]\n 32%|███▏      | 8/25 [00:00<00:01,  9.16it/s]\n 36%|███▌      | 9/25 [00:00<00:01,  8.95it/s]\n 40%|████      | 10/25 [00:01<00:01,  8.91it/s]\n 44%|████▍     | 11/25 [00:01<00:01,  8.43it/s]\n 48%|████▊     | 12/25 [00:01<00:01,  8.45it/s]\n 52%|█████▏    | 13/25 [00:01<00:01,  8.20it/s]\n 56%|█████▌    | 14/25 [00:01<00:01,  8.23it/s]\n 60%|██████    | 15/25 [00:01<00:01,  8.03it/s]\n 64%|██████▍   | 16/25 [00:01<00:01,  7.92it/s]\n 68%|██████▊   | 17/25 [00:01<00:01,  7.95it/s]\n 72%|███████▏  | 18/25 [00:02<00:00,  8.04it/s]\n 76%|███████▌  | 19/25 [00:02<00:00,  8.03it/s]\n 80%|████████  | 20/25 [00:02<00:00,  7.96it/s]\n 84%|████████▍ | 21/25 [00:02<00:00,  7.78it/s]\n 88%|████████▊ | 22/25 [00:02<00:00,  7.52it/s]\n 92%|█████████▏| 23/25 [00:02<00:00,  7.40it/s]\n 96%|█████████▌| 24/25 [00:02<00:00,  7.29it/s]\n100%|██████████| 25/25 [00:03<00:00,  7.41it/s]\n100%|██████████| 25/25 [00:03<00:00,  8.26it/s]\n4 [[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93E64690>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C9428B0D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C95F0EA90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C94235110>]]\n0 [[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93E64690>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C9428B0D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C95F0EA90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C94235110>], [<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C941E5A50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC64D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC7E90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC7ED0>]]\n[[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93E64690>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C9428B0D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C95F0EA90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C94235110>], [<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C941E5A50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC64D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC7E90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC7ED0>]]\n1 (7, 650)\n0 (124, 721)\n1 (56, 636)\n0 (1, 712)\nPipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.\nPipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.\nPipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.\nPipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.",
  "metrics": {
    "predict_time": 32.411101,
    "total_time": 94.271267
  },
  "output": {
    "comic": "https://replicate.delivery/pbxt/2Dfo7bS5xtRVaKetjG3dBAmfvi0U47R0fxznTearmUZyH3IWC/comic.webp",
    "individual_images": [
      "https://replicate.delivery/pbxt/jbMHRLctL3oePSecrNlTpEYlSusbISeqG36PsO80qH6ejbELB/out-0.webp",
      "https://replicate.delivery/pbxt/qfRozduVXqwPSSAApNiGHvAnMYcMWnxVR5ozsJlaEfsfxNilA/out-1.webp",
      "https://replicate.delivery/pbxt/wKSIYJY2IU4iNR1x2IK6BcgiMsvTGWOmUQKmcI02MoxPuRsE/out-2.webp",
      "https://replicate.delivery/pbxt/J2qFUX6L8Xa5BxkjfNhQj1ENK7PkesDNvIL9eHr3p9OejbELB/out-3.webp",
      "https://replicate.delivery/pbxt/KGrZeFia1PwHV6bT1SI2q3KK8DtNPQH0Cs1fctwN0X9fxNilA/out-4.webp",
      "https://replicate.delivery/pbxt/NMz3LLKBl37ODNNYTu6RehpsVPALgJfGLH4UNPNx3zCfxNilA/out-5.webp",
      "https://replicate.delivery/pbxt/Ny3mrUcfxORrICxnRICp2MLmiVEmKQaUwSeQcDc8yQ6fxNilA/out-6.webp",
      "https://replicate.delivery/pbxt/YI6MJsi9QEZVAtAjyOsnU58bTckiUtjEFtjn7besmmGgcjYJA/out-7.webp"
    ]
  },
  "started_at": "2024-05-04T22:52:15.863166Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/x0mfgjfatdrgm0cf8q6v5rbb3m",
    "cancel": "https://api.replicate.com/v1/predictions/x0mfgjfatdrgm0cf8q6v5rbb3m/cancel"
  },
  "version": "d0faed1e8b5779d4d060c5bb0afac8e52c704700f7bee9e4341b0684a8feda04"
}

Generated in

32.4 seconds

Tweak it ShareReport

['at home, read new paper #at home, The newspaper says there is a treasure house in the forest.', 'on the road, near the forest', '[NC] The car on the road, near the forest #He drives to the forest in search of treasure.', '[NC]A tiger appeared in the forest, at night ', 'very frightened, open mouth, in the forest, at night', 'running very fast, in the forest, at night', '[NC] A house in the forest, at night #Suddenly, he discovers the treasure house!', 'in the house filled with  treasure, laughing, at night #He is overjoyed inside the house.']
['a man, wearing black suit,at home, read new paper #at home, The newspaper says there is a treasure house in the forest.', 'a man, wearing black suit,on the road, near the forest', ' The car on the road, near the forest #He drives to the forest in search of treasure.', 'A tiger appeared in the forest, at night ', 'a man, wearing black suit,very frightened, open mouth, in the forest, at night', 'a man, wearing black suit,running very fast, in the forest, at night', ' A house in the forest, at night #Suddenly, he discovers the treasure house!', 'a man, wearing black suit,in the house filled with  treasure, laughing, at night #He is overjoyed inside the house.']
['a man, wearing black suit,at home, read new paper', 'a man, wearing black suit,on the road, near the forest', 'The car on the road, near the forest', 'A tiger appeared in the forest, at night', 'a man, wearing black suit,very frightened, open mouth, in the forest, at night', 'a man, wearing black suit,running very fast, in the forest, at night', 'A house in the forest, at night', 'a man, wearing black suit,in the house filled with  treasure, laughing, at night']
Using seed: 26420
Successfully load paired self-attention
Number of the processor : 36
  0%|          | 0/25 [00:00<?, ?it/s]
  4%|▍         | 1/25 [00:00<00:19,  1.21it/s]
  8%|▊         | 2/25 [00:00<00:10,  2.27it/s]
 12%|█▏        | 3/25 [00:01<00:07,  3.14it/s]
 16%|█▌        | 4/25 [00:01<00:05,  3.82it/s]
 20%|██        | 5/25 [00:01<00:04,  4.34it/s]
 24%|██▍       | 6/25 [00:01<00:04,  4.09it/s]
 28%|██▊       | 7/25 [00:02<00:04,  4.00it/s]
 32%|███▏      | 8/25 [00:02<00:04,  3.92it/s]
 36%|███▌      | 9/25 [00:02<00:04,  3.89it/s]
 40%|████      | 10/25 [00:02<00:03,  3.88it/s]
 44%|████▍     | 11/25 [00:03<00:03,  3.88it/s]
 48%|████▊     | 12/25 [00:03<00:03,  3.87it/s]
 52%|█████▏    | 13/25 [00:03<00:03,  3.89it/s]
 56%|█████▌    | 14/25 [00:03<00:02,  3.90it/s]
 60%|██████    | 15/25 [00:04<00:02,  3.82it/s]
 64%|██████▍   | 16/25 [00:04<00:02,  3.69it/s]
 68%|██████▊   | 17/25 [00:04<00:02,  3.60it/s]
 72%|███████▏  | 18/25 [00:05<00:01,  3.58it/s]
 76%|███████▌  | 19/25 [00:05<00:01,  3.64it/s]
 80%|████████  | 20/25 [00:05<00:01,  3.58it/s]
 84%|████████▍ | 21/25 [00:05<00:01,  3.48it/s]
 88%|████████▊ | 22/25 [00:06<00:00,  3.41it/s]
 92%|█████████▏| 23/25 [00:06<00:00,  3.36it/s]
 96%|█████████▌| 24/25 [00:06<00:00,  3.34it/s]
100%|██████████| 25/25 [00:07<00:00,  3.32it/s]
100%|██████████| 25/25 [00:07<00:00,  3.52it/s]
  0%|          | 0/25 [00:00<?, ?it/s]
  4%|▍         | 1/25 [00:00<00:03,  6.92it/s]
 12%|█▏        | 3/25 [00:00<00:02,  9.37it/s]
 20%|██        | 5/25 [00:00<00:01, 10.09it/s]
 24%|██▍       | 6/25 [00:00<00:02,  9.26it/s]
 28%|██▊       | 7/25 [00:00<00:02,  8.76it/s]
 32%|███▏      | 8/25 [00:00<00:02,  8.46it/s]
 36%|███▌      | 9/25 [00:01<00:01,  8.45it/s]
 40%|████      | 10/25 [00:01<00:01,  8.32it/s]
 44%|████▍     | 11/25 [00:01<00:01,  8.12it/s]
 48%|████▊     | 12/25 [00:01<00:01,  8.09it/s]
 52%|█████▏    | 13/25 [00:01<00:01,  8.04it/s]
 56%|█████▌    | 14/25 [00:01<00:01,  7.89it/s]
 60%|██████    | 15/25 [00:01<00:01,  7.93it/s]
 64%|██████▍   | 16/25 [00:01<00:01,  7.98it/s]
 68%|██████▊   | 17/25 [00:02<00:00,  8.38it/s]
 72%|███████▏  | 18/25 [00:02<00:00,  8.23it/s]
 76%|███████▌  | 19/25 [00:02<00:00,  8.21it/s]
 80%|████████  | 20/25 [00:02<00:00,  7.95it/s]
 84%|████████▍ | 21/25 [00:02<00:00,  7.68it/s]
 88%|████████▊ | 22/25 [00:02<00:00,  7.74it/s]
 92%|█████████▏| 23/25 [00:02<00:00,  7.51it/s]
 96%|█████████▌| 24/25 [00:02<00:00,  7.40it/s]
100%|██████████| 25/25 [00:03<00:00,  7.49it/s]
100%|██████████| 25/25 [00:03<00:00,  8.12it/s]
  0%|          | 0/25 [00:00<?, ?it/s]
  8%|▊         | 2/25 [00:00<00:02, 10.77it/s]
 16%|█▌        | 4/25 [00:00<00:01, 10.83it/s]
 24%|██▍       | 6/25 [00:00<00:01, 10.10it/s]
 32%|███▏      | 8/25 [00:00<00:01,  9.13it/s]
 36%|███▌      | 9/25 [00:00<00:01,  9.03it/s]
 40%|████      | 10/25 [00:01<00:01,  8.84it/s]
 44%|████▍     | 11/25 [00:01<00:01,  8.62it/s]
 48%|████▊     | 12/25 [00:01<00:01,  8.66it/s]
 52%|█████▏    | 13/25 [00:01<00:01,  8.59it/s]
 56%|█████▌    | 14/25 [00:01<00:01,  8.49it/s]
 60%|██████    | 15/25 [00:01<00:01,  8.50it/s]
 64%|██████▍   | 16/25 [00:01<00:01,  8.32it/s]
 68%|██████▊   | 17/25 [00:01<00:00,  8.21it/s]
 72%|███████▏  | 18/25 [00:02<00:00,  8.37it/s]
 76%|███████▌  | 19/25 [00:02<00:00,  8.27it/s]
 80%|████████  | 20/25 [00:02<00:00,  8.33it/s]
 84%|████████▍ | 21/25 [00:02<00:00,  7.99it/s]
 88%|████████▊ | 22/25 [00:02<00:00,  7.77it/s]
 92%|█████████▏| 23/25 [00:02<00:00,  7.54it/s]
 96%|█████████▌| 24/25 [00:02<00:00,  7.50it/s]
100%|██████████| 25/25 [00:02<00:00,  7.48it/s]
100%|██████████| 25/25 [00:02<00:00,  8.45it/s]
  0%|          | 0/25 [00:00<?, ?it/s]
  8%|▊         | 2/25 [00:00<00:02, 10.80it/s]
 16%|█▌        | 4/25 [00:00<00:01, 10.82it/s]
 24%|██▍       | 6/25 [00:00<00:01, 10.16it/s]
 32%|███▏      | 8/25 [00:00<00:01,  9.63it/s]
 36%|███▌      | 9/25 [00:00<00:01,  9.26it/s]
 40%|████      | 10/25 [00:01<00:01,  8.89it/s]
 44%|████▍     | 11/25 [00:01<00:01,  8.54it/s]
 48%|████▊     | 12/25 [00:01<00:01,  8.53it/s]
 52%|█████▏    | 13/25 [00:01<00:01,  8.35it/s]
 56%|█████▌    | 14/25 [00:01<00:01,  8.32it/s]
 60%|██████    | 15/25 [00:01<00:01,  8.33it/s]
 64%|██████▍   | 16/25 [00:01<00:01,  8.30it/s]
 68%|██████▊   | 17/25 [00:01<00:00,  8.20it/s]
 72%|███████▏  | 18/25 [00:02<00:00,  8.11it/s]
 76%|███████▌  | 19/25 [00:02<00:00,  7.93it/s]
 80%|████████  | 20/25 [00:02<00:00,  8.07it/s]
 84%|████████▍ | 21/25 [00:02<00:00,  8.03it/s]
 88%|████████▊ | 22/25 [00:02<00:00,  7.81it/s]
 92%|█████████▏| 23/25 [00:02<00:00,  7.57it/s]
 96%|█████████▌| 24/25 [00:02<00:00,  7.58it/s]
100%|██████████| 25/25 [00:02<00:00,  7.50it/s]
100%|██████████| 25/25 [00:02<00:00,  8.42it/s]
  0%|          | 0/25 [00:00<?, ?it/s]
  8%|▊         | 2/25 [00:00<00:02, 10.73it/s]
 16%|█▌        | 4/25 [00:00<00:01, 10.83it/s]
 24%|██▍       | 6/25 [00:00<00:01, 10.47it/s]
 32%|███▏      | 8/25 [00:00<00:01,  9.35it/s]
 36%|███▌      | 9/25 [00:00<00:01,  8.95it/s]
 40%|████      | 10/25 [00:01<00:01,  8.58it/s]
 44%|████▍     | 11/25 [00:01<00:01,  8.33it/s]
 48%|████▊     | 12/25 [00:01<00:01,  8.53it/s]
 52%|█████▏    | 13/25 [00:01<00:01,  8.63it/s]
 56%|█████▌    | 14/25 [00:01<00:01,  8.46it/s]
 60%|██████    | 15/25 [00:01<00:01,  8.44it/s]
 64%|██████▍   | 16/25 [00:01<00:01,  8.30it/s]
 68%|██████▊   | 17/25 [00:01<00:00,  8.19it/s]
 72%|███████▏  | 18/25 [00:02<00:00,  8.03it/s]
 76%|███████▌  | 19/25 [00:02<00:00,  7.97it/s]
 80%|████████  | 20/25 [00:02<00:00,  7.92it/s]
 84%|████████▍ | 21/25 [00:02<00:00,  7.75it/s]
 88%|████████▊ | 22/25 [00:02<00:00,  7.63it/s]
 92%|█████████▏| 23/25 [00:02<00:00,  7.57it/s]
 96%|█████████▌| 24/25 [00:02<00:00,  7.51it/s]
100%|██████████| 25/25 [00:02<00:00,  7.44it/s]
100%|██████████| 25/25 [00:02<00:00,  8.36it/s]
  0%|          | 0/25 [00:00<?, ?it/s]
  8%|▊         | 2/25 [00:00<00:02, 10.76it/s]
 16%|█▌        | 4/25 [00:00<00:01, 10.82it/s]
 24%|██▍       | 6/25 [00:00<00:01, 10.03it/s]
 32%|███▏      | 8/25 [00:00<00:01,  9.16it/s]
 36%|███▌      | 9/25 [00:00<00:01,  8.95it/s]
 40%|████      | 10/25 [00:01<00:01,  8.91it/s]
 44%|████▍     | 11/25 [00:01<00:01,  8.43it/s]
 48%|████▊     | 12/25 [00:01<00:01,  8.45it/s]
 52%|█████▏    | 13/25 [00:01<00:01,  8.20it/s]
 56%|█████▌    | 14/25 [00:01<00:01,  8.23it/s]
 60%|██████    | 15/25 [00:01<00:01,  8.03it/s]
 64%|██████▍   | 16/25 [00:01<00:01,  7.92it/s]
 68%|██████▊   | 17/25 [00:01<00:01,  7.95it/s]
 72%|███████▏  | 18/25 [00:02<00:00,  8.04it/s]
 76%|███████▌  | 19/25 [00:02<00:00,  8.03it/s]
 80%|████████  | 20/25 [00:02<00:00,  7.96it/s]
 84%|████████▍ | 21/25 [00:02<00:00,  7.78it/s]
 88%|████████▊ | 22/25 [00:02<00:00,  7.52it/s]
 92%|█████████▏| 23/25 [00:02<00:00,  7.40it/s]
 96%|█████████▌| 24/25 [00:02<00:00,  7.29it/s]
100%|██████████| 25/25 [00:03<00:00,  7.41it/s]
100%|██████████| 25/25 [00:03<00:00,  8.26it/s]
4 [[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93E64690>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C9428B0D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C95F0EA90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C94235110>]]
0 [[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93E64690>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C9428B0D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C95F0EA90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C94235110>], [<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C941E5A50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC64D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC7E90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC7ED0>]]
[[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93E64690>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C9428B0D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C95F0EA90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C94235110>], [<PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C941E5A50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC64D0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC7E90>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F5C93CC7ED0>]]
1 (7, 650)
0 (124, 721)
1 (56, 636)
0 (1, 712)
Pipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.
Pipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.
Pipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.
Pipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.