camenduru/story-diffusion – Run with an API on Replicate

camenduru / story-diffusion

StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation

Cold

Public
1K runs
L40S
GitHub
Paper
License

Run with an API

Playground API Examples README Versions

Input

input_image

*file

style

string

Shift + Return to add a new line

Style template: '(No style)', 'Japanese Anime', 'Cinematic', 'Disney Character', 'Photographic', 'Comic book', 'Line art'

Default: "Japanese Anime"

style_strength_ratio

integer

Style strength of Ref Image (%)

Default: 20

model_type

string

Control type of the Character

Default: "Using Ref Images"

general_prompt

string

Shift + Return to add a new line

a woman img, wearing a white T-shirt, blue loose haira woman img, wearing a white T-shirt, blue loose hair

Textual Description for Character

Default: "a woman img, wearing a white T-shirt, blue loose hair"

negative_prompt

string

Shift + Return to add a new line

bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbsbad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs

Negative Prompt

Default: "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs"

prompt_array

string

Shift + Return to add a new line

wake up in the bed
have breakfast
is on the road, go to company
work in the company
Take a walk next to the company at noon
lying in bed at nightwake up in the bed
have breakfast
is on the road, go to company
work in the company
Take a walk next to the company at noon
lying in bed at night

Comic Description (each line corresponds to a frame).

Default: "wake up in the bed\nhave breakfast\nis on the road, go to company\nwork in the company\nTake a walk next to the company at noon\nlying in bed at night"

Ip_Adapter_Strength

number

Ip Adapter Strength

Default: 0.5

sa32_

number

The degree of Paired Attention at 32 x 32 self-attention layers

Default: 0.5

sa64_

number

The degree of Paired Attention at 64 x 64 self-attention layers

Default: 0.5

id_length_

integer

Number of id images in total images

Default: 3

seed_

integer

Seed

Default: 1

num_steps

integer

Number of sample steps

Default: 50

G_height

integer

Height

Default: 768

G_width

integer

Width

Default: 768

comic_type

string

Typesetting Style

Default: "Classic Comic Style"

guidance_scale

integer

Guidance scale

Default: 5

Run this model in Node.js with one line of code:

npx create-replicate --model=camenduru/story-diffusion

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run camenduru/story-diffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "camenduru/story-diffusion:a43c7e0e4bce75ee98445b20b244240d1109e30a46bf7719958fd0a69ab29e8e",
  {
    input: {
      sa32_: 0.5,
      sa64_: 0.5,
      seed_: 1,
      style: "Japanese Anime",
      G_width: 768,
      G_height: 768,
      num_steps: 50,
      comic_type: "Classic Comic Style",
      id_length_: 3,
      model_type: "Using Ref Images",
      input_image: "https://replicate.delivery/pbxt/KqySXsVmWku71q5LZeNjgasK4oVRILdFPt9dKKCEYG5ZFVko/1%20%281%29.jpeg",
      prompt_array: "wake up in the bed\nhave breakfast\nis on the road, go to company\nwork in the company\nTake a walk next to the company at noon\nlying in bed at night",
      general_prompt: "a woman img, wearing a white T-shirt, blue loose hair",
      guidance_scale: 5,
      negative_prompt: "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
      Ip_Adapter_Strength: 0.5,
      style_strength_ratio: 20
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run camenduru/story-diffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "camenduru/story-diffusion:a43c7e0e4bce75ee98445b20b244240d1109e30a46bf7719958fd0a69ab29e8e",
    input={
        "sa32_": 0.5,
        "sa64_": 0.5,
        "seed_": 1,
        "style": "Japanese Anime",
        "G_width": 768,
        "G_height": 768,
        "num_steps": 50,
        "comic_type": "Classic Comic Style",
        "id_length_": 3,
        "model_type": "Using Ref Images",
        "input_image": "https://replicate.delivery/pbxt/KqySXsVmWku71q5LZeNjgasK4oVRILdFPt9dKKCEYG5ZFVko/1%20%281%29.jpeg",
        "prompt_array": "wake up in the bed\nhave breakfast\nis on the road, go to company\nwork in the company\nTake a walk next to the company at noon\nlying in bed at night",
        "general_prompt": "a woman img, wearing a white T-shirt, blue loose hair",
        "guidance_scale": 5,
        "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
        "Ip_Adapter_Strength": 0.5,
        "style_strength_ratio": 20
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run camenduru/story-diffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "a43c7e0e4bce75ee98445b20b244240d1109e30a46bf7719958fd0a69ab29e8e",
    "input": {
      "sa32_": 0.5,
      "sa64_": 0.5,
      "seed_": 1,
      "style": "Japanese Anime",
      "G_width": 768,
      "G_height": 768,
      "num_steps": 50,
      "comic_type": "Classic Comic Style",
      "id_length_": 3,
      "model_type": "Using Ref Images",
      "input_image": "https://replicate.delivery/pbxt/KqySXsVmWku71q5LZeNjgasK4oVRILdFPt9dKKCEYG5ZFVko/1%20%281%29.jpeg",
      "prompt_array": "wake up in the bed\\nhave breakfast\\nis on the road, go to company\\nwork in the company\\nTake a walk next to the company at noon\\nlying in bed at night",
      "general_prompt": "a woman img, wearing a white T-shirt, blue loose hair",
      "guidance_scale": 5,
      "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
      "Ip_Adapter_Strength": 0.5,
      "style_strength_ratio": 20
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

{
  "completed_at": "2024-05-03T08:09:10.148381Z",
  "created_at": "2024-05-03T08:03:04.293000Z",
  "data_removed": false,
  "error": null,
  "id": "39nmmv3bwnrgm0cf7nxagt736m",
  "input": {
    "sa32_": 0.5,
    "sa64_": 0.5,
    "seed_": 1,
    "style": "Japanese Anime",
    "G_width": 768,
    "sd_type": "Unstable",
    "G_height": 768,
    "num_steps": 50,
    "comic_type": "Classic Comic Style",
    "id_length_": 3,
    "model_type": "Using Ref Images",
    "input_image": "https://replicate.delivery/pbxt/KqySXsVmWku71q5LZeNjgasK4oVRILdFPt9dKKCEYG5ZFVko/1%20%281%29.jpeg",
    "prompt_array": "wake up in the bed\nhave breakfast\nis on the road, go to company\nwork in the company\nTake a walk next to the company at noon\nlying in bed at night",
    "general_prompt": "a woman img, wearing a white T-shirt, blue loose hair",
    "guidance_scale": 5,
    "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
    "Ip_Adapter_Strength": 0.5,
    "style_strength_ratio": 20
  },
  "logs": "successsfully load paired self-attention\nnumber of the processor : 36\n/content/StoryDiffusion-hf/examples/taylor/1.jpeg\nstart_merge_step:10\n['a woman img, wearing a white T-shirt, blue loose hair,wake up in the bed', 'a woman img, wearing a white T-shirt, blue loose hair,have breakfast', 'a woman img, wearing a white T-shirt, blue loose hair,is on the road, go to company', 'a woman img, wearing a white T-shirt, blue loose hair,work in the company', 'a woman img, wearing a white T-shirt, blue loose hair,Take a walk next to the company at noon', 'a woman img, wearing a white T-shirt, blue loose hair,lying in bed at night']\nanime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, wake up in the bed. created by japanese anime studio. highly emotional. best quality, high resolution\nanime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, have breakfast. created by japanese anime studio. highly emotional. best quality, high resolution\nanime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, is on the road, go to company. created by japanese anime studio. highly emotional. best quality, high resolution\ntorch.Size([3, 77, 2048])\ntorch.Size([3, 77, 2048])\ntorch.Size([3, 77, 2048])\ntorch.Size([3, 1280])\ntorch.Size([3, 1280])\ntorch.Size([3, 1280])\ntorch.Size([3, 4, 96, 96])\ntorch.Size([6, 6])\n  0%|          | 0/50 [00:00<?, ?it/s]\n  2%|▏         | 1/50 [00:00<00:32,  1.51it/s]\n  4%|▍         | 2/50 [00:00<00:22,  2.17it/s]\n  6%|▌         | 3/50 [00:01<00:18,  2.48it/s]\n  8%|▊         | 4/50 [00:01<00:17,  2.58it/s]\n 10%|█         | 5/50 [00:02<00:17,  2.65it/s]\n 12%|█▏        | 6/50 [00:02<00:16,  2.70it/s]\n 14%|█▍        | 7/50 [00:02<00:15,  2.74it/s]\n 16%|█▌        | 8/50 [00:03<00:15,  2.73it/s]\n 18%|█▊        | 9/50 [00:03<00:14,  2.77it/s]\n 20%|██        | 10/50 [00:03<00:14,  2.79it/s]\n 22%|██▏       | 11/50 [00:04<00:13,  2.82it/s]\n 24%|██▍       | 12/50 [00:04<00:13,  2.82it/s]\n 26%|██▌       | 13/50 [00:04<00:13,  2.81it/s]\n 28%|██▊       | 14/50 [00:05<00:12,  2.79it/s]\n 30%|███       | 15/50 [00:05<00:12,  2.82it/s]\n 32%|███▏      | 16/50 [00:05<00:12,  2.79it/s]\n 34%|███▍      | 17/50 [00:06<00:11,  2.76it/s]\n 36%|███▌      | 18/50 [00:06<00:11,  2.73it/s]\n 38%|███▊      | 19/50 [00:07<00:11,  2.75it/s]\n 40%|████      | 20/50 [00:07<00:10,  2.76it/s]\n 42%|████▏     | 21/50 [00:07<00:10,  2.76it/s]\n 44%|████▍     | 22/50 [00:08<00:10,  2.74it/s]\n 46%|████▌     | 23/50 [00:08<00:09,  2.72it/s]\n 48%|████▊     | 24/50 [00:08<00:09,  2.71it/s]\n 50%|█████     | 25/50 [00:09<00:09,  2.72it/s]\n 52%|█████▏    | 26/50 [00:09<00:08,  2.72it/s]\n 54%|█████▍    | 27/50 [00:10<00:08,  2.70it/s]\n 56%|█████▌    | 28/50 [00:10<00:08,  2.70it/s]\n 58%|█████▊    | 29/50 [00:10<00:07,  2.69it/s]\n 60%|██████    | 30/50 [00:11<00:07,  2.68it/s]\n 62%|██████▏   | 31/50 [00:11<00:07,  2.68it/s]\n 64%|██████▍   | 32/50 [00:11<00:06,  2.68it/s]\n 66%|██████▌   | 33/50 [00:12<00:06,  2.68it/s]\n 68%|██████▊   | 34/50 [00:12<00:05,  2.69it/s]\n 70%|███████   | 35/50 [00:12<00:05,  2.68it/s]\n 72%|███████▏  | 36/50 [00:13<00:05,  2.69it/s]\n 74%|███████▍  | 37/50 [00:13<00:04,  2.69it/s]\n 76%|███████▌  | 38/50 [00:14<00:04,  2.69it/s]\n 78%|███████▊  | 39/50 [00:14<00:04,  2.69it/s]\n 80%|████████  | 40/50 [00:14<00:03,  2.69it/s]\n 82%|████████▏ | 41/50 [00:15<00:03,  2.70it/s]\n 84%|████████▍ | 42/50 [00:15<00:02,  2.70it/s]\n 86%|████████▌ | 43/50 [00:15<00:02,  2.69it/s]\n 88%|████████▊ | 44/50 [00:16<00:02,  2.70it/s]\n 90%|█████████ | 45/50 [00:16<00:01,  2.72it/s]\n 92%|█████████▏| 46/50 [00:17<00:01,  2.71it/s]\n 94%|█████████▍| 47/50 [00:17<00:01,  2.72it/s]\n 96%|█████████▌| 48/50 [00:17<00:00,  2.73it/s]\n 98%|█████████▊| 49/50 [00:18<00:00,  2.76it/s]\n100%|██████████| 50/50 [00:18<00:00,  2.74it/s]\n100%|██████████| 50/50 [00:18<00:00,  2.70it/s]\nanime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, work in the company. created by japanese anime studio. highly emotional. best quality, high resolution\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 1280])\ntorch.Size([1, 1280])\ntorch.Size([1, 1280])\ntorch.Size([1, 4, 96, 96])\ntorch.Size([2, 6])\n  0%|          | 0/50 [00:00<?, ?it/s]\n  2%|▏         | 1/50 [00:00<00:09,  5.08it/s]\n  4%|▍         | 2/50 [00:00<00:07,  6.27it/s]\n  6%|▌         | 3/50 [00:00<00:07,  6.49it/s]\n  8%|▊         | 4/50 [00:00<00:07,  6.35it/s]\n 10%|█         | 5/50 [00:00<00:07,  6.28it/s]\n 12%|█▏        | 6/50 [00:00<00:06,  6.33it/s]\n 14%|█▍        | 7/50 [00:01<00:06,  6.34it/s]\n 16%|█▌        | 8/50 [00:01<00:06,  6.28it/s]\n 18%|█▊        | 9/50 [00:01<00:06,  6.31it/s]\n 20%|██        | 10/50 [00:01<00:06,  6.37it/s]\n 22%|██▏       | 11/50 [00:01<00:06,  6.41it/s]\n 24%|██▍       | 12/50 [00:01<00:05,  6.39it/s]\n 26%|██▌       | 13/50 [00:02<00:05,  6.35it/s]\n 28%|██▊       | 14/50 [00:02<00:05,  6.30it/s]\n 30%|███       | 15/50 [00:02<00:05,  6.38it/s]\n 32%|███▏      | 16/50 [00:02<00:05,  6.31it/s]\n 34%|███▍      | 17/50 [00:02<00:05,  6.21it/s]\n 36%|███▌      | 18/50 [00:02<00:05,  6.14it/s]\n 38%|███▊      | 19/50 [00:03<00:04,  6.21it/s]\n 40%|████      | 20/50 [00:03<00:04,  6.25it/s]\n 42%|████▏     | 21/50 [00:03<00:04,  6.23it/s]\n 44%|████▍     | 22/50 [00:03<00:04,  6.17it/s]\n 46%|████▌     | 23/50 [00:03<00:04,  6.13it/s]\n 48%|████▊     | 24/50 [00:03<00:04,  6.11it/s]\n 50%|█████     | 25/50 [00:04<00:04,  6.10it/s]\n 52%|█████▏    | 26/50 [00:04<00:03,  6.10it/s]\n 54%|█████▍    | 27/50 [00:04<00:03,  6.05it/s]\n 56%|█████▌    | 28/50 [00:04<00:03,  6.04it/s]\n 58%|█████▊    | 29/50 [00:04<00:03,  6.01it/s]\n 60%|██████    | 30/50 [00:04<00:03,  5.97it/s]\n 62%|██████▏   | 31/50 [00:05<00:03,  5.95it/s]\n 64%|██████▍   | 32/50 [00:05<00:03,  5.97it/s]\n 66%|██████▌   | 33/50 [00:05<00:02,  5.99it/s]\n 68%|██████▊   | 34/50 [00:05<00:02,  5.97it/s]\n 70%|███████   | 35/50 [00:05<00:02,  5.98it/s]\n 72%|███████▏  | 36/50 [00:05<00:02,  5.99it/s]\n 74%|███████▍  | 37/50 [00:06<00:02,  5.97it/s]\n 76%|███████▌  | 38/50 [00:06<00:02,  5.95it/s]\n 78%|███████▊  | 39/50 [00:06<00:01,  5.99it/s]\n 80%|████████  | 40/50 [00:06<00:01,  5.99it/s]\n 82%|████████▏ | 41/50 [00:06<00:01,  6.03it/s]\n 84%|████████▍ | 42/50 [00:06<00:01,  6.02it/s]\n 86%|████████▌ | 43/50 [00:07<00:01,  6.01it/s]\n 88%|████████▊ | 44/50 [00:07<00:00,  6.05it/s]\n 90%|█████████ | 45/50 [00:07<00:00,  6.11it/s]\n 92%|█████████▏| 46/50 [00:07<00:00,  6.08it/s]\n 94%|█████████▍| 47/50 [00:07<00:00,  6.07it/s]\n 96%|█████████▌| 48/50 [00:07<00:00,  6.10it/s]\n 98%|█████████▊| 49/50 [00:07<00:00,  6.18it/s]\n100%|██████████| 50/50 [00:08<00:00,  6.15it/s]\n100%|██████████| 50/50 [00:08<00:00,  6.13it/s]\nanime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, take a walk next to the company at noon. created by japanese anime studio. highly emotional. best quality, high resolution\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 1280])\ntorch.Size([1, 1280])\ntorch.Size([1, 1280])\ntorch.Size([1, 4, 96, 96])\ntorch.Size([2, 6])\n  0%|          | 0/50 [00:00<?, ?it/s]\n  2%|▏         | 1/50 [00:00<00:06,  7.32it/s]\n  4%|▍         | 2/50 [00:00<00:06,  7.42it/s]\n  6%|▌         | 3/50 [00:00<00:06,  7.11it/s]\n  8%|▊         | 4/50 [00:00<00:06,  6.69it/s]\n 10%|█         | 5/50 [00:00<00:06,  6.50it/s]\n 12%|█▏        | 6/50 [00:00<00:06,  6.49it/s]\n 14%|█▍        | 7/50 [00:01<00:06,  6.45it/s]\n 16%|█▌        | 8/50 [00:01<00:06,  6.35it/s]\n 18%|█▊        | 9/50 [00:01<00:06,  6.38it/s]\n 20%|██        | 10/50 [00:01<00:06,  6.42it/s]\n 22%|██▏       | 11/50 [00:01<00:06,  6.44it/s]\n 24%|██▍       | 12/50 [00:01<00:05,  6.42it/s]\n 26%|██▌       | 13/50 [00:01<00:05,  6.38it/s]\n 28%|██▊       | 14/50 [00:02<00:05,  6.32it/s]\n 30%|███       | 15/50 [00:02<00:05,  6.40it/s]\n 32%|███▏      | 16/50 [00:02<00:05,  6.33it/s]\n 34%|███▍      | 17/50 [00:02<00:05,  6.24it/s]\n 36%|███▌      | 18/50 [00:02<00:05,  6.17it/s]\n 38%|███▊      | 19/50 [00:02<00:04,  6.21it/s]\n 40%|████      | 20/50 [00:03<00:04,  6.25it/s]\n 42%|████▏     | 21/50 [00:03<00:04,  6.23it/s]\n 44%|████▍     | 22/50 [00:03<00:04,  6.14it/s]\n 46%|████▌     | 23/50 [00:03<00:04,  6.09it/s]\n 48%|████▊     | 24/50 [00:03<00:04,  6.09it/s]\n 50%|█████     | 25/50 [00:03<00:04,  6.08it/s]\n 52%|█████▏    | 26/50 [00:04<00:03,  6.08it/s]\n 54%|█████▍    | 27/50 [00:04<00:03,  6.04it/s]\n 56%|█████▌    | 28/50 [00:04<00:03,  6.01it/s]\n 58%|█████▊    | 29/50 [00:04<00:03,  5.99it/s]\n 60%|██████    | 30/50 [00:04<00:03,  5.98it/s]\n 62%|██████▏   | 31/50 [00:04<00:03,  5.96it/s]\n 64%|██████▍   | 32/50 [00:05<00:03,  6.00it/s]\n 66%|██████▌   | 33/50 [00:05<00:02,  6.01it/s]\n 68%|██████▊   | 34/50 [00:05<00:02,  5.99it/s]\n 70%|███████   | 35/50 [00:05<00:02,  5.98it/s]\n 72%|███████▏  | 36/50 [00:05<00:02,  6.01it/s]\n 74%|███████▍  | 37/50 [00:05<00:02,  6.00it/s]\n 76%|███████▌  | 38/50 [00:06<00:02,  5.98it/s]\n 78%|███████▊  | 39/50 [00:06<00:01,  6.00it/s]\n 80%|████████  | 40/50 [00:06<00:01,  5.96it/s]\n 82%|████████▏ | 41/50 [00:06<00:01,  5.99it/s]\n 84%|████████▍ | 42/50 [00:06<00:01,  5.98it/s]\n 86%|████████▌ | 43/50 [00:06<00:01,  5.97it/s]\n 88%|████████▊ | 44/50 [00:07<00:01,  5.96it/s]\n 90%|█████████ | 45/50 [00:07<00:00,  6.04it/s]\n 92%|█████████▏| 46/50 [00:07<00:00,  5.99it/s]\n 94%|█████████▍| 47/50 [00:07<00:00,  6.01it/s]\n 96%|█████████▌| 48/50 [00:07<00:00,  6.05it/s]\n 98%|█████████▊| 49/50 [00:07<00:00,  6.13it/s]\n100%|██████████| 50/50 [00:08<00:00,  6.07it/s]\n100%|██████████| 50/50 [00:08<00:00,  6.17it/s]\nanime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, lying in bed at night. created by japanese anime studio. highly emotional. best quality, high resolution\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 77, 2048])\ntorch.Size([1, 1280])\ntorch.Size([1, 1280])\ntorch.Size([1, 1280])\ntorch.Size([1, 4, 96, 96])\ntorch.Size([2, 6])\n  0%|          | 0/50 [00:00<?, ?it/s]\n  2%|▏         | 1/50 [00:00<00:06,  7.37it/s]\n  4%|▍         | 2/50 [00:00<00:06,  7.43it/s]\n  6%|▌         | 3/50 [00:00<00:06,  7.08it/s]\n  8%|▊         | 4/50 [00:00<00:07,  6.56it/s]\n 10%|█         | 5/50 [00:00<00:07,  6.36it/s]\n 12%|█▏        | 6/50 [00:00<00:06,  6.37it/s]\n 14%|█▍        | 7/50 [00:01<00:06,  6.34it/s]\n 16%|█▌        | 8/50 [00:01<00:06,  6.24it/s]\n 18%|█▊        | 9/50 [00:01<00:06,  6.29it/s]\n 20%|██        | 10/50 [00:01<00:06,  6.34it/s]\n 22%|██▏       | 11/50 [00:01<00:06,  6.38it/s]\n 24%|██▍       | 12/50 [00:01<00:05,  6.36it/s]\n 26%|██▌       | 13/50 [00:02<00:05,  6.32it/s]\n 28%|██▊       | 14/50 [00:02<00:05,  6.27it/s]\n 30%|███       | 15/50 [00:02<00:05,  6.35it/s]\n 32%|███▏      | 16/50 [00:02<00:05,  6.31it/s]\n 34%|███▍      | 17/50 [00:02<00:05,  6.22it/s]\n 36%|███▌      | 18/50 [00:02<00:05,  6.14it/s]\n 38%|███▊      | 19/50 [00:02<00:05,  6.20it/s]\n 40%|████      | 20/50 [00:03<00:04,  6.23it/s]\n 42%|████▏     | 21/50 [00:03<00:04,  6.19it/s]\n 44%|████▍     | 22/50 [00:03<00:04,  6.13it/s]\n 46%|████▌     | 23/50 [00:03<00:04,  6.10it/s]\n 48%|████▊     | 24/50 [00:03<00:04,  6.07it/s]\n 50%|█████     | 25/50 [00:03<00:04,  6.07it/s]\n 52%|█████▏    | 26/50 [00:04<00:03,  6.06it/s]\n 54%|█████▍    | 27/50 [00:04<00:03,  5.99it/s]\n 56%|█████▌    | 28/50 [00:04<00:03,  5.99it/s]\n 58%|█████▊    | 29/50 [00:04<00:03,  5.98it/s]\n 60%|██████    | 30/50 [00:04<00:03,  5.95it/s]\n 62%|██████▏   | 31/50 [00:04<00:03,  5.94it/s]\n 64%|██████▍   | 32/50 [00:05<00:03,  5.97it/s]\n 66%|██████▌   | 33/50 [00:05<00:02,  5.97it/s]\n 68%|██████▊   | 34/50 [00:05<00:02,  5.98it/s]\n 70%|███████   | 35/50 [00:05<00:02,  5.97it/s]\n 72%|███████▏  | 36/50 [00:05<00:02,  5.99it/s]\n 74%|███████▍  | 37/50 [00:05<00:02,  5.98it/s]\n 76%|███████▌  | 38/50 [00:06<00:02,  5.95it/s]\n 78%|███████▊  | 39/50 [00:06<00:01,  5.96it/s]\n 80%|████████  | 40/50 [00:06<00:01,  5.93it/s]\n 82%|████████▏ | 41/50 [00:06<00:01,  5.97it/s]\n 84%|████████▍ | 42/50 [00:06<00:01,  5.94it/s]\n 86%|████████▌ | 43/50 [00:07<00:01,  5.88it/s]\n 88%|████████▊ | 44/50 [00:07<00:01,  5.92it/s]\n 90%|█████████ | 45/50 [00:07<00:00,  5.99it/s]\n 92%|█████████▏| 46/50 [00:07<00:00,  5.97it/s]\n 94%|█████████▍| 47/50 [00:07<00:00,  6.00it/s]\n 96%|█████████▌| 48/50 [00:07<00:00,  6.03it/s]\n 98%|█████████▊| 49/50 [00:07<00:00,  6.10it/s]\n100%|██████████| 50/50 [00:08<00:00,  6.07it/s]\n100%|██████████| 50/50 [00:08<00:00,  6.13it/s]\n2 [[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAB60>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAF50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAA70>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CBC40>]]\n-2 [[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAB60>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAF50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAA70>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CBC40>], [<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CACE0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAD10>]]\n[[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAB60>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAF50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAA70>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CBC40>], [<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CACE0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAD10>, <PIL.Image.Image image mode=RGBA size=788x788 at 0x7F59B44CAC50>, <PIL.Image.Image image mode=RGBA size=788x788 at 0x7F59B44CAC50>]]\n0 (214, 718)\n0 (201, 717)\n0 (1, 717)\nPipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.\nPipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.\nPipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.\nsuccesssfully load paired self-attention\nnumber of the processor : 36",
  "metrics": {
    "predict_time": 56.055645,
    "total_time": 365.855381
  },
  "output": [
    "https://replicate.delivery/pbxt/FgRjVhsguuJFFdVKSATMWmUGIfeYfH8qsiPFaLHpGpoFtJhlA/unique_0.png",
    "https://replicate.delivery/pbxt/PZhHvaxkiNYcOVdB1UusmZ5NaEuAn3HerxhNYbf8LZwj2kwSA/unique_1.png",
    "https://replicate.delivery/pbxt/nqS4wo9eYSS0GiG0Bqwx6dqQahPaQhYp9ATZE7kefveRaTCLB/unique_2.png",
    "https://replicate.delivery/pbxt/EhKTiR4sHIqyJN5S9qUFV8Zlkr72w8nZRDCirNehINNSbSYJA/unique_3.png",
    "https://replicate.delivery/pbxt/lmN72ZeIX80qWCz5CQqwPzQTI6Lct5TzXAkXpkeGjn2k2kwSA/unique_4.png",
    "https://replicate.delivery/pbxt/BkAuSm0Sf6Ufn0i0SuvJf4dHZssb37G7Yuz9ZNjgmgXKtJhlA/unique_5.png",
    "https://replicate.delivery/pbxt/raoJfvqCTCSISKBmmmTew4ClZnatGXlmeQqROfQq8n3WaTCLB/unique_6.png"
  ],
  "started_at": "2024-05-03T08:08:14.092736Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/39nmmv3bwnrgm0cf7nxagt736m",
    "cancel": "https://api.replicate.com/v1/predictions/39nmmv3bwnrgm0cf7nxagt736m/cancel"
  },
  "version": "d9d04c7db3887b916be25d671fa49d0f4455074c75187d5667ae4df0301491de"
}

Generated in

56.1 seconds

Tweak it ShareReport

successsfully load paired self-attention
number of the processor : 36
/content/StoryDiffusion-hf/examples/taylor/1.jpeg
start_merge_step:10
['a woman img, wearing a white T-shirt, blue loose hair,wake up in the bed', 'a woman img, wearing a white T-shirt, blue loose hair,have breakfast', 'a woman img, wearing a white T-shirt, blue loose hair,is on the road, go to company', 'a woman img, wearing a white T-shirt, blue loose hair,work in the company', 'a woman img, wearing a white T-shirt, blue loose hair,Take a walk next to the company at noon', 'a woman img, wearing a white T-shirt, blue loose hair,lying in bed at night']
anime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, wake up in the bed. created by japanese anime studio. highly emotional. best quality, high resolution
anime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, have breakfast. created by japanese anime studio. highly emotional. best quality, high resolution
anime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, is on the road, go to company. created by japanese anime studio. highly emotional. best quality, high resolution
torch.Size([3, 77, 2048])
torch.Size([3, 77, 2048])
torch.Size([3, 77, 2048])
torch.Size([3, 1280])
torch.Size([3, 1280])
torch.Size([3, 1280])
torch.Size([3, 4, 96, 96])
torch.Size([6, 6])
  0%|          | 0/50 [00:00<?, ?it/s]
  2%|▏         | 1/50 [00:00<00:32,  1.51it/s]
  4%|▍         | 2/50 [00:00<00:22,  2.17it/s]
  6%|▌         | 3/50 [00:01<00:18,  2.48it/s]
  8%|▊         | 4/50 [00:01<00:17,  2.58it/s]
 10%|█         | 5/50 [00:02<00:17,  2.65it/s]
 12%|█▏        | 6/50 [00:02<00:16,  2.70it/s]
 14%|█▍        | 7/50 [00:02<00:15,  2.74it/s]
 16%|█▌        | 8/50 [00:03<00:15,  2.73it/s]
 18%|█▊        | 9/50 [00:03<00:14,  2.77it/s]
 20%|██        | 10/50 [00:03<00:14,  2.79it/s]
 22%|██▏       | 11/50 [00:04<00:13,  2.82it/s]
 24%|██▍       | 12/50 [00:04<00:13,  2.82it/s]
 26%|██▌       | 13/50 [00:04<00:13,  2.81it/s]
 28%|██▊       | 14/50 [00:05<00:12,  2.79it/s]
 30%|███       | 15/50 [00:05<00:12,  2.82it/s]
 32%|███▏      | 16/50 [00:05<00:12,  2.79it/s]
 34%|███▍      | 17/50 [00:06<00:11,  2.76it/s]
 36%|███▌      | 18/50 [00:06<00:11,  2.73it/s]
 38%|███▊      | 19/50 [00:07<00:11,  2.75it/s]
 40%|████      | 20/50 [00:07<00:10,  2.76it/s]
 42%|████▏     | 21/50 [00:07<00:10,  2.76it/s]
 44%|████▍     | 22/50 [00:08<00:10,  2.74it/s]
 46%|████▌     | 23/50 [00:08<00:09,  2.72it/s]
 48%|████▊     | 24/50 [00:08<00:09,  2.71it/s]
 50%|█████     | 25/50 [00:09<00:09,  2.72it/s]
 52%|█████▏    | 26/50 [00:09<00:08,  2.72it/s]
 54%|█████▍    | 27/50 [00:10<00:08,  2.70it/s]
 56%|█████▌    | 28/50 [00:10<00:08,  2.70it/s]
 58%|█████▊    | 29/50 [00:10<00:07,  2.69it/s]
 60%|██████    | 30/50 [00:11<00:07,  2.68it/s]
 62%|██████▏   | 31/50 [00:11<00:07,  2.68it/s]
 64%|██████▍   | 32/50 [00:11<00:06,  2.68it/s]
 66%|██████▌   | 33/50 [00:12<00:06,  2.68it/s]
 68%|██████▊   | 34/50 [00:12<00:05,  2.69it/s]
 70%|███████   | 35/50 [00:12<00:05,  2.68it/s]
 72%|███████▏  | 36/50 [00:13<00:05,  2.69it/s]
 74%|███████▍  | 37/50 [00:13<00:04,  2.69it/s]
 76%|███████▌  | 38/50 [00:14<00:04,  2.69it/s]
 78%|███████▊  | 39/50 [00:14<00:04,  2.69it/s]
 80%|████████  | 40/50 [00:14<00:03,  2.69it/s]
 82%|████████▏ | 41/50 [00:15<00:03,  2.70it/s]
 84%|████████▍ | 42/50 [00:15<00:02,  2.70it/s]
 86%|████████▌ | 43/50 [00:15<00:02,  2.69it/s]
 88%|████████▊ | 44/50 [00:16<00:02,  2.70it/s]
 90%|█████████ | 45/50 [00:16<00:01,  2.72it/s]
 92%|█████████▏| 46/50 [00:17<00:01,  2.71it/s]
 94%|█████████▍| 47/50 [00:17<00:01,  2.72it/s]
 96%|█████████▌| 48/50 [00:17<00:00,  2.73it/s]
 98%|█████████▊| 49/50 [00:18<00:00,  2.76it/s]
100%|██████████| 50/50 [00:18<00:00,  2.74it/s]
100%|██████████| 50/50 [00:18<00:00,  2.70it/s]
anime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, work in the company. created by japanese anime studio. highly emotional. best quality, high resolution
torch.Size([1, 77, 2048])
torch.Size([1, 77, 2048])
torch.Size([1, 77, 2048])
torch.Size([1, 1280])
torch.Size([1, 1280])
torch.Size([1, 1280])
torch.Size([1, 4, 96, 96])
torch.Size([2, 6])
  0%|          | 0/50 [00:00<?, ?it/s]
  2%|▏         | 1/50 [00:00<00:09,  5.08it/s]
  4%|▍         | 2/50 [00:00<00:07,  6.27it/s]
  6%|▌         | 3/50 [00:00<00:07,  6.49it/s]
  8%|▊         | 4/50 [00:00<00:07,  6.35it/s]
 10%|█         | 5/50 [00:00<00:07,  6.28it/s]
 12%|█▏        | 6/50 [00:00<00:06,  6.33it/s]
 14%|█▍        | 7/50 [00:01<00:06,  6.34it/s]
 16%|█▌        | 8/50 [00:01<00:06,  6.28it/s]
 18%|█▊        | 9/50 [00:01<00:06,  6.31it/s]
 20%|██        | 10/50 [00:01<00:06,  6.37it/s]
 22%|██▏       | 11/50 [00:01<00:06,  6.41it/s]
 24%|██▍       | 12/50 [00:01<00:05,  6.39it/s]
 26%|██▌       | 13/50 [00:02<00:05,  6.35it/s]
 28%|██▊       | 14/50 [00:02<00:05,  6.30it/s]
 30%|███       | 15/50 [00:02<00:05,  6.38it/s]
 32%|███▏      | 16/50 [00:02<00:05,  6.31it/s]
 34%|███▍      | 17/50 [00:02<00:05,  6.21it/s]
 36%|███▌      | 18/50 [00:02<00:05,  6.14it/s]
 38%|███▊      | 19/50 [00:03<00:04,  6.21it/s]
 40%|████      | 20/50 [00:03<00:04,  6.25it/s]
 42%|████▏     | 21/50 [00:03<00:04,  6.23it/s]
 44%|████▍     | 22/50 [00:03<00:04,  6.17it/s]
 46%|████▌     | 23/50 [00:03<00:04,  6.13it/s]
 48%|████▊     | 24/50 [00:03<00:04,  6.11it/s]
 50%|█████     | 25/50 [00:04<00:04,  6.10it/s]
 52%|█████▏    | 26/50 [00:04<00:03,  6.10it/s]
 54%|█████▍    | 27/50 [00:04<00:03,  6.05it/s]
 56%|█████▌    | 28/50 [00:04<00:03,  6.04it/s]
 58%|█████▊    | 29/50 [00:04<00:03,  6.01it/s]
 60%|██████    | 30/50 [00:04<00:03,  5.97it/s]
 62%|██████▏   | 31/50 [00:05<00:03,  5.95it/s]
 64%|██████▍   | 32/50 [00:05<00:03,  5.97it/s]
 66%|██████▌   | 33/50 [00:05<00:02,  5.99it/s]
 68%|██████▊   | 34/50 [00:05<00:02,  5.97it/s]
 70%|███████   | 35/50 [00:05<00:02,  5.98it/s]
 72%|███████▏  | 36/50 [00:05<00:02,  5.99it/s]
 74%|███████▍  | 37/50 [00:06<00:02,  5.97it/s]
 76%|███████▌  | 38/50 [00:06<00:02,  5.95it/s]
 78%|███████▊  | 39/50 [00:06<00:01,  5.99it/s]
 80%|████████  | 40/50 [00:06<00:01,  5.99it/s]
 82%|████████▏ | 41/50 [00:06<00:01,  6.03it/s]
 84%|████████▍ | 42/50 [00:06<00:01,  6.02it/s]
 86%|████████▌ | 43/50 [00:07<00:01,  6.01it/s]
 88%|████████▊ | 44/50 [00:07<00:00,  6.05it/s]
 90%|█████████ | 45/50 [00:07<00:00,  6.11it/s]
 92%|█████████▏| 46/50 [00:07<00:00,  6.08it/s]
 94%|█████████▍| 47/50 [00:07<00:00,  6.07it/s]
 96%|█████████▌| 48/50 [00:07<00:00,  6.10it/s]
 98%|█████████▊| 49/50 [00:07<00:00,  6.18it/s]
100%|██████████| 50/50 [00:08<00:00,  6.15it/s]
100%|██████████| 50/50 [00:08<00:00,  6.13it/s]
anime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, take a walk next to the company at noon. created by japanese anime studio. highly emotional. best quality, high resolution
torch.Size([1, 77, 2048])
torch.Size([1, 77, 2048])
torch.Size([1, 77, 2048])
torch.Size([1, 1280])
torch.Size([1, 1280])
torch.Size([1, 1280])
torch.Size([1, 4, 96, 96])
torch.Size([2, 6])
  0%|          | 0/50 [00:00<?, ?it/s]
  2%|▏         | 1/50 [00:00<00:06,  7.32it/s]
  4%|▍         | 2/50 [00:00<00:06,  7.42it/s]
  6%|▌         | 3/50 [00:00<00:06,  7.11it/s]
  8%|▊         | 4/50 [00:00<00:06,  6.69it/s]
 10%|█         | 5/50 [00:00<00:06,  6.50it/s]
 12%|█▏        | 6/50 [00:00<00:06,  6.49it/s]
 14%|█▍        | 7/50 [00:01<00:06,  6.45it/s]
 16%|█▌        | 8/50 [00:01<00:06,  6.35it/s]
 18%|█▊        | 9/50 [00:01<00:06,  6.38it/s]
 20%|██        | 10/50 [00:01<00:06,  6.42it/s]
 22%|██▏       | 11/50 [00:01<00:06,  6.44it/s]
 24%|██▍       | 12/50 [00:01<00:05,  6.42it/s]
 26%|██▌       | 13/50 [00:01<00:05,  6.38it/s]
 28%|██▊       | 14/50 [00:02<00:05,  6.32it/s]
 30%|███       | 15/50 [00:02<00:05,  6.40it/s]
 32%|███▏      | 16/50 [00:02<00:05,  6.33it/s]
 34%|███▍      | 17/50 [00:02<00:05,  6.24it/s]
 36%|███▌      | 18/50 [00:02<00:05,  6.17it/s]
 38%|███▊      | 19/50 [00:02<00:04,  6.21it/s]
 40%|████      | 20/50 [00:03<00:04,  6.25it/s]
 42%|████▏     | 21/50 [00:03<00:04,  6.23it/s]
 44%|████▍     | 22/50 [00:03<00:04,  6.14it/s]
 46%|████▌     | 23/50 [00:03<00:04,  6.09it/s]
 48%|████▊     | 24/50 [00:03<00:04,  6.09it/s]
 50%|█████     | 25/50 [00:03<00:04,  6.08it/s]
 52%|█████▏    | 26/50 [00:04<00:03,  6.08it/s]
 54%|█████▍    | 27/50 [00:04<00:03,  6.04it/s]
 56%|█████▌    | 28/50 [00:04<00:03,  6.01it/s]
 58%|█████▊    | 29/50 [00:04<00:03,  5.99it/s]
 60%|██████    | 30/50 [00:04<00:03,  5.98it/s]
 62%|██████▏   | 31/50 [00:04<00:03,  5.96it/s]
 64%|██████▍   | 32/50 [00:05<00:03,  6.00it/s]
 66%|██████▌   | 33/50 [00:05<00:02,  6.01it/s]
 68%|██████▊   | 34/50 [00:05<00:02,  5.99it/s]
 70%|███████   | 35/50 [00:05<00:02,  5.98it/s]
 72%|███████▏  | 36/50 [00:05<00:02,  6.01it/s]
 74%|███████▍  | 37/50 [00:05<00:02,  6.00it/s]
 76%|███████▌  | 38/50 [00:06<00:02,  5.98it/s]
 78%|███████▊  | 39/50 [00:06<00:01,  6.00it/s]
 80%|████████  | 40/50 [00:06<00:01,  5.96it/s]
 82%|████████▏ | 41/50 [00:06<00:01,  5.99it/s]
 84%|████████▍ | 42/50 [00:06<00:01,  5.98it/s]
 86%|████████▌ | 43/50 [00:06<00:01,  5.97it/s]
 88%|████████▊ | 44/50 [00:07<00:01,  5.96it/s]
 90%|█████████ | 45/50 [00:07<00:00,  6.04it/s]
 92%|█████████▏| 46/50 [00:07<00:00,  5.99it/s]
 94%|█████████▍| 47/50 [00:07<00:00,  6.01it/s]
 96%|█████████▌| 48/50 [00:07<00:00,  6.05it/s]
 98%|█████████▊| 49/50 [00:07<00:00,  6.13it/s]
100%|██████████| 50/50 [00:08<00:00,  6.07it/s]
100%|██████████| 50/50 [00:08<00:00,  6.17it/s]
anime artwork illustrating a woman, wearing a white t - shirt, blue loose hair, lying in bed at night. created by japanese anime studio. highly emotional. best quality, high resolution
torch.Size([1, 77, 2048])
torch.Size([1, 77, 2048])
torch.Size([1, 77, 2048])
torch.Size([1, 1280])
torch.Size([1, 1280])
torch.Size([1, 1280])
torch.Size([1, 4, 96, 96])
torch.Size([2, 6])
  0%|          | 0/50 [00:00<?, ?it/s]
  2%|▏         | 1/50 [00:00<00:06,  7.37it/s]
  4%|▍         | 2/50 [00:00<00:06,  7.43it/s]
  6%|▌         | 3/50 [00:00<00:06,  7.08it/s]
  8%|▊         | 4/50 [00:00<00:07,  6.56it/s]
 10%|█         | 5/50 [00:00<00:07,  6.36it/s]
 12%|█▏        | 6/50 [00:00<00:06,  6.37it/s]
 14%|█▍        | 7/50 [00:01<00:06,  6.34it/s]
 16%|█▌        | 8/50 [00:01<00:06,  6.24it/s]
 18%|█▊        | 9/50 [00:01<00:06,  6.29it/s]
 20%|██        | 10/50 [00:01<00:06,  6.34it/s]
 22%|██▏       | 11/50 [00:01<00:06,  6.38it/s]
 24%|██▍       | 12/50 [00:01<00:05,  6.36it/s]
 26%|██▌       | 13/50 [00:02<00:05,  6.32it/s]
 28%|██▊       | 14/50 [00:02<00:05,  6.27it/s]
 30%|███       | 15/50 [00:02<00:05,  6.35it/s]
 32%|███▏      | 16/50 [00:02<00:05,  6.31it/s]
 34%|███▍      | 17/50 [00:02<00:05,  6.22it/s]
 36%|███▌      | 18/50 [00:02<00:05,  6.14it/s]
 38%|███▊      | 19/50 [00:02<00:05,  6.20it/s]
 40%|████      | 20/50 [00:03<00:04,  6.23it/s]
 42%|████▏     | 21/50 [00:03<00:04,  6.19it/s]
 44%|████▍     | 22/50 [00:03<00:04,  6.13it/s]
 46%|████▌     | 23/50 [00:03<00:04,  6.10it/s]
 48%|████▊     | 24/50 [00:03<00:04,  6.07it/s]
 50%|█████     | 25/50 [00:03<00:04,  6.07it/s]
 52%|█████▏    | 26/50 [00:04<00:03,  6.06it/s]
 54%|█████▍    | 27/50 [00:04<00:03,  5.99it/s]
 56%|█████▌    | 28/50 [00:04<00:03,  5.99it/s]
 58%|█████▊    | 29/50 [00:04<00:03,  5.98it/s]
 60%|██████    | 30/50 [00:04<00:03,  5.95it/s]
 62%|██████▏   | 31/50 [00:04<00:03,  5.94it/s]
 64%|██████▍   | 32/50 [00:05<00:03,  5.97it/s]
 66%|██████▌   | 33/50 [00:05<00:02,  5.97it/s]
 68%|██████▊   | 34/50 [00:05<00:02,  5.98it/s]
 70%|███████   | 35/50 [00:05<00:02,  5.97it/s]
 72%|███████▏  | 36/50 [00:05<00:02,  5.99it/s]
 74%|███████▍  | 37/50 [00:05<00:02,  5.98it/s]
 76%|███████▌  | 38/50 [00:06<00:02,  5.95it/s]
 78%|███████▊  | 39/50 [00:06<00:01,  5.96it/s]
 80%|████████  | 40/50 [00:06<00:01,  5.93it/s]
 82%|████████▏ | 41/50 [00:06<00:01,  5.97it/s]
 84%|████████▍ | 42/50 [00:06<00:01,  5.94it/s]
 86%|████████▌ | 43/50 [00:07<00:01,  5.88it/s]
 88%|████████▊ | 44/50 [00:07<00:01,  5.92it/s]
 90%|█████████ | 45/50 [00:07<00:00,  5.99it/s]
 92%|█████████▏| 46/50 [00:07<00:00,  5.97it/s]
 94%|█████████▍| 47/50 [00:07<00:00,  6.00it/s]
 96%|█████████▌| 48/50 [00:07<00:00,  6.03it/s]
 98%|█████████▊| 49/50 [00:07<00:00,  6.10it/s]
100%|██████████| 50/50 [00:08<00:00,  6.07it/s]
100%|██████████| 50/50 [00:08<00:00,  6.13it/s]
2 [[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAB60>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAF50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAA70>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CBC40>]]
-2 [[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAB60>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAF50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAA70>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CBC40>], [<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CACE0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAD10>]]
[[<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAB60>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAF50>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAA70>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CBC40>], [<PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CACE0>, <PIL.Image.Image image mode=RGB size=788x788 at 0x7F59B44CAD10>, <PIL.Image.Image image mode=RGBA size=788x788 at 0x7F59B44CAC50>, <PIL.Image.Image image mode=RGBA size=788x788 at 0x7F59B44CAC50>]]
0 (214, 718)
0 (201, 717)
0 (1, 717)
Pipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.
Pipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.
Pipelines loaded with `dtype=torch.float16` cannot run with `cpu` device. It is not recommended to move them to `cpu` as running them will fail. Please make sure to use an accelerator to run the pipeline in inference, due to the lack of support for`float16` operations on this device in PyTorch. Please, remove the `torch_dtype=torch.float16` argument, or use another device for inference.
successsfully load paired self-attention
number of the processor : 36

This example was created by a different version, camenduru/story-diffusion:d9d04c7d.

Examples

View more examples

Run time and cost

This model costs approximately $0.11 to run on Replicate, or 9 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia L40S GPU hardware. Predictions typically complete within 111 seconds. The predict time for this model varies significantly based on the inputs.

Readme

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

📋 Tutorial

Enter a Textual Description for Character, if you add the Ref-Image, making sure to follow the class word you want to customize with the trigger word: img, such as: man img or woman img or girl img.
Enter the prompt array, each line corrsponds to one generated image.
Choose your preferred style template.
If you need to change the caption, add a # at the end of each line. Only the part after the # will be added as a caption to the image.)
[NC] symbol (The [NC] symbol is used as a flag to indicate that no characters should be present in the generated scene images. If you want do that, prepend the “[NC]” at the beginning of the line. For example, to generate a scene of falling leaves without any character, write: “[NC] The leaves are falling.”), Currently, support is only using Textual Description

Input

Output

Examples

Run time and cost

Readme

📋 Tutorial

🕸 Replicate

🧬 Code

📄 Paper

🌐 Page

🏢 Sponsor