georgedavila/cog-storydiffusion-comics – Run with an API on Replicate

georgedavila / cog-storydiffusion-comics

Cold

Public
15 runs
L40S

Iterate in playground

Run with an API

Playground API Examples README Versions

Input

input_image

*file

style

string

Shift + Return to add a new line

Style template: '(No style)', 'Japanese Anime', 'Cinematic', 'Disney Character', 'Photographic', 'Comic book', 'Line art'

Default: "Photographic"

style_strength_ratio

integer

Style strength of Ref Image (%)

Default: 20

model_type

string

Control type of the Character

Default: "Using Ref Images"

general_prompt

string

Shift + Return to add a new line

Textual Description for Character

Default: "a man img, wearing a tuxedo"

negative_prompt

string

Shift + Return to add a new line

bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbsbad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs

Negative Prompt

Default: "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs"

prompt_array

string

Shift + Return to add a new line

wake up in the bed
have breakfast
is on the road, go to company
work in the company
Take a walk next to the company at noon
lying in bed at nightwake up in the bed
have breakfast
is on the road, go to company
work in the company
Take a walk next to the company at noon
lying in bed at night

Comic Description (each line corresponds to a frame).

Default: "wake up in the bed\nhave breakfast\nis on the road, go to company\nwork in the company\nTake a walk next to the company at noon\nlying in bed at night"

Ip_Adapter_Strength

number

Ip Adapter Strength

Default: 0.7

sa32_

number

The degree of Paired Attention at 32 x 32 self-attention layers

Default: 0.5

sa64_

number

The degree of Paired Attention at 64 x 64 self-attention layers

Default: 0.5

id_length_

integer

Number of id images in total images

Default: 3

seed_

integer

Seed

Default: 1

num_steps

integer

Number of sample steps

Default: 50

G_height

integer

Height

Default: 768

G_width

integer

Width

Default: 768

comic_type

string

Typesetting Style

Default: "Classic Comic Style"

guidance_scale

integer

Guidance scale

Default: 5

Run this model in Node.js with one line of code:

npx create-replicate --model=georgedavila/cog-storydiffusion-comics

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run georgedavila/cog-storydiffusion-comics using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "georgedavila/cog-storydiffusion-comics:761766d076bb8b45f58c4dddb04be7c13a37d9a799a8e04e2e2e3f5f66bfa663",
  {
    input: {
      sa32_: 0.5,
      sa64_: 0.5,
      seed_: 1,
      style: "Photographic",
      G_width: 768,
      G_height: 768,
      num_steps: 50,
      comic_type: "Classic Comic Style",
      id_length_: 3,
      model_type: "Using Ref Images",
      prompt_array: "wake up in the bed\nhave breakfast\nis on the road, go to company\nwork in the company\nTake a walk next to the company at noon\nlying in bed at night",
      general_prompt: "a man img, wearing a tuxedo",
      guidance_scale: 5,
      negative_prompt: "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
      Ip_Adapter_Strength: 0.7,
      style_strength_ratio: 20
    }
  }
);

// To access the file URL:
console.log(output[0].url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output[0]);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run georgedavila/cog-storydiffusion-comics using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "georgedavila/cog-storydiffusion-comics:761766d076bb8b45f58c4dddb04be7c13a37d9a799a8e04e2e2e3f5f66bfa663",
    input={
        "sa32_": 0.5,
        "sa64_": 0.5,
        "seed_": 1,
        "style": "Photographic",
        "G_width": 768,
        "G_height": 768,
        "num_steps": 50,
        "comic_type": "Classic Comic Style",
        "id_length_": 3,
        "model_type": "Using Ref Images",
        "prompt_array": "wake up in the bed\nhave breakfast\nis on the road, go to company\nwork in the company\nTake a walk next to the company at noon\nlying in bed at night",
        "general_prompt": "a man img, wearing a tuxedo",
        "guidance_scale": 5,
        "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
        "Ip_Adapter_Strength": 0.7,
        "style_strength_ratio": 20
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run georgedavila/cog-storydiffusion-comics using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "georgedavila/cog-storydiffusion-comics:761766d076bb8b45f58c4dddb04be7c13a37d9a799a8e04e2e2e3f5f66bfa663",
    "input": {
      "sa32_": 0.5,
      "sa64_": 0.5,
      "seed_": 1,
      "style": "Photographic",
      "G_width": 768,
      "G_height": 768,
      "num_steps": 50,
      "comic_type": "Classic Comic Style",
      "id_length_": 3,
      "model_type": "Using Ref Images",
      "prompt_array": "wake up in the bed\\nhave breakfast\\nis on the road, go to company\\nwork in the company\\nTake a walk next to the company at noon\\nlying in bed at night",
      "general_prompt": "a man img, wearing a tuxedo",
      "guidance_scale": 5,
      "negative_prompt": "bad anatomy, bad hands, missing fingers, extra fingers, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, three crus, fused feet, fused thigh, extra crus, ugly fingers, horn, cartoon, cg, 3d, unreal, animate, amputation, disconnected limbs",
      "Ip_Adapter_Strength": 0.7,
      "style_strength_ratio": 20
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

No output yet! Press "Submit" to start a prediction.

Run time and cost

This model runs on Nvidia L40S GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

This model doesn't have a readme.