rossjillian/controlnet:795433b1 – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

rossjillian /controlnet:795433b1

Playground API

Input

image

*file

Input image

prompt

*string

Shift + Return to add a new line

Prompt for the model

structure

*string

Controlnet structure to condition on

num_outputs

integer

(minimum: 1, maximum: 4)

Number of images to output (higher values may OOM)

Default: 1

image_resolution

integer

Resolution of output image (will be scaled to this as its smaller dimension)

Default: 512

scheduler

string

Choose a scheduler.

Default: "DDIM"

steps

integer

Steps

Default: 20

scale

number

(minimum: 0.1, maximum: 30)

Scale for classifier-free guidance

Default: 9

seed

integer

Seed

eta

number

Controls the amount of noise that is added to the input data during the denoising diffusion process. Higher value -> more noise

Default: 0

negative_prompt

string

Shift + Return to add a new line

Longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low qualityLongbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality

Negative prompt

Default: "Longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality"

return_reference_image

boolean

whether to return the reference image along with the output

Default: false

low_threshold

integer

(minimum: 1, maximum: 255)

[canny only] Line detection low threshold

Default: 100

high_threshold

integer

(minimum: 1, maximum: 255)

[canny only] Line detection high threshold

Default: 200

Run this model in Node.js with one line of code:

npx create-replicate --model=rossjillian/controlnet

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run rossjillian/controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "rossjillian/controlnet:795433b19458d0f4fa172a7ccf93178d2adb1cb8ab2ad6c8fdc33fdbcd49f477",
  {
    input: {
      eta: 0,
      scale: 9,
      steps: 20,
      scheduler: "DDIM",
      structure: "canny",
      num_outputs: 1,
      low_threshold: 100,
      high_threshold: 200,
      negative_prompt: "Longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality",
      image_resolution: 512,
      return_reference_image: false
    }
  }
);

// To access the file URL:
console.log(output[0].url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output[0]);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run rossjillian/controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "rossjillian/controlnet:795433b19458d0f4fa172a7ccf93178d2adb1cb8ab2ad6c8fdc33fdbcd49f477",
    input={
        "eta": 0,
        "scale": 9,
        "steps": 20,
        "scheduler": "DDIM",
        "structure": "canny",
        "num_outputs": 1,
        "low_threshold": 100,
        "high_threshold": 200,
        "negative_prompt": "Longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality",
        "image_resolution": 512,
        "return_reference_image": False
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run rossjillian/controlnet using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "rossjillian/controlnet:795433b19458d0f4fa172a7ccf93178d2adb1cb8ab2ad6c8fdc33fdbcd49f477",
    "input": {
      "eta": 0,
      "scale": 9,
      "steps": 20,
      "scheduler": "DDIM",
      "structure": "canny",
      "num_outputs": 1,
      "low_threshold": 100,
      "high_threshold": 200,
      "negative_prompt": "Longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality",
      "image_resolution": 512,
      "return_reference_image": false
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

No output yet! Press "Submit" to start a prediction.