jyoung105 / lcm

Latent Consistency Models: Synthesizing High-Resolution Images with Few-step Inference

Cold

Public
124 runs
L40S
GitHub
Weights
Paper
License

Run with an API

Playground API Examples README Versions

Input

prompt

string

Shift + Return to add a new line

Input prompt, text of what you want to generate.

negative_prompt

string

Shift + Return to add a new line

Input negative prompt, text of what you don't want to generate.

width

integer

(minimum: 1, maximum: 2048)

Width of the output image.

Default: 1024

height

integer

(minimum: 1, maximum: 2048)

Height of the output image.

Default: 1024

num_images

integer

(minimum: 1, maximum: 4)

Number of output images.

Default: 1

steps

integer

(minimum: 1, maximum: 50)

Number of denoising steps.

Default: 4

eta

number

(minimum: 0, maximum: 1)

Stochastic parameter to control the randomness.

Default: 0

guidance_scale

number

(minimum: 0, maximum: 20)

Scale for classifier-free guidance.

Default: 0

seed

integer

Random seed. Leave blank to randomize the seed.

clip_skip

integer

Number of the layers to skip in CLIP.

Default: 0

Run this model in Node.js with one line of code:

npx create-replicate --model=jyoung105/lcm

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run jyoung105/lcm using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "jyoung105/lcm:098684902c54abfb0d464cd0e28d11af902c01f88590ac38cbac393f7776e799",
  {
    input: {
      eta: 0,
      steps: 4,
      width: 1024,
      height: 1024,
      prompt: "A man with hoodie on, illustration",
      clip_skip: 0,
      num_images: 1,
      guidance_scale: 0
    }
  }
);

// To access the file URL:
console.log(output[0].url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output[0]);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run jyoung105/lcm using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "jyoung105/lcm:098684902c54abfb0d464cd0e28d11af902c01f88590ac38cbac393f7776e799",
    input={
        "eta": 0,
        "steps": 4,
        "width": 1024,
        "height": 1024,
        "prompt": "A man with hoodie on, illustration",
        "clip_skip": 0,
        "num_images": 1,
        "guidance_scale": 0
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run jyoung105/lcm using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "jyoung105/lcm:098684902c54abfb0d464cd0e28d11af902c01f88590ac38cbac393f7776e799",
    "input": {
      "eta": 0,
      "steps": 4,
      "width": 1024,
      "height": 1024,
      "prompt": "A man with hoodie on, illustration",
      "clip_skip": 0,
      "num_images": 1,
      "guidance_scale": 0
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

Generated in

3.8 seconds

Tweak it Share Report

This output was created using a different version of the model, jyoung105/lcm:1eccb313.

Examples

View more examples

Run time and cost

This model costs approximately $0.0045 to run on Replicate, or 222 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia L40S GPU hardware. Predictions typically complete within 5 seconds.

Readme

Latent Consistency Models

Official Repository of the paper: Latent Consistency Models. Project Page: https://latent-consistency-models.github.io

Try our Hugging Face demos:

Model Descriptions:

Distilled from Dreamshaper v7 fine-tune of Stable-Diffusion v1-5 with only 4,000 training iterations (~32 A100 GPU Hours).

BibTeX

@misc{luo2023latent,
      title={Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference}, 
      author={Simian Luo and Yiqin Tan and Longbo Huang and Jian Li and Hang Zhao},
      year={2023},
      eprint={2310.04378},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}