zsxkib / ic-light

✍️✨Prompts to auto-magically relights your images

Cold

Public
201.9K runs
L40S
GitHub
License

Run with an API

Playground API Examples README Versions

Input

subject_image

*file

The main foreground image to be relighted

prompt

*string

Shift + Return to add a new line

Woman, detailed face, sci-fi RGB glowing, cyberpunkWoman, detailed face, sci-fi RGB glowing, cyberpunk

A text description guiding the relighting and generation process

appended_prompt

string

Shift + Return to add a new line

Additional text to be appended to the main prompt, enhancing image quality

Default: "best quality"

negative_prompt

string

Shift + Return to add a new line

lowres, bad anatomy, bad hands, cropped, worst qualitylowres, bad anatomy, bad hands, cropped, worst quality

A text description of attributes to avoid in the generated images

Default: "lowres, bad anatomy, bad hands, cropped, worst quality"

width

integer

The width of the generated images in pixels

Default: 512

height

integer

The height of the generated images in pixels

Default: 640

steps

integer

(minimum: 1, maximum: 100)

The number of diffusion steps to perform during generation (more steps generally improves image quality but increases processing time)

Default: 25

cfg

number

(minimum: 1, maximum: 32)

Classifier-Free Guidance scale - higher values encourage adherence to prompt, lower values encourage more creative interpretation

Default: 2

highres_scale

number

(minimum: 1, maximum: 3)

The multiplier for the final output resolution relative to the initial latent resolution

Default: 1.5

highres_denoise

number

(minimum: 0.1, maximum: 1)

Controls the amount of denoising applied when refining the high resolution output (higher = more adherence to the upscaled latent, lower = more creative details added)

Default: 0.5

lowres_denoise

number

(minimum: 0.1, maximum: 1)

Controls the amount of denoising applied when generating the initial latent from the background image (higher = more adherence to the background, lower = more creative interpretation)

Default: 0.9

light_source

string

The type and position of lighting to apply to the initial background latent

Default: "None"

seed

integer

A fixed random seed for reproducible results (omit this parameter for a randomized seed)

number_of_images

integer

(minimum: 1, maximum: 12)

The number of unique images to generate from the given input and settings

Default: 1

output_format

string

The image file format of the generated output images

Default: "webp"

output_quality

integer

(minimum: 0, maximum: 100)

The image compression quality (for lossy formats like JPEG and WebP). 100 = best quality, 0 = lowest quality.

Default: 80

Run this model in Node.js with one line of code:

npx create-replicate --model=zsxkib/ic-light

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run zsxkib/ic-light using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "zsxkib/ic-light:d41bcb10d8c159868f4cfbd7c6a2ca01484f7d39e4613419d5952c61562f1ba7",
  {
    input: {
      cfg: 2,
      steps: 25,
      width: 512,
      height: 640,
      prompt: "Woman, detailed face, sci-fi RGB glowing, cyberpunk",
      light_source: "Left Light",
      highres_scale: 1.5,
      output_format: "webp",
      subject_image: "https://replicate.delivery/pbxt/KtCKrs9sxPF3HciwoWL0TTVM9Nde7ySDWpO9S2flTiyi9Pp3/i3.png",
      lowres_denoise: 0.9,
      output_quality: 80,
      appended_prompt: "best quality",
      highres_denoise: 0.5,
      negative_prompt: "lowres, bad anatomy, bad hands, cropped, worst quality",
      number_of_images: 1
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run zsxkib/ic-light using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "zsxkib/ic-light:d41bcb10d8c159868f4cfbd7c6a2ca01484f7d39e4613419d5952c61562f1ba7",
    input={
        "cfg": 2,
        "steps": 25,
        "width": 512,
        "height": 640,
        "prompt": "Woman, detailed face, sci-fi RGB glowing, cyberpunk",
        "light_source": "Left Light",
        "highres_scale": 1.5,
        "output_format": "webp",
        "subject_image": "https://replicate.delivery/pbxt/KtCKrs9sxPF3HciwoWL0TTVM9Nde7ySDWpO9S2flTiyi9Pp3/i3.png",
        "lowres_denoise": 0.9,
        "output_quality": 80,
        "appended_prompt": "best quality",
        "highres_denoise": 0.5,
        "negative_prompt": "lowres, bad anatomy, bad hands, cropped, worst quality",
        "number_of_images": 1
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run zsxkib/ic-light using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "d41bcb10d8c159868f4cfbd7c6a2ca01484f7d39e4613419d5952c61562f1ba7",
    "input": {
      "cfg": 2,
      "steps": 25,
      "width": 512,
      "height": 640,
      "prompt": "Woman, detailed face, sci-fi RGB glowing, cyberpunk",
      "light_source": "Left Light",
      "highres_scale": 1.5,
      "output_format": "webp",
      "subject_image": "https://replicate.delivery/pbxt/KtCKrs9sxPF3HciwoWL0TTVM9Nde7ySDWpO9S2flTiyi9Pp3/i3.png",
      "lowres_denoise": 0.9,
      "output_quality": 80,
      "appended_prompt": "best quality",
      "highres_denoise": 0.5,
      "negative_prompt": "lowres, bad anatomy, bad hands, cropped, worst quality",
      "number_of_images": 1
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

{
  "completed_at": "2024-05-21T15:36:41.562137Z",
  "created_at": "2024-05-21T15:36:35.794000Z",
  "data_removed": false,
  "error": null,
  "id": "5eah7grtt9rgp0cfkf695tqe28",
  "input": {
    "cfg": 2,
    "steps": 25,
    "width": 512,
    "height": 640,
    "prompt": "Woman, detailed face, sci-fi RGB glowing, cyberpunk",
    "light_source": "Left Light",
    "highres_scale": 1.5,
    "output_format": "webp",
    "subject_image": "https://replicate.delivery/pbxt/KtCKrs9sxPF3HciwoWL0TTVM9Nde7ySDWpO9S2flTiyi9Pp3/i3.png",
    "lowres_denoise": 0.9,
    "output_quality": 80,
    "appended_prompt": "best quality",
    "highres_denoise": 0.5,
    "negative_prompt": "lowres, bad anatomy, bad hands, cropped, worst quality",
    "number_of_images": 1
  },
  "logs": "Using seed: 3579\n[!] (<class 'cog.types.Path'>) input_fg=/tmp/tmpdqgnps5yi3.png\n[!] (<class 'str'>) prompt=Woman, detailed face, sci-fi RGB glowing, cyberpunk\n[!] (<class 'int'>) image_width=512\n[!] (<class 'int'>) image_height=640\n[!] (<class 'int'>) num_samples=1\n[!] (<class 'int'>) seed=3579\n[!] (<class 'int'>) steps=25\n[!] (<class 'str'>) a_prompt=best quality\n[!] (<class 'str'>) n_prompt=lowres, bad anatomy, bad hands, cropped, worst quality\n[!] (<class 'float'>) cfg=2.0\n[!] (<class 'float'>) highres_scale=1.5\n[!] (<class 'float'>) highres_denoise=0.5\n[!] (<class 'float'>) lowres_denoise=0.9\n[!] (<class 'str'>) bg_source=Left Light\n  0%|          | 0/25 [00:00<?, ?it/s]\n 12%|█▏        | 3/25 [00:00<00:00, 29.80it/s]\n 24%|██▍       | 6/25 [00:00<00:00, 24.69it/s]\n 36%|███▌      | 9/25 [00:00<00:00, 23.39it/s]\n 48%|████▊     | 12/25 [00:00<00:00, 22.81it/s]\n 60%|██████    | 15/25 [00:00<00:00, 22.50it/s]\n 72%|███████▏  | 18/25 [00:00<00:00, 22.31it/s]\n 84%|████████▍ | 21/25 [00:00<00:00, 22.19it/s]\n 96%|█████████▌| 24/25 [00:01<00:00, 22.09it/s]\n100%|██████████| 25/25 [00:01<00:00, 22.68it/s]\n  0%|          | 0/25 [00:00<?, ?it/s]\n  8%|▊         | 2/25 [00:00<00:01, 15.12it/s]\n 16%|█▌        | 4/25 [00:00<00:01, 11.04it/s]\n 24%|██▍       | 6/25 [00:00<00:01, 10.18it/s]\n 32%|███▏      | 8/25 [00:00<00:01,  9.81it/s]\n 40%|████      | 10/25 [00:00<00:01,  9.61it/s]\n 44%|████▍     | 11/25 [00:01<00:01,  9.54it/s]\n 48%|████▊     | 12/25 [00:01<00:01,  9.49it/s]\n 52%|█████▏    | 13/25 [00:01<00:01,  9.43it/s]\n 56%|█████▌    | 14/25 [00:01<00:01,  9.39it/s]\n 60%|██████    | 15/25 [00:01<00:01,  9.36it/s]\n 64%|██████▍   | 16/25 [00:01<00:00,  9.34it/s]\n 68%|██████▊   | 17/25 [00:01<00:00,  9.33it/s]\n 72%|███████▏  | 18/25 [00:01<00:00,  9.23it/s]\n 76%|███████▌  | 19/25 [00:01<00:00,  9.12it/s]\n 80%|████████  | 20/25 [00:02<00:00,  9.17it/s]\n 84%|████████▍ | 21/25 [00:02<00:00,  9.18it/s]\n 88%|████████▊ | 22/25 [00:02<00:00,  9.22it/s]\n 92%|█████████▏| 23/25 [00:02<00:00,  9.24it/s]\n 96%|█████████▌| 24/25 [00:02<00:00,  9.23it/s]\n100%|██████████| 25/25 [00:02<00:00,  9.26it/s]\n100%|██████████| 25/25 [00:02<00:00,  9.55it/s]\n[~] Saving to output_images/generated_0.webp...\n[~] Output format: WEBP\n[~] Output quality: 80",
  "metrics": {
    "predict_time": 5.721511,
    "total_time": 5.768137
  },
  "output": [
    "https://replicate.delivery/pbxt/GsxrHO4NuhbyO9IlMU7eetDNJRrIuT41jMNTP2PuvTFIGn2SA/generated_0.webp"
  ],
  "started_at": "2024-05-21T15:36:35.840626Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/5eah7grtt9rgp0cfkf695tqe28",
    "cancel": "https://api.replicate.com/v1/predictions/5eah7grtt9rgp0cfkf695tqe28/cancel"
  },
  "version": "d41bcb10d8c159868f4cfbd7c6a2ca01484f7d39e4613419d5952c61562f1ba7"
}

Generated in

5.7 seconds

Tweak it ShareReport

Using seed: 3579
[!] (<class 'cog.types.Path'>) input_fg=/tmp/tmpdqgnps5yi3.png
[!] (<class 'str'>) prompt=Woman, detailed face, sci-fi RGB glowing, cyberpunk
[!] (<class 'int'>) image_width=512
[!] (<class 'int'>) image_height=640
[!] (<class 'int'>) num_samples=1
[!] (<class 'int'>) seed=3579
[!] (<class 'int'>) steps=25
[!] (<class 'str'>) a_prompt=best quality
[!] (<class 'str'>) n_prompt=lowres, bad anatomy, bad hands, cropped, worst quality
[!] (<class 'float'>) cfg=2.0
[!] (<class 'float'>) highres_scale=1.5
[!] (<class 'float'>) highres_denoise=0.5
[!] (<class 'float'>) lowres_denoise=0.9
[!] (<class 'str'>) bg_source=Left Light
  0%|          | 0/25 [00:00<?, ?it/s]
 12%|█▏        | 3/25 [00:00<00:00, 29.80it/s]
 24%|██▍       | 6/25 [00:00<00:00, 24.69it/s]
 36%|███▌      | 9/25 [00:00<00:00, 23.39it/s]
 48%|████▊     | 12/25 [00:00<00:00, 22.81it/s]
 60%|██████    | 15/25 [00:00<00:00, 22.50it/s]
 72%|███████▏  | 18/25 [00:00<00:00, 22.31it/s]
 84%|████████▍ | 21/25 [00:00<00:00, 22.19it/s]
 96%|█████████▌| 24/25 [00:01<00:00, 22.09it/s]
100%|██████████| 25/25 [00:01<00:00, 22.68it/s]
  0%|          | 0/25 [00:00<?, ?it/s]
  8%|▊         | 2/25 [00:00<00:01, 15.12it/s]
 16%|█▌        | 4/25 [00:00<00:01, 11.04it/s]
 24%|██▍       | 6/25 [00:00<00:01, 10.18it/s]
 32%|███▏      | 8/25 [00:00<00:01,  9.81it/s]
 40%|████      | 10/25 [00:00<00:01,  9.61it/s]
 44%|████▍     | 11/25 [00:01<00:01,  9.54it/s]
 48%|████▊     | 12/25 [00:01<00:01,  9.49it/s]
 52%|█████▏    | 13/25 [00:01<00:01,  9.43it/s]
 56%|█████▌    | 14/25 [00:01<00:01,  9.39it/s]
 60%|██████    | 15/25 [00:01<00:01,  9.36it/s]
 64%|██████▍   | 16/25 [00:01<00:00,  9.34it/s]
 68%|██████▊   | 17/25 [00:01<00:00,  9.33it/s]
 72%|███████▏  | 18/25 [00:01<00:00,  9.23it/s]
 76%|███████▌  | 19/25 [00:01<00:00,  9.12it/s]
 80%|████████  | 20/25 [00:02<00:00,  9.17it/s]
 84%|████████▍ | 21/25 [00:02<00:00,  9.18it/s]
 88%|████████▊ | 22/25 [00:02<00:00,  9.22it/s]
 92%|█████████▏| 23/25 [00:02<00:00,  9.24it/s]
 96%|█████████▌| 24/25 [00:02<00:00,  9.23it/s]
100%|██████████| 25/25 [00:02<00:00,  9.26it/s]
100%|██████████| 25/25 [00:02<00:00,  9.55it/s]
[~] Saving to output_images/generated_0.webp...
[~] Output format: WEBP
[~] Output quality: 80

Examples

View more examples

Run time and cost

This model costs approximately $0.0038 to run on Replicate, or 263 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia L40S GPU hardware. Predictions typically complete within 4 seconds.

Readme

IC-Light Text: Illuminate Portraits with Text-Guided Relighting 📝💡

Foreground (Subject) Image + Prompt → Subject in Prompted Location w/ Correct Lighting

Overview 🌈

IC-Light Text (short for “Imposing Consistent Light”) is an AI-powered tool that magically relights your portrait photos using text descriptions. Built upon cutting-edge deep learning techniques, IC-Light Text lets you create beautifully illuminated results with ease! 📸✨

Getting Started 🚀

To start relighting your portraits, simply:

Upload your portrait image
Describe the desired lighting using natural language
Let IC-Light Text work its magic! ✨

Text-Conditioned Relighting ✍️💡

With text-conditioned relighting, you can describe the lighting you want using natural language. Want a warm, golden hour glow? Just type it in! IC-Light Text will interpret your description and relight your portrait accordingly. 🌅

Consistency is Key 🔑

IC-Light Text’s secret sauce is its ability to impose consistent lighting across your portrait. By training the model with a specialized loss function, IC-Light Text ensures that the relighting looks physically plausible and coherent, no matter how creative you get with your descriptions! 🧙‍♂️

Customization Galore 🎛️

IC-Light Text offers a wide range of parameters to fine-tune your relighting results. From adjusting the intensity of the lighting to controlling the output quality, you have the power to create the perfect look for your portraits. 🎚️

Powered by Science 🔬

Under the hood, IC-Light Text leverages state-of-the-art deep learning models, including Stable Diffusion v1.5, to work its relighting magic. With a powerful combination of text encoding, variational autoencoders, and U-Nets, IC-Light Text is at the forefront of AI-driven image manipulation. 🧠

Get Ready to Shine! ✨

With IC-Light Text, you can take your portrait photography to the next level. Say goodbye to flat, lifeless lighting and hello to stunning, perfectly illuminated portraits that will make your subjects shine! 🌟

Disclaimer 📜

While IC-Light Text is an incredibly powerful tool, please use it responsibly. Respect the privacy and rights of the individuals in your photos, and always obtain necessary permissions before sharing or publishing relit images. 🙏

Get ready to see your portraits in a whole new light with IC-Light Text! 🌈✨

For background-conditioned portrait relighting, check out the IC-Light Background model. 🖼️💡