georgedavila/sdxl-beethoven-spectrograms-lora | Run with an API on Replicate

georgedavila / sdxl-beethoven-spectrograms-lora

SDXL LoRA finetuned on spectrograms of Beethoven songs

Cold

Public
19 runs
L40S
GitHub

Iterate in playground

Run with an API

Playground API Examples README Versions

Input

myprompt

string

Shift + Return to add a new line

Input prompt (SPECTROGRAM is the style trigger word)

Default: "A SPECTROGRAM image"

promptAddendum

string

Shift + Return to add a new line

Extra terms to add to end of prompt

Default: ""

negative_prompt

string

Shift + Return to add a new line

Negative Prompt

Default: "fuzzy, lone pixels"

outWidth

integer

(minimum: 128, maximum: 4096)

width of output

Default: 1024

outHeight

integer

(minimum: 128, maximum: 4096)

height of output

Default: 1024

guidanceScale

number

(minimum: 0, maximum: 50)

Guidance scale (influence of input text on generation)

Default: 7.5

num_outputs

integer

(minimum: 1, maximum: 4)

Number of images to output.

Default: 1

num_inference_steps

integer

(minimum: 1, maximum: 500)

Number of denoising steps

Default: 50

seed

integer

Random seed. Leave blank to randomize the seed

high_noise_frac

number

(minimum: 0, maximum: 1)

For expert_ensemble_refiner, the fraction of noise to use

Default: 0.8

refine_steps

integer

For base_image_refiner, the number of steps to refine, defaults to num_inference_steps

lora_scale

number

(minimum: 0, maximum: 1)

LoRA additive scale. Only applicable on trained models.

Default: 0.6

Run this model in Node.js with one line of code:

npx create-replicate --model=georgedavila/sdxl-beethoven-spectrograms-lora

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";
import fs from "node:fs";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run georgedavila/sdxl-beethoven-spectrograms-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "georgedavila/sdxl-beethoven-spectrograms-lora:193c41eaa2f90912bb886b75950af5d433eb9e6007c17507e5da11e527ad38e5",
  {
    input: {
      myprompt: "A SPECTROGRAM image",
      outWidth: 640,
      outHeight: 480,
      lora_scale: 0.6,
      num_outputs: 1,
      guidanceScale: 7.5,
      promptAddendum: "",
      high_noise_frac: 0.8,
      negative_prompt: "noisy",
      num_inference_steps: 50
    }
  }
);

// To access the file URL:
console.log(output[0].url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output[0]);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run georgedavila/sdxl-beethoven-spectrograms-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "georgedavila/sdxl-beethoven-spectrograms-lora:193c41eaa2f90912bb886b75950af5d433eb9e6007c17507e5da11e527ad38e5",
    input={
        "myprompt": "A SPECTROGRAM image",
        "outWidth": 640,
        "outHeight": 480,
        "lora_scale": 0.6,
        "num_outputs": 1,
        "guidanceScale": 7.5,
        "promptAddendum": "",
        "high_noise_frac": 0.8,
        "negative_prompt": "noisy",
        "num_inference_steps": 50
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run georgedavila/sdxl-beethoven-spectrograms-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "georgedavila/sdxl-beethoven-spectrograms-lora:193c41eaa2f90912bb886b75950af5d433eb9e6007c17507e5da11e527ad38e5",
    "input": {
      "myprompt": "A SPECTROGRAM image",
      "outWidth": 640,
      "outHeight": 480,
      "lora_scale": 0.6,
      "num_outputs": 1,
      "guidanceScale": 7.5,
      "promptAddendum": "",
      "high_noise_frac": 0.8,
      "negative_prompt": "noisy",
      "num_inference_steps": 50
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

{
  "completed_at": "2024-05-29T17:26:52.221181Z",
  "created_at": "2024-05-29T17:26:44.180000Z",
  "data_removed": false,
  "error": null,
  "id": "vgb734pgthrgm0cfrnhtgfrdy0",
  "input": {
    "myprompt": "A SPECTROGRAM image",
    "outWidth": 640,
    "outHeight": 480,
    "lora_scale": 0.6,
    "num_outputs": 1,
    "guidanceScale": 7.5,
    "promptAddendum": "",
    "high_noise_frac": 0.8,
    "negative_prompt": "noisy",
    "num_inference_steps": 50
  },
  "logs": "Using seed: 55418\n  0%|          | 0/50 [00:00<?, ?it/s]\n  2%|▏         | 1/50 [00:00<00:05,  8.20it/s]\n  4%|▍         | 2/50 [00:00<00:05,  8.27it/s]\n  6%|▌         | 3/50 [00:00<00:05,  8.41it/s]\n  8%|▊         | 4/50 [00:00<00:05,  8.49it/s]\n 10%|█         | 5/50 [00:00<00:05,  8.58it/s]\n 12%|█▏        | 6/50 [00:00<00:05,  8.63it/s]\n 14%|█▍        | 7/50 [00:00<00:04,  8.67it/s]\n 16%|█▌        | 8/50 [00:00<00:04,  8.59it/s]\n 18%|█▊        | 9/50 [00:01<00:04,  8.56it/s]\n 20%|██        | 10/50 [00:01<00:04,  8.44it/s]\n 22%|██▏       | 11/50 [00:01<00:04,  8.21it/s]\n 24%|██▍       | 12/50 [00:01<00:04,  8.19it/s]\n 26%|██▌       | 13/50 [00:01<00:04,  8.13it/s]\n 28%|██▊       | 14/50 [00:01<00:04,  7.97it/s]\n 30%|███       | 15/50 [00:01<00:04,  7.84it/s]\n 32%|███▏      | 16/50 [00:01<00:04,  7.78it/s]\n 34%|███▍      | 17/50 [00:02<00:04,  7.62it/s]\n 36%|███▌      | 18/50 [00:02<00:04,  7.56it/s]\n 38%|███▊      | 19/50 [00:02<00:04,  7.60it/s]\n 40%|████      | 20/50 [00:02<00:03,  7.69it/s]\n 42%|████▏     | 21/50 [00:02<00:03,  7.77it/s]\n 44%|████▍     | 22/50 [00:02<00:03,  7.86it/s]\n 46%|████▌     | 23/50 [00:02<00:03,  8.14it/s]\n 48%|████▊     | 24/50 [00:02<00:03,  8.22it/s]\n 50%|█████     | 25/50 [00:03<00:02,  8.43it/s]\n 52%|█████▏    | 26/50 [00:03<00:02,  8.43it/s]\n 54%|█████▍    | 27/50 [00:03<00:02,  8.27it/s]\n 56%|█████▌    | 28/50 [00:03<00:02,  8.26it/s]\n 58%|█████▊    | 29/50 [00:03<00:02,  8.22it/s]\n 60%|██████    | 30/50 [00:03<00:02,  8.09it/s]\n 62%|██████▏   | 31/50 [00:03<00:02,  8.13it/s]\n 64%|██████▍   | 32/50 [00:03<00:02,  8.09it/s]\n 66%|██████▌   | 33/50 [00:04<00:02,  8.25it/s]\n 68%|██████▊   | 34/50 [00:04<00:01,  8.35it/s]\n 70%|███████   | 35/50 [00:04<00:01,  8.17it/s]\n 72%|███████▏  | 36/50 [00:04<00:01,  8.12it/s]\n 74%|███████▍  | 37/50 [00:04<00:01,  8.13it/s]\n 76%|███████▌  | 38/50 [00:04<00:01,  7.98it/s]\n 78%|███████▊  | 39/50 [00:04<00:01,  7.96it/s]\n 80%|████████  | 40/50 [00:04<00:01,  7.87it/s]\n 82%|████████▏ | 41/50 [00:05<00:01,  7.79it/s]\n 84%|████████▍ | 42/50 [00:05<00:01,  7.90it/s]\n 86%|████████▌ | 43/50 [00:05<00:00,  7.93it/s]\n 88%|████████▊ | 44/50 [00:05<00:00,  7.89it/s]\n 90%|█████████ | 45/50 [00:05<00:00,  7.72it/s]\n 92%|█████████▏| 46/50 [00:05<00:00,  7.54it/s]\n 94%|█████████▍| 47/50 [00:05<00:00,  7.35it/s]\n 96%|█████████▌| 48/50 [00:06<00:00,  7.14it/s]\n 98%|█████████▊| 49/50 [00:06<00:00,  7.05it/s]\n100%|██████████| 50/50 [00:06<00:00,  7.03it/s]\n100%|██████████| 50/50 [00:06<00:00,  7.94it/s]",
  "metrics": {
    "predict_time": 8.000885,
    "total_time": 8.041181
  },
  "output": [
    "https://replicate.delivery/pbxt/R6e9Ju3g4rxHCK8LolnwY0l03xafzUYRBXk2RomOQptbdR5SA/out-0.png"
  ],
  "started_at": "2024-05-29T17:26:44.220296Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/vgb734pgthrgm0cfrnhtgfrdy0",
    "cancel": "https://api.replicate.com/v1/predictions/vgb734pgthrgm0cfrnhtgfrdy0/cancel"
  },
  "version": "193c41eaa2f90912bb886b75950af5d433eb9e6007c17507e5da11e527ad38e5"
}

Generated in

8.0 seconds

Tweak it ShareReport View full prediction

Using seed: 55418
  0%|          | 0/50 [00:00<?, ?it/s]
  2%|▏         | 1/50 [00:00<00:05,  8.20it/s]
  4%|▍         | 2/50 [00:00<00:05,  8.27it/s]
  6%|▌         | 3/50 [00:00<00:05,  8.41it/s]
  8%|▊         | 4/50 [00:00<00:05,  8.49it/s]
 10%|█         | 5/50 [00:00<00:05,  8.58it/s]
 12%|█▏        | 6/50 [00:00<00:05,  8.63it/s]
 14%|█▍        | 7/50 [00:00<00:04,  8.67it/s]
 16%|█▌        | 8/50 [00:00<00:04,  8.59it/s]
 18%|█▊        | 9/50 [00:01<00:04,  8.56it/s]
 20%|██        | 10/50 [00:01<00:04,  8.44it/s]
 22%|██▏       | 11/50 [00:01<00:04,  8.21it/s]
 24%|██▍       | 12/50 [00:01<00:04,  8.19it/s]
 26%|██▌       | 13/50 [00:01<00:04,  8.13it/s]
 28%|██▊       | 14/50 [00:01<00:04,  7.97it/s]
 30%|███       | 15/50 [00:01<00:04,  7.84it/s]
 32%|███▏      | 16/50 [00:01<00:04,  7.78it/s]
 34%|███▍      | 17/50 [00:02<00:04,  7.62it/s]
 36%|███▌      | 18/50 [00:02<00:04,  7.56it/s]
 38%|███▊      | 19/50 [00:02<00:04,  7.60it/s]
 40%|████      | 20/50 [00:02<00:03,  7.69it/s]
 42%|████▏     | 21/50 [00:02<00:03,  7.77it/s]
 44%|████▍     | 22/50 [00:02<00:03,  7.86it/s]
 46%|████▌     | 23/50 [00:02<00:03,  8.14it/s]
 48%|████▊     | 24/50 [00:02<00:03,  8.22it/s]
 50%|█████     | 25/50 [00:03<00:02,  8.43it/s]
 52%|█████▏    | 26/50 [00:03<00:02,  8.43it/s]
 54%|█████▍    | 27/50 [00:03<00:02,  8.27it/s]
 56%|█████▌    | 28/50 [00:03<00:02,  8.26it/s]
 58%|█████▊    | 29/50 [00:03<00:02,  8.22it/s]
 60%|██████    | 30/50 [00:03<00:02,  8.09it/s]
 62%|██████▏   | 31/50 [00:03<00:02,  8.13it/s]
 64%|██████▍   | 32/50 [00:03<00:02,  8.09it/s]
 66%|██████▌   | 33/50 [00:04<00:02,  8.25it/s]
 68%|██████▊   | 34/50 [00:04<00:01,  8.35it/s]
 70%|███████   | 35/50 [00:04<00:01,  8.17it/s]
 72%|███████▏  | 36/50 [00:04<00:01,  8.12it/s]
 74%|███████▍  | 37/50 [00:04<00:01,  8.13it/s]
 76%|███████▌  | 38/50 [00:04<00:01,  7.98it/s]
 78%|███████▊  | 39/50 [00:04<00:01,  7.96it/s]
 80%|████████  | 40/50 [00:04<00:01,  7.87it/s]
 82%|████████▏ | 41/50 [00:05<00:01,  7.79it/s]
 84%|████████▍ | 42/50 [00:05<00:01,  7.90it/s]
 86%|████████▌ | 43/50 [00:05<00:00,  7.93it/s]
 88%|████████▊ | 44/50 [00:05<00:00,  7.89it/s]
 90%|█████████ | 45/50 [00:05<00:00,  7.72it/s]
 92%|█████████▏| 46/50 [00:05<00:00,  7.54it/s]
 94%|█████████▍| 47/50 [00:05<00:00,  7.35it/s]
 96%|█████████▌| 48/50 [00:06<00:00,  7.14it/s]
 98%|█████████▊| 49/50 [00:06<00:00,  7.05it/s]
100%|██████████| 50/50 [00:06<00:00,  7.03it/s]
100%|██████████| 50/50 [00:06<00:00,  7.94it/s]