jourdelune/diffrhythm – Run with an API on Replicate

jourdelune / diffrhythm

"DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion"

Cold

Public
269 runs
T4
GitHub
Weights
Paper
License

Run with an API

Playground API Examples README Versions

Input

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

lyric

string

Shift + Return to add a new line

[00:10.00]Moonlight spills through broken blinds
[00:13.20]Your shadow dances on the dashboard shrine
[00:16.85]Neon ghosts in gasoline rain
[00:20.40]I hear your laughter down the midnight train
[00:24.15]Static whispers through frayed wires
[00:27.65]Guitar strings hum our cathedral choirs
[00:31.30]Flicker screens show reruns of June
[00:34.90]I'm drowning in this mercury lagoon
[00:38.55]Electric veins pulse through concrete skies
[00:42.10]Your name echoes in the hollow where my heartbeat lies
[00:45.75]We're satellites trapped in parallel light
[00:49.25]Burning through the atmosphere of endless night
[01:00.00]Dusty vinyl spins reverse
[01:03.45]Our polaroid timeline bleeds through the verse
[01:07.10]Telescope aimed at dead stars
[01:10.65]Still tracing constellations through prison bars
[01:14.30]Electric veins pulse through concrete skies
[01:17.85]Your name echoes in the hollow where my heartbeat lies
[01:21.50]We're satellites trapped in parallel light
[01:25.05]Burning through the atmosphere of endless night
[02:10.00]Clockwork gears grind moonbeams to rust
[02:13.50]Our fingerprint smudged by interstellar dust
[02:17.15]Velvet thunder rolls through my veins
[02:20.70]Chasing phantom trains through solar plane
[02:24.35]Electric veins pulse through concrete skies
[02:27.90]Your name echoes in the hollow where my heartbeat lies[00:10.00]Moonlight spills through broken blinds
[00:13.20]Your shadow dances on the dashboard shrine
[00:16.85]Neon ghosts in gasoline rain
[00:20.40]I hear your laughter down the midnight train
[00:24.15]Static whispers through frayed wires
[00:27.65]Guitar strings hum our cathedral choirs
[00:31.30]Flicker screens show reruns of June
[00:34.90]I'm drowning in this mercury lagoon
[00:38.55]Electric veins pulse through concrete skies
[00:42.10]Your name echoes in the hollow where my heartbeat lies
[00:45.75]We're satellites trapped in parallel light
[00:49.25]Burning through the atmosphere of endless night
[01:00.00]Dusty vinyl spins reverse
[01:03.45]Our polaroid timeline bleeds through the verse
[01:07.10]Telescope aimed at dead stars
[01:10.65]Still tracing constellations through prison bars
[01:14.30]Electric veins pulse through concrete skies
[01:17.85]Your name echoes in the hollow where my heartbeat lies
[01:21.50]We're satellites trapped in parallel light
[01:25.05]Burning through the atmosphere of endless night
[02:10.00]Clockwork gears grind moonbeams to rust
[02:13.50]Our fingerprint smudged by interstellar dust
[02:17.15]Velvet thunder rolls through my veins
[02:20.70]Chasing phantom trains through solar plane
[02:24.35]Electric veins pulse through concrete skies
[02:27.90]Your name echoes in the hollow where my heartbeat lies

Lyric to generate a song for, format: [00:00.00]lyrics

Default: ""

audio_length

integer

Length of generated song

Default: 95

ref_prompt

string

Shift + Return to add a new line

Prompt to use as style reference

Default: ""

ref_audio_path

file

Audio to use as reference, have to be longer than 10 seconds

Default: ""

Run this model in Node.js with one line of code:

npx create-replicate --model=jourdelune/diffrhythm

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run jourdelune/diffrhythm using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "jourdelune/diffrhythm:4b0f15c352ce0508a34eaf09f8336f70334240643113a4091fb4f79feb57be03",
  {
    input: {
      lyric: "[00:10.00]Moonlight spills through broken blinds\n[00:13.20]Your shadow dances on the dashboard shrine\n[00:16.85]Neon ghosts in gasoline rain\n[00:20.40]I hear your laughter down the midnight train\n[00:24.15]Static whispers through frayed wires\n[00:27.65]Guitar strings hum our cathedral choirs\n[00:31.30]Flicker screens show reruns of June\n[00:34.90]I'm drowning in this mercury lagoon\n[00:38.55]Electric veins pulse through concrete skies\n[00:42.10]Your name echoes in the hollow where my heartbeat lies\n[00:45.75]We're satellites trapped in parallel light\n[00:49.25]Burning through the atmosphere of endless night\n[01:00.00]Dusty vinyl spins reverse\n[01:03.45]Our polaroid timeline bleeds through the verse\n[01:07.10]Telescope aimed at dead stars\n[01:10.65]Still tracing constellations through prison bars\n[01:14.30]Electric veins pulse through concrete skies\n[01:17.85]Your name echoes in the hollow where my heartbeat lies\n[01:21.50]We're satellites trapped in parallel light\n[01:25.05]Burning through the atmosphere of endless night\n[02:10.00]Clockwork gears grind moonbeams to rust\n[02:13.50]Our fingerprint smudged by interstellar dust\n[02:17.15]Velvet thunder rolls through my veins\n[02:20.70]Chasing phantom trains through solar plane\n[02:24.35]Electric veins pulse through concrete skies\n[02:27.90]Your name echoes in the hollow where my heartbeat lies",
      ref_prompt: "",
      audio_length: 95,
      ref_audio_path: "https://replicate.delivery/pbxt/Md2hz8ACgvWtwu2szfoq5WPDM3w3GaM2r9oWKtzZ4inPRch5/jourdelune%20-%20MUSIIIIIIIIIIIC%20-%20Sonauto.wav"
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run jourdelune/diffrhythm using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "jourdelune/diffrhythm:4b0f15c352ce0508a34eaf09f8336f70334240643113a4091fb4f79feb57be03",
    input={
        "lyric": "[00:10.00]Moonlight spills through broken blinds\n[00:13.20]Your shadow dances on the dashboard shrine\n[00:16.85]Neon ghosts in gasoline rain\n[00:20.40]I hear your laughter down the midnight train\n[00:24.15]Static whispers through frayed wires\n[00:27.65]Guitar strings hum our cathedral choirs\n[00:31.30]Flicker screens show reruns of June\n[00:34.90]I'm drowning in this mercury lagoon\n[00:38.55]Electric veins pulse through concrete skies\n[00:42.10]Your name echoes in the hollow where my heartbeat lies\n[00:45.75]We're satellites trapped in parallel light\n[00:49.25]Burning through the atmosphere of endless night\n[01:00.00]Dusty vinyl spins reverse\n[01:03.45]Our polaroid timeline bleeds through the verse\n[01:07.10]Telescope aimed at dead stars\n[01:10.65]Still tracing constellations through prison bars\n[01:14.30]Electric veins pulse through concrete skies\n[01:17.85]Your name echoes in the hollow where my heartbeat lies\n[01:21.50]We're satellites trapped in parallel light\n[01:25.05]Burning through the atmosphere of endless night\n[02:10.00]Clockwork gears grind moonbeams to rust\n[02:13.50]Our fingerprint smudged by interstellar dust\n[02:17.15]Velvet thunder rolls through my veins\n[02:20.70]Chasing phantom trains through solar plane\n[02:24.35]Electric veins pulse through concrete skies\n[02:27.90]Your name echoes in the hollow where my heartbeat lies",
        "ref_prompt": "",
        "audio_length": 95,
        "ref_audio_path": "https://replicate.delivery/pbxt/Md2hz8ACgvWtwu2szfoq5WPDM3w3GaM2r9oWKtzZ4inPRch5/jourdelune%20-%20MUSIIIIIIIIIIIC%20-%20Sonauto.wav"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run jourdelune/diffrhythm using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "4b0f15c352ce0508a34eaf09f8336f70334240643113a4091fb4f79feb57be03",
    "input": {
      "lyric": "[00:10.00]Moonlight spills through broken blinds\\n[00:13.20]Your shadow dances on the dashboard shrine\\n[00:16.85]Neon ghosts in gasoline rain\\n[00:20.40]I hear your laughter down the midnight train\\n[00:24.15]Static whispers through frayed wires\\n[00:27.65]Guitar strings hum our cathedral choirs\\n[00:31.30]Flicker screens show reruns of June\\n[00:34.90]I\'m drowning in this mercury lagoon\\n[00:38.55]Electric veins pulse through concrete skies\\n[00:42.10]Your name echoes in the hollow where my heartbeat lies\\n[00:45.75]We\'re satellites trapped in parallel light\\n[00:49.25]Burning through the atmosphere of endless night\\n[01:00.00]Dusty vinyl spins reverse\\n[01:03.45]Our polaroid timeline bleeds through the verse\\n[01:07.10]Telescope aimed at dead stars\\n[01:10.65]Still tracing constellations through prison bars\\n[01:14.30]Electric veins pulse through concrete skies\\n[01:17.85]Your name echoes in the hollow where my heartbeat lies\\n[01:21.50]We\'re satellites trapped in parallel light\\n[01:25.05]Burning through the atmosphere of endless night\\n[02:10.00]Clockwork gears grind moonbeams to rust\\n[02:13.50]Our fingerprint smudged by interstellar dust\\n[02:17.15]Velvet thunder rolls through my veins\\n[02:20.70]Chasing phantom trains through solar plane\\n[02:24.35]Electric veins pulse through concrete skies\\n[02:27.90]Your name echoes in the hollow where my heartbeat lies",
      "ref_prompt": "",
      "audio_length": 95,
      "ref_audio_path": "https://replicate.delivery/pbxt/Md2hz8ACgvWtwu2szfoq5WPDM3w3GaM2r9oWKtzZ4inPRch5/jourdelune%20-%20MUSIIIIIIIIIIIC%20-%20Sonauto.wav"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

{
  "completed_at": "2025-03-09T10:14:37.849993Z",
  "created_at": "2025-03-09T10:13:12.494000Z",
  "data_removed": false,
  "error": null,
  "id": "drgq687rnsrg80cnf9j9969amr",
  "input": {
    "lyric": "[00:10.00]Moonlight spills through broken blinds\n[00:13.20]Your shadow dances on the dashboard shrine\n[00:16.85]Neon ghosts in gasoline rain\n[00:20.40]I hear your laughter down the midnight train\n[00:24.15]Static whispers through frayed wires\n[00:27.65]Guitar strings hum our cathedral choirs\n[00:31.30]Flicker screens show reruns of June\n[00:34.90]I'm drowning in this mercury lagoon\n[00:38.55]Electric veins pulse through concrete skies\n[00:42.10]Your name echoes in the hollow where my heartbeat lies\n[00:45.75]We're satellites trapped in parallel light\n[00:49.25]Burning through the atmosphere of endless night\n[01:00.00]Dusty vinyl spins reverse\n[01:03.45]Our polaroid timeline bleeds through the verse\n[01:07.10]Telescope aimed at dead stars\n[01:10.65]Still tracing constellations through prison bars\n[01:14.30]Electric veins pulse through concrete skies\n[01:17.85]Your name echoes in the hollow where my heartbeat lies\n[01:21.50]We're satellites trapped in parallel light\n[01:25.05]Burning through the atmosphere of endless night\n[02:10.00]Clockwork gears grind moonbeams to rust\n[02:13.50]Our fingerprint smudged by interstellar dust\n[02:17.15]Velvet thunder rolls through my veins\n[02:20.70]Chasing phantom trains through solar plane\n[02:24.35]Electric veins pulse through concrete skies\n[02:27.90]Your name echoes in the hollow where my heartbeat lies",
    "audio_length": 95,
    "ref_audio_path": "https://replicate.delivery/pbxt/Md2hz8ACgvWtwu2szfoq5WPDM3w3GaM2r9oWKtzZ4inPRch5/jourdelune%20-%20MUSIIIIIIIIIIIC%20-%20Sonauto.wav"
  },
  "logs": null,
  "metrics": {
    "predict_time": 45.540349418,
    "total_time": 85.355993
  },
  "output": "https://replicate.delivery/czjl/qpMwuQt15ILMB5ludFDGtytiEVszeCzfSl1UZNzaGd8NwxWUA/output.wav",
  "started_at": "2025-03-09T10:13:52.309644Z",
  "status": "succeeded",
  "urls": {
    "stream": "https://stream.replicate.com/v1/files/fddq-csykgp3nispbpszqbm3yrcmuq7t7kdhqclpmme4gd7hiy2kryoza",
    "get": "https://api.replicate.com/v1/predictions/drgq687rnsrg80cnf9j9969amr",
    "cancel": "https://api.replicate.com/v1/predictions/drgq687rnsrg80cnf9j9969amr/cancel"
  },
  "version": "4b0f15c352ce0508a34eaf09f8336f70334240643113a4091fb4f79feb57be03"
}

Generated in

45.5 seconds

Tweak it ShareReport

Run time and cost

This model costs approximately $0.048 to run on Replicate, or 20 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 4 minutes. The predict time for this model varies significantly based on the inputs.

Readme

This model doesn't have a readme.