adirik/styletts2:53fd5081 | Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

adirik /styletts2:53fd5081

Input

text

*string

Shift + Return to add a new line

StyleTTS 2 is a text-to-speech model that leverages style diffusion and adversarial training with large speech language models to achieve human-level text-to-speech synthesis.StyleTTS 2 is a text-to-speech model that leverages style diffusion and adversarial training with large speech language models to achieve human-level text-to-speech synthesis.

Text to convert to speech

reference

file

Reference speech to copy style from

alpha

number

(minimum: 0, maximum: 1)

Only used for long text inputs or in case of reference speaker, determines the timbre of the speaker. Use lower values to sample style based on previous or reference speech instead of text.

Default: 0.3

beta

number

(minimum: 0, maximum: 1)

Only used for long text inputs or in case of reference speaker, determines the prosody of the speaker. Use lower values to sample style based on previous or reference speech instead of text.

Default: 0.7

diffusion_steps

integer

(minimum: 0, maximum: 50)

Number of diffusion steps

Default: 10

embedding_scale

number

(minimum: 0, maximum: 5)

Embedding scale, use higher values for pronounced emotion

Default: 1

seed

integer

Seed for reproducibility

Default: 0

Run this model in Node.js with one line of code:

npx create-replicate --model=adirik/styletts2

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";
import fs from "node:fs";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run adirik/styletts2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "adirik/styletts2:53fd5081feae9440974d1ef9cae83bf7af5fe18be1646343f37e559f5f80a613",
  {
    input: {
      beta: 0.7,
      seed: 0,
      text: "StyleTTS 2 is a text-to-speech model that leverages style diffusion and adversarial training with large speech language models to achieve human-level text-to-speech synthesis.",
      alpha: 0.3,
      diffusion_steps: 10,
      embedding_scale: 1.5
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run adirik/styletts2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "adirik/styletts2:53fd5081feae9440974d1ef9cae83bf7af5fe18be1646343f37e559f5f80a613",
    input={
        "beta": 0.7,
        "seed": 0,
        "text": "StyleTTS 2 is a text-to-speech model that leverages style diffusion and adversarial training with large speech language models to achieve human-level text-to-speech synthesis.",
        "alpha": 0.3,
        "diffusion_steps": 10,
        "embedding_scale": 1.5
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run adirik/styletts2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "adirik/styletts2:53fd5081feae9440974d1ef9cae83bf7af5fe18be1646343f37e559f5f80a613",
    "input": {
      "beta": 0.7,
      "seed": 0,
      "text": "StyleTTS 2 is a text-to-speech model that leverages style diffusion and adversarial training with large speech language models to achieve human-level text-to-speech synthesis.",
      "alpha": 0.3,
      "diffusion_steps": 10,
      "embedding_scale": 1.5
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/adirik/styletts2@sha256:53fd5081feae9440974d1ef9cae83bf7af5fe18be1646343f37e559f5f80a613 \
  -i 'beta=0.7' \
  -i 'seed=0' \
  -i 'text="StyleTTS 2 is a text-to-speech model that leverages style diffusion and adversarial training with large speech language models to achieve human-level text-to-speech synthesis."' \
  -i 'alpha=0.3' \
  -i 'diffusion_steps=10' \
  -i 'embedding_scale=1.5'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/adirik/styletts2@sha256:53fd5081feae9440974d1ef9cae83bf7af5fe18be1646343f37e559f5f80a613
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "beta": 0.7,
      "seed": 0,
      "text": "StyleTTS 2 is a text-to-speech model that leverages style diffusion and adversarial training with large speech language models to achieve human-level text-to-speech synthesis.",
      "alpha": 0.3,
      "diffusion_steps": 10,
      "embedding_scale": 1.5
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

Generated in

5.4 seconds

Tweak itReport View full prediction