Failed to load versions. Head to the versions page to see all versions for this model.
You're looking at a specific version of this model. Jump to the model overview.
ttsds /amphion_valle:ea4a4a59
Input
Run this model in Node.js with one line of code:
npm install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import Replicate from "replicate";
const replicate = new Replicate({
auth: process.env.REPLICATE_API_TOKEN,
});
Run ttsds/amphion_valle using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run(
"ttsds/amphion_valle:ea4a4a593f9692b7c796e23f1a4b4cbdd64b346bb67e2185688719ebe5b3a8e2",
{
input: {
text: "The quick brown fox jumped over the lazy dog.",
model: "valle_v1_small",
speaker_reference: "https://replicate.delivery/pbxt/MN7xAi6gE38grU2jIsRpzx43qsVuzPChncdGx6viarnNSXIh/example%281%29.wav"
}
}
);
// To access the file URL:
console.log(output.url()); //=> "http://example.com"
// To write the file to disk:
fs.writeFile("my-image.png", output);
To learn more, take a look at the guide on getting started with Node.js.
pip install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import replicate
Run ttsds/amphion_valle using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"ttsds/amphion_valle:ea4a4a593f9692b7c796e23f1a4b4cbdd64b346bb67e2185688719ebe5b3a8e2",
input={
"text": "The quick brown fox jumped over the lazy dog.",
"model": "valle_v1_small",
"speaker_reference": "https://replicate.delivery/pbxt/MN7xAi6gE38grU2jIsRpzx43qsVuzPChncdGx6viarnNSXIh/example%281%29.wav"
}
)
print(output)
To learn more, take a look at the guide on getting started with Python.
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
Run ttsds/amphion_valle using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-H "Prefer: wait" \
-d $'{
"version": "ttsds/amphion_valle:ea4a4a593f9692b7c796e23f1a4b4cbdd64b346bb67e2185688719ebe5b3a8e2",
"input": {
"text": "The quick brown fox jumped over the lazy dog.",
"model": "valle_v1_small",
"speaker_reference": "https://replicate.delivery/pbxt/MN7xAi6gE38grU2jIsRpzx43qsVuzPChncdGx6viarnNSXIh/example%281%29.wav"
}
}' \
https://api.replicate.com/v1/predictions
To learn more, take a look at Replicate’s HTTP API reference docs.
Add a payment method to run this model.
By signing in, you agree to our
terms of service and privacy policy
Output
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{
"completed_at": "2025-01-23T14:07:31.701266Z",
"created_at": "2025-01-23T14:06:58.347000Z",
"data_removed": false,
"error": null,
"id": "hxzs946h5drmc0cmjdy9mrkq10",
"input": {
"text": "The quick brown fox jumped over the lazy dog.",
"model": "valle_v1_small",
"speaker_reference": "https://replicate.delivery/pbxt/MN7xAi6gE38grU2jIsRpzx43qsVuzPChncdGx6viarnNSXIh/example%281%29.wav"
},
"logs": "Due to a bug fix in https://github.com/huggingface/transformers/pull/28687 transcription using a multilingual Whisper will default to language detection followed by transcription instead of translation to English.This might be a breaking change for your use case. If you want to instead always translate your audio to English, make sure to pass `language='en'`.\n2025-01-23 14:07:29 | WARNING | phonemizer | words count mismatch on 100.0% of the lines (1/1)\n2025-01-23 14:07:29 | WARNING | phonemizer | words count mismatch on 100.0% of the lines (1/1)\nSaved to: /results/cec60fce6376f548b305ab4a0ae800b23c3dcbae7d5355c6f2cfb31043e0a386/single",
"metrics": {
"predict_time": 3.521645611,
"total_time": 33.354266
},
"output": "https://replicate.delivery/xezq/HdJCfGR4tmVveEWIE945GHDXZlokskfqh9Px5LBk12aH5ffgC/test_pred.wav",
"started_at": "2025-01-23T14:07:28.179620Z",
"status": "succeeded",
"urls": {
"stream": "https://stream.replicate.com/v1/files/bcwr-3nrjqoybc7vpdewzgr75mj4nhimkbbct5otvzxm7kqljfyc2sehq",
"get": "https://api.replicate.com/v1/predictions/hxzs946h5drmc0cmjdy9mrkq10",
"cancel": "https://api.replicate.com/v1/predictions/hxzs946h5drmc0cmjdy9mrkq10/cancel"
},
"version": "ea4a4a593f9692b7c796e23f1a4b4cbdd64b346bb67e2185688719ebe5b3a8e2"
}
Due to a bug fix in https://github.com/huggingface/transformers/pull/28687 transcription using a multilingual Whisper will default to language detection followed by transcription instead of translation to English.This might be a breaking change for your use case. If you want to instead always translate your audio to English, make sure to pass `language='en'`.
2025-01-23 14:07:29 | WARNING | phonemizer | words count mismatch on 100.0% of the lines (1/1)
2025-01-23 14:07:29 | WARNING | phonemizer | words count mismatch on 100.0% of the lines (1/1)
Saved to: /results/cec60fce6376f548b305ab4a0ae800b23c3dcbae7d5355c6f2cfb31043e0a386/single