Caption an audio
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
Audio to caption
Run this model in Node.js with one line of code:
npm install replicate
REPLICATE_API_TOKEN
export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });
Run pipi32167/msclap using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "pipi32167/msclap:6570a71af2a5cb0fc273ad4cd257d34fe05754e2b83fce477f89ba8479f014f4", { input: { audio: "https://replicate.delivery/pbxt/Jvr1UiU9RQT9sdxtVDxo7T5FDxQTPNG0MWb05773rrKWLTQG/game.wav" } } ); console.log(output);
To learn more, take a look at the guide on getting started with Node.js.
pip install replicate
import replicate
output = replicate.run( "pipi32167/msclap:6570a71af2a5cb0fc273ad4cd257d34fe05754e2b83fce477f89ba8479f014f4", input={ "audio": "https://replicate.delivery/pbxt/Jvr1UiU9RQT9sdxtVDxo7T5FDxQTPNG0MWb05773rrKWLTQG/game.wav" } ) print(output)
To learn more, take a look at the guide on getting started with Python.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "pipi32167/msclap:6570a71af2a5cb0fc273ad4cd257d34fe05754e2b83fce477f89ba8479f014f4", "input": { "audio": "https://replicate.delivery/pbxt/Jvr1UiU9RQT9sdxtVDxo7T5FDxQTPNG0MWb05773rrKWLTQG/game.wav" } }' \ https://api.replicate.com/v1/predictions
To learn more, take a look at Replicate’s HTTP API reference docs.
{ "completed_at": "2023-11-24T09:56:48.630059Z", "created_at": "2023-11-24T09:56:47.656073Z", "data_removed": false, "error": null, "id": "owjptgzbxckck63zeuux5z65zm", "input": { "audio": "https://replicate.delivery/pbxt/Jvr1UiU9RQT9sdxtVDxo7T5FDxQTPNG0MWb05773rrKWLTQG/game.wav" }, "logs": null, "metrics": { "predict_time": 0.957808, "total_time": 0.973986 }, "output": "A synthesizer is playing a melody. ", "started_at": "2023-11-24T09:56:47.672251Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/owjptgzbxckck63zeuux5z65zm", "cancel": "https://api.replicate.com/v1/predictions/owjptgzbxckck63zeuux5z65zm/cancel" }, "version": "6570a71af2a5cb0fc273ad4cd257d34fe05754e2b83fce477f89ba8479f014f4" }
This model runs on Nvidia T4 GPU hardware. We don't yet have enough runs of this model to provide performance information.
This model doesn't have a readme.
Create a music by an image
Caption any images.
Chat with image or video.
This model is cold. You'll get a fast response if the model is warm and already running, and a slower response if the model is cold and starting up.
Choose a file from your machine
Hint: you can also drag files onto the input