Prediction

turian/multi-task-music-transcription:159965ec81a23b88d50e4636f9539f2cbb6f50503d8f14e915069526b4a9edfb

Model

turian/multi-task-music-transcription:159965ec

8zfxnteamsrj20ck2s6b41kx3w

Status

Succeeded

Source

Web

Hardware

A100 (80GB)

Total duration

1m 47s

Created

6 months ago by @turian

Input

audio_file: Video Player is loading.
Current Time 00:00:000
Duration 00:00:000
Loaded: 0%
Stream Type LIVE
Remaining Time 00:00:000

1x
Chapters
descriptions off, selected
captions settings, opens captions settings dialog
captions off, selected
Beginning of dialog window. Escape will cancel and close the window.
TextColorTransparency
BackgroundColorTransparency
WindowColorTransparency
Font Size
Text Edge Style
Font Family
End of dialog window.
model_type: mt3

{
  "audio_file": "https://replicate.delivery/pbxt/LwqzMVvrrQGdaOgpRrwpLYaNdEoAfQBCvB8mxptn0aRqF6nH/762258__lolamoore__energetic-indie-rock-track-with-uplifting-vibes.mp3",
  "model_type": "mt3"
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run turian/multi-task-music-transcription using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "turian/multi-task-music-transcription:159965ec81a23b88d50e4636f9539f2cbb6f50503d8f14e915069526b4a9edfb",
  {
    input: {
      audio_file: "https://replicate.delivery/pbxt/LwqzMVvrrQGdaOgpRrwpLYaNdEoAfQBCvB8mxptn0aRqF6nH/762258__lolamoore__energetic-indie-rock-track-with-uplifting-vibes.mp3",
      model_type: "mt3"
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run turian/multi-task-music-transcription using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "turian/multi-task-music-transcription:159965ec81a23b88d50e4636f9539f2cbb6f50503d8f14e915069526b4a9edfb",
    input={
        "audio_file": "https://replicate.delivery/pbxt/LwqzMVvrrQGdaOgpRrwpLYaNdEoAfQBCvB8mxptn0aRqF6nH/762258__lolamoore__energetic-indie-rock-track-with-uplifting-vibes.mp3",
        "model_type": "mt3"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run turian/multi-task-music-transcription using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "turian/multi-task-music-transcription:159965ec81a23b88d50e4636f9539f2cbb6f50503d8f14e915069526b4a9edfb",
    "input": {
      "audio_file": "https://replicate.delivery/pbxt/LwqzMVvrrQGdaOgpRrwpLYaNdEoAfQBCvB8mxptn0aRqF6nH/762258__lolamoore__energetic-indie-rock-track-with-uplifting-vibes.mp3",
      "model_type": "mt3"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

transcription.mid

{
  "completed_at": "2024-11-10T13:40:58.355443Z",
  "created_at": "2024-11-10T13:39:11.654000Z",
  "data_removed": false,
  "error": null,
  "id": "8zfxnteamsrj20ck2s6b41kx3w",
  "input": {
    "audio_file": "https://replicate.delivery/pbxt/LwqzMVvrrQGdaOgpRrwpLYaNdEoAfQBCvB8mxptn0aRqF6nH/762258__lolamoore__energetic-indie-rock-track-with-uplifting-vibes.mp3",
    "model_type": "mt3"
  },
  "logs": "2024-11-10 13:40:23.646358: I tensorflow/core/common_runtime/gpu/gpu_device.cc:2021] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 79091 MB memory:  -> device: 0, name: NVIDIA A100-SXM4-80GB, pci bus id: 0000:57:00.0, compute capability: 8.0\nWARNING:tensorflow:From /root/.pyenv/versions/3.10.14/lib/python3.10/site-packages/tensorflow/python/util/nest_util.py:1105: _RandomDataset.__init__ (from tensorflow.python.data.experimental.ops.random_ops) is deprecated and will be removed in a future version.\nInstructions for updating:\nUse `tf.data.Dataset.random(...)`.\nWARNING:tensorflow:From /root/.pyenv/versions/3.10.14/lib/python3.10/site-packages/tensorflow/python/util/nest_util.py:1105: _RandomDataset.__init__ (from tensorflow.python.data.experimental.ops.random_ops) is deprecated and will be removed in a future version.\nInstructions for updating:\nUse `tf.data.Dataset.random(...)`.\n2024-11-10 13:40:58.294195: I tensorflow/core/framework/local_rendezvous.cc:404] Local rendezvous is aborting with status: OUT_OF_RANGE: End of sequence",
  "metrics": {
    "predict_time": 46.736935895,
    "total_time": 106.701443
  },
  "output": "https://replicate.delivery/yhqm/O906xRhF5fTxA6PnzFFEbgHnqgYwe0fC90hax1sFMxVVPNfOB/transcription.mid",
  "started_at": "2024-11-10T13:40:11.618507Z",
  "status": "succeeded",
  "urls": {
    "stream": "https://stream.replicate.com/v1/files/qoxq-thajbc65d4ur7fnfbvstbjdx2b2jmg3frahy4ubfms7ycxzduywq",
    "get": "https://api.replicate.com/v1/predictions/8zfxnteamsrj20ck2s6b41kx3w",
    "cancel": "https://api.replicate.com/v1/predictions/8zfxnteamsrj20ck2s6b41kx3w/cancel"
  },
  "version": "159965ec81a23b88d50e4636f9539f2cbb6f50503d8f14e915069526b4a9edfb"
}

Generated in

46.7 seconds

Tweak it ShareReport

Want to make some of these yourself?

Run this model