music-and-culture-technology-lab
/
omnizart
democratizing automatic music transcription
Prediction
music-and-culture-technology-lab/omnizart:5e20380eID4qapsvz3jjcqbi3eennld2bdlqStatusSucceededSourceWebHardware–Total durationCreatedInput
- mode
- vocal
- audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "mode": "vocal", "audio": "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" }Install Replicate’s Node.js client library:npm install replicateSet theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "music-and-culture-technology-lab/omnizart:5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", { input: { mode: "vocal", audio: "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateSet theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the client:import replicateRun music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "music-and-culture-technology-lab/omnizart:5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", input={ "mode": "vocal", "audio": "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" } ) # The music-and-culture-technology-lab/omnizart model can stream output as it's running. # The predict method returns an iterator, and you can iterate over that output. for item in output: # https://replicate.com/music-and-culture-technology-lab/omnizart/api#output-schema print(item)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", "input": { "mode": "vocal", "audio": "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "completed_at": "2021-12-13T18:04:30.908886Z", "created_at": "2021-12-13T17:59:40.430654Z", "data_removed": false, "error": null, "id": "4qapsvz3jjcqbi3eennld2bdlq", "input": { "mode": "vocal", "audio": "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" }, "logs": "Progress: 1/76\nProgress: 2/76\nProgress: 3/76\nProgress: 4/76\nProgress: 5/76\nProgress: 6/76\nProgress: 7/76\nProgress: 8/76\nProgress: 9/76\nProgress: 10/76\nProgress: 11/76\nProgress: 12/76\nProgress: 13/76\nProgress: 14/76\nProgress: 15/76\nProgress: 16/76\nProgress: 17/76\nProgress: 18/76\nProgress: 19/76\nProgress: 20/76\nProgress: 21/76\nProgress: 22/76\nProgress: 23/76\nProgress: 24/76\nProgress: 25/76\nProgress: 26/76\nProgress: 27/76\nProgress: 28/76\nProgress: 29/76\nProgress: 30/76\nProgress: 31/76\nProgress: 32/76\nProgress: 33/76\nProgress: 34/76\nProgress: 35/76\nProgress: 36/76\nProgress: 37/76\nProgress: 38/76\nProgress: 39/76\nProgress: 40/76\nProgress: 41/76\nProgress: 42/76\nProgress: 43/76\nProgress: 44/76\nProgress: 45/76\nProgress: 46/76\nProgress: 47/76\nProgress: 48/76\nProgress: 49/76\nProgress: 50/76\nProgress: 51/76\nProgress: 52/76\nProgress: 53/76\nProgress: 54/76\nProgress: 55/76\nProgress: 56/76\nProgress: 57/76\nProgress: 58/76\nProgress: 59/76\nProgress: 60/76\nProgress: 61/76\nProgress: 62/76\nProgress: 63/76\nProgress: 64/76\nProgress: 65/76\nProgress: 66/76\nProgress: 67/76\nProgress: 68/76\nProgress: 69/76\nProgress: 70/76\nProgress: 71/76\nProgress: 72/76\nProgress: 73/76\nProgress: 74/76\nProgress: 75/76\nProgress: 76/76\nbatch: 1/122\nbatch: 2/122\nbatch: 3/122\nbatch: 4/122\nbatch: 5/122\nbatch: 6/122\nbatch: 7/122\nbatch: 8/122\nbatch: 9/122\nbatch: 10/122\nbatch: 11/122\nbatch: 12/122\nbatch: 13/122\nbatch: 14/122\nbatch: 15/122\nbatch: 16/122\nbatch: 17/122\nbatch: 18/122\nbatch: 19/122\nbatch: 20/122\nbatch: 21/122\nbatch: 22/122\nbatch: 23/122\nbatch: 24/122\nbatch: 25/122\nbatch: 26/122\nbatch: 27/122\nbatch: 28/122\nbatch: 29/122\nbatch: 30/122\nbatch: 31/122\nbatch: 32/122\nbatch: 33/122\nbatch: 34/122\nbatch: 35/122\nbatch: 36/122\nbatch: 37/122\nbatch: 38/122\nbatch: 39/122\nbatch: 40/122\nbatch: 41/122\nbatch: 42/122\nbatch: 43/122\nbatch: 44/122\nbatch: 45/122\nbatch: 46/122\nbatch: 47/122\nbatch: 48/122\nbatch: 49/122\nbatch: 50/122\nbatch: 51/122\nbatch: 52/122\nbatch: 53/122\nbatch: 54/122\nbatch: 55/122\nbatch: 56/122\nbatch: 57/122\nbatch: 58/122\nbatch: 59/122\nbatch: 60/122\nbatch: 61/122\nbatch: 62/122\nbatch: 63/122\nbatch: 64/122\nbatch: 65/122\nbatch: 66/122\nbatch: 67/122\nbatch: 68/122\nbatch: 69/122\nbatch: 70/122\nbatch: 71/122\nbatch: 72/122\nbatch: 73/122\nbatch: 74/122\nbatch: 75/122\nbatch: 76/122\nbatch: 77/122\nbatch: 78/122\nbatch: 79/122\nbatch: 80/122\nbatch: 81/122\nbatch: 82/122\nbatch: 83/122\nbatch: 84/122\nbatch: 85/122\nbatch: 86/122\nbatch: 87/122\nbatch: 88/122\nbatch: 89/122\nbatch: 90/122\nbatch: 91/122\nbatch: 92/122\nbatch: 93/122\nbatch: 94/122\nbatch: 95/122\nbatch: 96/122\nbatch: 97/122\nbatch: 98/122\nbatch: 99/122\nbatch: 100/122\nbatch: 101/122\nbatch: 102/122\nbatch: 103/122\nbatch: 104/122\nbatch: 105/122\nbatch: 106/122\nbatch: 107/122\nbatch: 108/122\nbatch: 109/122\nbatch: 110/122\nbatch: 111/122\nbatch: 112/122\nbatch: 113/122\nbatch: 114/122\nbatch: 115/122\nbatch: 116/122\nbatch: 117/122\nbatch: 118/122\nbatch: 119/122\nbatch: 120/122\nbatch: 121/122\nbatch: 122/122\nSynthesizing MIDI...", "metrics": { "predict_time": 195.841577, "total_time": 290.478232 }, "output": [ { "file": "https://replicate.delivery/mgxm/63872dcd-8507-460b-b4a0-c06e903c7beb/out.mp3" } ], "started_at": "2021-12-13T18:01:15.067309Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/4qapsvz3jjcqbi3eennld2bdlq", "cancel": "https://api.replicate.com/v1/predictions/4qapsvz3jjcqbi3eennld2bdlq/cancel" }, "version": "bfdf25151eb31b6f155d8149f32386d02148dcf975819b1857b42d02bc931184" }Generated inProgress: 1/76 Progress: 2/76 Progress: 3/76 Progress: 4/76 Progress: 5/76 Progress: 6/76 Progress: 7/76 Progress: 8/76 Progress: 9/76 Progress: 10/76 Progress: 11/76 Progress: 12/76 Progress: 13/76 Progress: 14/76 Progress: 15/76 Progress: 16/76 Progress: 17/76 Progress: 18/76 Progress: 19/76 Progress: 20/76 Progress: 21/76 Progress: 22/76 Progress: 23/76 Progress: 24/76 Progress: 25/76 Progress: 26/76 Progress: 27/76 Progress: 28/76 Progress: 29/76 Progress: 30/76 Progress: 31/76 Progress: 32/76 Progress: 33/76 Progress: 34/76 Progress: 35/76 Progress: 36/76 Progress: 37/76 Progress: 38/76 Progress: 39/76 Progress: 40/76 Progress: 41/76 Progress: 42/76 Progress: 43/76 Progress: 44/76 Progress: 45/76 Progress: 46/76 Progress: 47/76 Progress: 48/76 Progress: 49/76 Progress: 50/76 Progress: 51/76 Progress: 52/76 Progress: 53/76 Progress: 54/76 Progress: 55/76 Progress: 56/76 Progress: 57/76 Progress: 58/76 Progress: 59/76 Progress: 60/76 Progress: 61/76 Progress: 62/76 Progress: 63/76 Progress: 64/76 Progress: 65/76 Progress: 66/76 Progress: 67/76 Progress: 68/76 Progress: 69/76 Progress: 70/76 Progress: 71/76 Progress: 72/76 Progress: 73/76 Progress: 74/76 Progress: 75/76 Progress: 76/76 batch: 1/122 batch: 2/122 batch: 3/122 batch: 4/122 batch: 5/122 batch: 6/122 batch: 7/122 batch: 8/122 batch: 9/122 batch: 10/122 batch: 11/122 batch: 12/122 batch: 13/122 batch: 14/122 batch: 15/122 batch: 16/122 batch: 17/122 batch: 18/122 batch: 19/122 batch: 20/122 batch: 21/122 batch: 22/122 batch: 23/122 batch: 24/122 batch: 25/122 batch: 26/122 batch: 27/122 batch: 28/122 batch: 29/122 batch: 30/122 batch: 31/122 batch: 32/122 batch: 33/122 batch: 34/122 batch: 35/122 batch: 36/122 batch: 37/122 batch: 38/122 batch: 39/122 batch: 40/122 batch: 41/122 batch: 42/122 batch: 43/122 batch: 44/122 batch: 45/122 batch: 46/122 batch: 47/122 batch: 48/122 batch: 49/122 batch: 50/122 batch: 51/122 batch: 52/122 batch: 53/122 batch: 54/122 batch: 55/122 batch: 56/122 batch: 57/122 batch: 58/122 batch: 59/122 batch: 60/122 batch: 61/122 batch: 62/122 batch: 63/122 batch: 64/122 batch: 65/122 batch: 66/122 batch: 67/122 batch: 68/122 batch: 69/122 batch: 70/122 batch: 71/122 batch: 72/122 batch: 73/122 batch: 74/122 batch: 75/122 batch: 76/122 batch: 77/122 batch: 78/122 batch: 79/122 batch: 80/122 batch: 81/122 batch: 82/122 batch: 83/122 batch: 84/122 batch: 85/122 batch: 86/122 batch: 87/122 batch: 88/122 batch: 89/122 batch: 90/122 batch: 91/122 batch: 92/122 batch: 93/122 batch: 94/122 batch: 95/122 batch: 96/122 batch: 97/122 batch: 98/122 batch: 99/122 batch: 100/122 batch: 101/122 batch: 102/122 batch: 103/122 batch: 104/122 batch: 105/122 batch: 106/122 batch: 107/122 batch: 108/122 batch: 109/122 batch: 110/122 batch: 111/122 batch: 112/122 batch: 113/122 batch: 114/122 batch: 115/122 batch: 116/122 batch: 117/122 batch: 118/122 batch: 119/122 batch: 120/122 batch: 121/122 batch: 122/122 Synthesizing MIDI...Prediction
music-and-culture-technology-lab/omnizart:5e20380eInput
- mode
- drum
- audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "mode": "drum", "audio": "https://replicate.delivery/mgxm/87e8e050-67dc-4b13-84b7-13821a160347/file_example_MP3_700KB.mp3" }Install Replicate’s Node.js client library:npm install replicateSet theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "music-and-culture-technology-lab/omnizart:5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", { input: { mode: "drum", audio: "https://replicate.delivery/mgxm/87e8e050-67dc-4b13-84b7-13821a160347/file_example_MP3_700KB.mp3" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateSet theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the client:import replicateRun music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "music-and-culture-technology-lab/omnizart:5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", input={ "mode": "drum", "audio": "https://replicate.delivery/mgxm/87e8e050-67dc-4b13-84b7-13821a160347/file_example_MP3_700KB.mp3" } ) # The music-and-culture-technology-lab/omnizart model can stream output as it's running. # The predict method returns an iterator, and you can iterate over that output. for item in output: # https://replicate.com/music-and-culture-technology-lab/omnizart/api#output-schema print(item)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", "input": { "mode": "drum", "audio": "https://replicate.delivery/mgxm/87e8e050-67dc-4b13-84b7-13821a160347/file_example_MP3_700KB.mp3" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "completed_at": "2021-12-13T18:07:14.292153Z", "created_at": "2021-12-13T18:05:57.156140Z", "data_removed": false, "error": null, "id": "lqmjou3spzbuhpfwtutred2isq", "input": { "mode": "drum", "audio": "https://replicate.delivery/mgxm/87e8e050-67dc-4b13-84b7-13821a160347/file_example_MP3_700KB.mp3" }, "logs": "Caught SIGTERM, exiting...\n/root/.pyenv/versions/3.8.12/lib/python3.8/site-packages/numpy/core/_asarray.py:83: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray\n return array(a, dtype, copy=False, order=order)\nCaught SIGTERM, exiting...\n/root/.pyenv/versions/3.8.12/lib/python3.8/site-packages/numpy/core/_asarray.py:83: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray\n return array(a, dtype, copy=False, order=order)\n1/16\n2/16\n3/16\n4/16\n5/16\n6/16\n7/16\n8/16\n9/16\n10/16\n11/16\n12/16\n13/16\n14/16\n15/16\n16/16\nSynthesizing MIDI...", "metrics": { "predict_time": 32.460797, "total_time": 77.136013 }, "output": [ { "file": "https://replicate.delivery/mgxm/1b3f4af8-d945-4f23-a9fd-1057e6e9c99e/out.mp3" } ], "started_at": "2021-12-13T18:06:41.831356Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/lqmjou3spzbuhpfwtutred2isq", "cancel": "https://api.replicate.com/v1/predictions/lqmjou3spzbuhpfwtutred2isq/cancel" }, "version": "bfdf25151eb31b6f155d8149f32386d02148dcf975819b1857b42d02bc931184" }Generated inCaught SIGTERM, exiting... /root/.pyenv/versions/3.8.12/lib/python3.8/site-packages/numpy/core/_asarray.py:83: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray return array(a, dtype, copy=False, order=order) Caught SIGTERM, exiting... /root/.pyenv/versions/3.8.12/lib/python3.8/site-packages/numpy/core/_asarray.py:83: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray return array(a, dtype, copy=False, order=order) 1/16 2/16 3/16 4/16 5/16 6/16 7/16 8/16 9/16 10/16 11/16 12/16 13/16 14/16 15/16 16/16 Synthesizing MIDI...Prediction
music-and-culture-technology-lab/omnizart:5e20380eIDzrx7ckvx3jfojpbc2euqspjoaeStatusSucceededSourceWebHardware–Total durationCreatedInput
- mode
- vocal-contour
- audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "mode": "vocal-contour", "audio": "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" }Install Replicate’s Node.js client library:npm install replicateSet theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "music-and-culture-technology-lab/omnizart:5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", { input: { mode: "vocal-contour", audio: "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateSet theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the client:import replicateRun music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "music-and-culture-technology-lab/omnizart:5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", input={ "mode": "vocal-contour", "audio": "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" } ) # The music-and-culture-technology-lab/omnizart model can stream output as it's running. # The predict method returns an iterator, and you can iterate over that output. for item in output: # https://replicate.com/music-and-culture-technology-lab/omnizart/api#output-schema print(item)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", "input": { "mode": "vocal-contour", "audio": "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "completed_at": "2021-12-13T17:55:23.369634Z", "created_at": "2021-12-13T17:51:55.360556Z", "data_removed": false, "error": null, "id": "zrx7ckvx3jfojpbc2euqspjoae", "input": { "mode": "vocal-contour", "audio": "https://replicate.delivery/mgxm/278c6a44-9487-4910-8e9c-d58b715b6572/sample.mp3" }, "logs": "batch: 1/122\nbatch: 2/122\nbatch: 3/122\nbatch: 4/122\nbatch: 5/122\nbatch: 6/122\nbatch: 7/122\nbatch: 8/122\nbatch: 9/122\nbatch: 10/122\nbatch: 11/122\nbatch: 12/122\nbatch: 13/122\nbatch: 14/122\nbatch: 15/122\nbatch: 16/122\nbatch: 17/122\nbatch: 18/122\nbatch: 19/122\nbatch: 20/122\nbatch: 21/122\nbatch: 22/122\nbatch: 23/122\nbatch: 24/122\nbatch: 25/122\nbatch: 26/122\nbatch: 27/122\nbatch: 28/122\nbatch: 29/122\nbatch: 30/122\nbatch: 31/122\nbatch: 32/122\nbatch: 33/122\nbatch: 34/122\nbatch: 35/122\nbatch: 36/122\nbatch: 37/122\nbatch: 38/122\nbatch: 39/122\nbatch: 40/122\nbatch: 41/122\nbatch: 42/122\nbatch: 43/122\nbatch: 44/122\nbatch: 45/122\nbatch: 46/122\nbatch: 47/122\nbatch: 48/122\nbatch: 49/122\nbatch: 50/122\nbatch: 51/122\nbatch: 52/122\nbatch: 53/122\nbatch: 54/122\nbatch: 55/122\nbatch: 56/122\nbatch: 57/122\nbatch: 58/122\nbatch: 59/122\nbatch: 60/122\nbatch: 61/122\nbatch: 62/122\nbatch: 63/122\nbatch: 64/122\nbatch: 65/122\nbatch: 66/122\nbatch: 67/122\nbatch: 68/122\nbatch: 69/122\nbatch: 70/122\nbatch: 71/122\nbatch: 72/122\nbatch: 73/122\nbatch: 74/122\nbatch: 75/122\nbatch: 76/122\nbatch: 77/122\nbatch: 78/122\nbatch: 79/122\nbatch: 80/122\nbatch: 81/122\nbatch: 82/122\nbatch: 83/122\nbatch: 84/122\nbatch: 85/122\nbatch: 86/122\nbatch: 87/122\nbatch: 88/122\nbatch: 89/122\nbatch: 90/122\nbatch: 91/122\nbatch: 92/122\nbatch: 93/122\nbatch: 94/122\nbatch: 95/122\nbatch: 96/122\nbatch: 97/122\nbatch: 98/122\nbatch: 99/122\nbatch: 100/122\nbatch: 101/122\nbatch: 102/122\nbatch: 103/122\nbatch: 104/122\nbatch: 105/122\nbatch: 106/122\nbatch: 107/122\nbatch: 108/122\nbatch: 109/122\nbatch: 110/122\nbatch: 111/122\nbatch: 112/122\nbatch: 113/122\nbatch: 114/122\nbatch: 115/122\nbatch: 116/122\nbatch: 117/122\nbatch: 118/122\nbatch: 119/122\nbatch: 120/122\nbatch: 121/122\nbatch: 122/122", "metrics": { "predict_time": 136.304734, "total_time": 208.009078 }, "output": [ { "file": "https://replicate.delivery/mgxm/8eb7caba-6774-44f3-8969-c29012c3d8ee/out.mp3" } ], "started_at": "2021-12-13T17:53:07.064900Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/zrx7ckvx3jfojpbc2euqspjoae", "cancel": "https://api.replicate.com/v1/predictions/zrx7ckvx3jfojpbc2euqspjoae/cancel" }, "version": "bfdf25151eb31b6f155d8149f32386d02148dcf975819b1857b42d02bc931184" }Generated inbatch: 1/122 batch: 2/122 batch: 3/122 batch: 4/122 batch: 5/122 batch: 6/122 batch: 7/122 batch: 8/122 batch: 9/122 batch: 10/122 batch: 11/122 batch: 12/122 batch: 13/122 batch: 14/122 batch: 15/122 batch: 16/122 batch: 17/122 batch: 18/122 batch: 19/122 batch: 20/122 batch: 21/122 batch: 22/122 batch: 23/122 batch: 24/122 batch: 25/122 batch: 26/122 batch: 27/122 batch: 28/122 batch: 29/122 batch: 30/122 batch: 31/122 batch: 32/122 batch: 33/122 batch: 34/122 batch: 35/122 batch: 36/122 batch: 37/122 batch: 38/122 batch: 39/122 batch: 40/122 batch: 41/122 batch: 42/122 batch: 43/122 batch: 44/122 batch: 45/122 batch: 46/122 batch: 47/122 batch: 48/122 batch: 49/122 batch: 50/122 batch: 51/122 batch: 52/122 batch: 53/122 batch: 54/122 batch: 55/122 batch: 56/122 batch: 57/122 batch: 58/122 batch: 59/122 batch: 60/122 batch: 61/122 batch: 62/122 batch: 63/122 batch: 64/122 batch: 65/122 batch: 66/122 batch: 67/122 batch: 68/122 batch: 69/122 batch: 70/122 batch: 71/122 batch: 72/122 batch: 73/122 batch: 74/122 batch: 75/122 batch: 76/122 batch: 77/122 batch: 78/122 batch: 79/122 batch: 80/122 batch: 81/122 batch: 82/122 batch: 83/122 batch: 84/122 batch: 85/122 batch: 86/122 batch: 87/122 batch: 88/122 batch: 89/122 batch: 90/122 batch: 91/122 batch: 92/122 batch: 93/122 batch: 94/122 batch: 95/122 batch: 96/122 batch: 97/122 batch: 98/122 batch: 99/122 batch: 100/122 batch: 101/122 batch: 102/122 batch: 103/122 batch: 104/122 batch: 105/122 batch: 106/122 batch: 107/122 batch: 108/122 batch: 109/122 batch: 110/122 batch: 111/122 batch: 112/122 batch: 113/122 batch: 114/122 batch: 115/122 batch: 116/122 batch: 117/122 batch: 118/122 batch: 119/122 batch: 120/122 batch: 121/122 batch: 122/122Prediction
music-and-culture-technology-lab/omnizart:5e20380eIDqshs2emlgjeubcw4nyypypqt5uStatusSucceededSourceWebHardware–Total durationCreatedInput
- mode
- music-piano
- audio
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "mode": "music-piano", "audio": "https://replicate.delivery/mgxm/32a1e898-f9cb-4dfc-95b9-f8f764fcc896/file_example_MP3_700KB.mp3" }Install Replicate’s Node.js client library:npm install replicateSet theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the client:import Replicate from "replicate"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "music-and-culture-technology-lab/omnizart:5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", { input: { mode: "music-piano", audio: "https://replicate.delivery/mgxm/32a1e898-f9cb-4dfc-95b9-f8f764fcc896/file_example_MP3_700KB.mp3" } } ); console.log(output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateSet theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the client:import replicateRun music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "music-and-culture-technology-lab/omnizart:5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", input={ "mode": "music-piano", "audio": "https://replicate.delivery/mgxm/32a1e898-f9cb-4dfc-95b9-f8f764fcc896/file_example_MP3_700KB.mp3" } ) # The music-and-culture-technology-lab/omnizart model can stream output as it's running. # The predict method returns an iterator, and you can iterate over that output. for item in output: # https://replicate.com/music-and-culture-technology-lab/omnizart/api#output-schema print(item)To learn more, take a look at the guide on getting started with Python.
Set theREPLICATE_API_TOKENenvironment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run music-and-culture-technology-lab/omnizart using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "5e20380e1f92837bfc9f17a5d88e46e4a18d094654a748bac32646b71cc70aaf", "input": { "mode": "music-piano", "audio": "https://replicate.delivery/mgxm/32a1e898-f9cb-4dfc-95b9-f8f764fcc896/file_example_MP3_700KB.mp3" } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "completed_at": "2021-12-13T18:08:48.978118Z", "created_at": "2021-12-13T18:08:26.371760Z", "data_removed": false, "error": null, "id": "qshs2emlgjeubcw4nyypypqt5u", "input": { "mode": "music-piano", "audio": "https://replicate.delivery/mgxm/32a1e898-f9cb-4dfc-95b9-f8f764fcc896/file_example_MP3_700KB.mp3" }, "logs": "1/6\n2/6\n3/6\n4/6\n5/6\n6/6\nPitch: 1/88\nPitch: 2/88\nPitch: 3/88\nPitch: 4/88\nPitch: 5/88\nPitch: 6/88\nPitch: 7/88\nPitch: 8/88\nPitch: 9/88\nPitch: 10/88\nPitch: 11/88\nPitch: 12/88\nPitch: 13/88\nPitch: 14/88\nPitch: 15/88\nPitch: 16/88\nPitch: 17/88\nPitch: 18/88\nPitch: 19/88\nPitch: 20/88\nPitch: 21/88\nPitch: 22/88\nPitch: 23/88\nPitch: 24/88\nPitch: 25/88\nPitch: 26/88\nPitch: 27/88\nPitch: 28/88\nPitch: 29/88\nPitch: 30/88\nPitch: 31/88\nPitch: 32/88\nPitch: 33/88\nPitch: 34/88\nPitch: 35/88\nPitch: 36/88\nPitch: 37/88\nPitch: 38/88\nPitch: 39/88\nPitch: 40/88\nPitch: 41/88\nPitch: 42/88\nPitch: 43/88\nPitch: 44/88\nPitch: 45/88\nPitch: 46/88\nPitch: 47/88\nPitch: 48/88\nPitch: 49/88\nPitch: 50/88\nPitch: 51/88\nPitch: 52/88\nPitch: 53/88\nPitch: 54/88\nPitch: 55/88\nPitch: 56/88\nPitch: 57/88\nPitch: 58/88\nPitch: 59/88\nPitch: 60/88\nPitch: 61/88\nPitch: 62/88\nPitch: 63/88\nPitch: 64/88\nPitch: 65/88\nPitch: 66/88\nPitch: 67/88\nPitch: 68/88\nPitch: 69/88\nPitch: 70/88\nPitch: 71/88\nPitch: 72/88\nPitch: 73/88\nPitch: 74/88\nPitch: 75/88\nPitch: 76/88\nPitch: 77/88\nPitch: 78/88\nPitch: 79/88\nPitch: 80/88\nPitch: 81/88\nPitch: 82/88\nPitch: 83/88\nPitch: 84/88\nPitch: 85/88\nPitch: 86/88\nPitch: 87/88\nPitch: 88/88\nSynthesizing MIDI...", "metrics": { "predict_time": 22.131439, "total_time": 22.606358 }, "output": [ { "file": "https://replicate.delivery/mgxm/e82a0852-95ee-4ea4-9ffc-cdc92da4da0d/out.mp3" } ], "started_at": "2021-12-13T18:08:26.846679Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/qshs2emlgjeubcw4nyypypqt5u", "cancel": "https://api.replicate.com/v1/predictions/qshs2emlgjeubcw4nyypypqt5u/cancel" }, "version": "bfdf25151eb31b6f155d8149f32386d02148dcf975819b1857b42d02bc931184" }Generated in1/6 2/6 3/6 4/6 5/6 6/6 Pitch: 1/88 Pitch: 2/88 Pitch: 3/88 Pitch: 4/88 Pitch: 5/88 Pitch: 6/88 Pitch: 7/88 Pitch: 8/88 Pitch: 9/88 Pitch: 10/88 Pitch: 11/88 Pitch: 12/88 Pitch: 13/88 Pitch: 14/88 Pitch: 15/88 Pitch: 16/88 Pitch: 17/88 Pitch: 18/88 Pitch: 19/88 Pitch: 20/88 Pitch: 21/88 Pitch: 22/88 Pitch: 23/88 Pitch: 24/88 Pitch: 25/88 Pitch: 26/88 Pitch: 27/88 Pitch: 28/88 Pitch: 29/88 Pitch: 30/88 Pitch: 31/88 Pitch: 32/88 Pitch: 33/88 Pitch: 34/88 Pitch: 35/88 Pitch: 36/88 Pitch: 37/88 Pitch: 38/88 Pitch: 39/88 Pitch: 40/88 Pitch: 41/88 Pitch: 42/88 Pitch: 43/88 Pitch: 44/88 Pitch: 45/88 Pitch: 46/88 Pitch: 47/88 Pitch: 48/88 Pitch: 49/88 Pitch: 50/88 Pitch: 51/88 Pitch: 52/88 Pitch: 53/88 Pitch: 54/88 Pitch: 55/88 Pitch: 56/88 Pitch: 57/88 Pitch: 58/88 Pitch: 59/88 Pitch: 60/88 Pitch: 61/88 Pitch: 62/88 Pitch: 63/88 Pitch: 64/88 Pitch: 65/88 Pitch: 66/88 Pitch: 67/88 Pitch: 68/88 Pitch: 69/88 Pitch: 70/88 Pitch: 71/88 Pitch: 72/88 Pitch: 73/88 Pitch: 74/88 Pitch: 75/88 Pitch: 76/88 Pitch: 77/88 Pitch: 78/88 Pitch: 79/88 Pitch: 80/88 Pitch: 81/88 Pitch: 82/88 Pitch: 83/88 Pitch: 84/88 Pitch: 85/88 Pitch: 86/88 Pitch: 87/88 Pitch: 88/88 Synthesizing MIDI...
Want to make some of these yourself?
Run this model