sakemin / all-in-one-music-structure-analyzer
Cog implementation of mir-aidj(Taejun Kim)'s 'All-In-One Music Structure Analyzer'
Prediction
sakemin/all-in-one-music-structure-analyzer:e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048IDdj2uzs3bqnchxy2hza2bygf7umStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- activ
- embed
- model
- harmonix-all
- sonify
- visualize
- music_input
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
- include_embeddings
- include_activations
{ "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", "include_embeddings": false, "include_activations": false }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; import fs from "node:fs"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "sakemin/all-in-one-music-structure-analyzer:e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048", { input: { activ: false, embed: false, model: "harmonix-all", sonify: true, visualize: true, music_input: "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", include_embeddings: false, include_activations: false } } ); // To access the file URL: console.log(output[0].url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output[0]);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "sakemin/all-in-one-music-structure-analyzer:e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048", input={ "activ": False, "embed": False, "model": "harmonix-all", "sonify": True, "visualize": True, "music_input": "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", "include_embeddings": False, "include_activations": False } ) # To access the file URL: print(output[0].url()) #=> "http://example.com" # To write the file to disk: with open("my-image.png", "wb") as file: file.write(output[0].read())To learn more, take a look at the guide on getting started with Python.
Run sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "sakemin/all-in-one-music-structure-analyzer:e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048", "input": { "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", "include_embeddings": false, "include_activations": false } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
tmp40u62vehx2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.json
Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "completed_at": "2023-12-16T13:29:25.078411Z", "created_at": "2023-12-16T13:27:28.704818Z", "data_removed": false, "error": null, "id": "dj2uzs3bqnchxy2hza2bygf7um", "input": { "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", "include_embeddings": false, "include_activations": false }, "logs": "=> Found 0 tracks already analyzed and 1 tracks to analyze.\n=> Found 0 tracks already demixed, 1 to demix.\nDownloading: \"https://dl.fbaipublicfiles.com/demucs/hybrid_transformer/955717e8-8726e21a.th\" to /root/.cache/torch/hub/checkpoints/955717e8-8726e21a.th\n 0%| | 0.00/80.2M [00:00<?, ?B/s]\n 0%| | 112k/80.2M [00:00<01:17, 1.08MB/s]\n 1%| | 512k/80.2M [00:00<00:29, 2.80MB/s]\n 3%|▎ | 2.08M/80.2M [00:00<00:09, 8.94MB/s]\n 11%|█ | 8.45M/80.2M [00:00<00:02, 31.5MB/s]\n 34%|███▍ | 27.1M/80.2M [00:00<00:00, 90.0MB/s]\n 62%|██████▏ | 49.9M/80.2M [00:00<00:00, 140MB/s] \n 93%|█████████▎| 75.0M/80.2M [00:00<00:00, 180MB/s]\n100%|██████████| 80.2M/80.2M [00:00<00:00, 116MB/s]\nSelected model is a bag of 1 models. You will see that many progress bars per track.\nSeparated tracks will be stored in /src/demix/htdemucs\nSeparating track /tmp/tmp40u62vehx2mate.com - Sean Lennon. Parachute (128 kbps).mp3\n 0%| | 0.0/204.75 [00:00<?, ?seconds/s]\n 3%|██ | 5.85/204.75 [00:01<00:48, 4.13seconds/s]\n 6%|████ | 11.7/204.75 [00:01<00:21, 8.89seconds/s]\n 9%|████▉ | 17.549999999999997/204.75 [00:01<00:13, 14.27seconds/s]\n 11%|████████▏ | 23.4/204.75 [00:01<00:09, 20.03seconds/s]\n 14%|██████████▏ | 29.25/204.75 [00:01<00:06, 25.67seconds/s]\n 17%|█████████▉ | 35.099999999999994/204.75 [00:01<00:05, 30.96seconds/s]\n 20%|███████████▌ | 40.949999999999996/204.75 [00:02<00:04, 35.58seconds/s]\n 23%|████████████████▍ | 46.8/204.75 [00:02<00:03, 39.58seconds/s]\n 26%|██████████████████▎ | 52.65/204.75 [00:02<00:03, 42.85seconds/s]\n 29%|████████████████████▌ | 58.5/204.75 [00:02<00:03, 45.09seconds/s]\n 31%|██████████████████████▎ | 64.35/204.75 [00:02<00:02, 46.98seconds/s]\n 34%|████████████████████▏ | 70.19999999999999/204.75 [00:02<00:02, 47.99seconds/s]\n 37%|██████████████████████████▎ | 76.05/204.75 [00:02<00:02, 48.57seconds/s]\n 40%|███████████████████████▌ | 81.89999999999999/204.75 [00:02<00:02, 49.65seconds/s]\n 43%|██████████████████████████████▍ | 87.75/204.75 [00:03<00:02, 50.13seconds/s]\n 46%|████████████████████████████████▉ | 93.6/204.75 [00:03<00:02, 50.81seconds/s]\n 49%|████████████████████████████▋ | 99.44999999999999/204.75 [00:03<00:02, 51.13seconds/s]\n 51%|████████████████████████████████████▌ | 105.3/204.75 [00:03<00:01, 51.40seconds/s]\n 54%|███████████████████████████████▍ | 111.14999999999999/204.75 [00:03<00:01, 51.92seconds/s]\n 57%|████████████████████████████████████████▌ | 117.0/204.75 [00:03<00:01, 51.97seconds/s]\n 60%|██████████████████████████████████████████ | 122.85/204.75 [00:03<00:01, 51.79seconds/s]\n 63%|████████████████████████████████████████████▋ | 128.7/204.75 [00:03<00:01, 51.66seconds/s]\n 66%|██████████████████████████████████████ | 134.54999999999998/204.75 [00:03<00:01, 51.45seconds/s]\n 69%|███████████████████████████████████████▊ | 140.39999999999998/204.75 [00:04<00:01, 51.48seconds/s]\n 71%|██████████████████████████████████████████████████ | 146.25/204.75 [00:04<00:01, 51.72seconds/s]\n 74%|████████████████████████████████████████████████████▋ | 152.1/204.75 [00:04<00:01, 51.93seconds/s]\n 77%|█████████████████████████████████████████████████████▉ | 157.95/204.75 [00:04<00:00, 51.98seconds/s]\n 80%|██████████████████████████████████████████████▍ | 163.79999999999998/204.75 [00:04<00:00, 52.05seconds/s]\n 83%|████████████████████████████████████████████████ | 169.64999999999998/204.75 [00:04<00:00, 52.16seconds/s]\n 86%|████████████████████████████████████████████████████████████▊ | 175.5/204.75 [00:04<00:00, 52.24seconds/s]\n 89%|██████████████████████████████████████████████████████████████ | 181.35/204.75 [00:04<00:00, 52.34seconds/s]\n 91%|████████████████████████████████████████████████████████████████▉ | 187.2/204.75 [00:04<00:00, 52.46seconds/s]\n 94%|██████████████████████████████████████████████████████▋ | 193.04999999999998/204.75 [00:05<00:00, 52.10seconds/s]\n 97%|████████████████████████████████████████████████████████▎ | 198.89999999999998/204.75 [00:05<00:00, 52.45seconds/s]\n100%|██████████████████████████████████████████████████████████████████████| 204.75/204.75 [00:05<00:00, 53.21seconds/s]\n100%|██████████████████████████████████████████████████████████████████████| 204.75/204.75 [00:05<00:00, 38.93seconds/s]\n=> Found 0 spectrograms already extracted, 1 to extract.\nExtracting spectrograms: 0%| | 0/1 [00:00<?, ?it/s]\nExtracting spectrograms: 100%|██████████| 1/1 [00:06<00:00, 6.05s/it]\nExtracting spectrograms: 100%|██████████| 1/1 [00:06<00:00, 6.05s/it]\nharmonix-fold0-0vra4ys2.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 4.97MB/s]\nharmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 4.96MB/s]\nharmonix-fold1-3ozjhtsj.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold1-3ozjhtsj.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 26.2MB/s]\nharmonix-fold2-gmgo0nsy.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold2-gmgo0nsy.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 77.6MB/s]\nharmonix-fold3-i92b7m8p.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold3-i92b7m8p.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 76.0MB/s]\nharmonix-fold4-1bql5qo0.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold4-1bql5qo0.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 75.9MB/s]\nharmonix-fold5-x4z5zeef.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold5-x4z5zeef.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 74.9MB/s]\nharmonix-fold6-x7t226rq.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold6-x7t226rq.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 76.9MB/s]\nharmonix-fold7-qwwskhg6.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold7-qwwskhg6.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 74.9MB/s]\n0%| | 0/1 [00:00<?, ?it/s]\nAnalyzing tmp40u62vehx2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 0%| | 0/1 [00:00<?, ?it/s]\nAnalyzing tmp40u62vehx2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 100%|██████████| 1/1 [00:03<00:00, 3.53s/it]\nAnalyzing tmp40u62vehx2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 100%|██████████| 1/1 [00:03<00:00, 3.53s/it]\nVisualizing results: 0%| | 0/1 [00:00<?, ?it/s]\nVisualizing results: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it]\nVisualizing results: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it]\n=> Plots are successfully saved to ./viz\nSonifying results: 0%| | 0/1 [00:00<?, ?it/s]\nSonifying results: 100%|██████████| 1/1 [00:07<00:00, 7.62s/it]\nSonifying results: 100%|██████████| 1/1 [00:07<00:00, 7.62s/it]\n=> Sonified tracks are successfully saved to ./sonif", "metrics": { "predict_time": 64.7974, "total_time": 116.373593 }, "output": [ "https://replicate.delivery/pbxt/wmLM5Prefvt0Wku1zDM94lgqHsYfKTR4Jd11xX3wtYamBrFkA/tmp40u62vehx2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.json", "https://replicate.delivery/pbxt/SYqO2nF8TmamHVdg0rgr2MDBP9i3e94LcZH2cwCz2CmZwaBJA/tmp40u62vehx2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.png", "https://replicate.delivery/pbxt/RobWxQfdVKzEcCjZqxdMXdVqofv0XLc8excB390y5xeQDWLIB/tmp40u62vehx2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.sonif.mp3" ], "started_at": "2023-12-16T13:28:20.281011Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/dj2uzs3bqnchxy2hza2bygf7um", "cancel": "https://api.replicate.com/v1/predictions/dj2uzs3bqnchxy2hza2bygf7um/cancel" }, "version": "e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048" }Generated in=> Found 0 tracks already analyzed and 1 tracks to analyze. => Found 0 tracks already demixed, 1 to demix. Downloading: "https://dl.fbaipublicfiles.com/demucs/hybrid_transformer/955717e8-8726e21a.th" to /root/.cache/torch/hub/checkpoints/955717e8-8726e21a.th 0%| | 0.00/80.2M [00:00<?, ?B/s] 0%| | 112k/80.2M [00:00<01:17, 1.08MB/s] 1%| | 512k/80.2M [00:00<00:29, 2.80MB/s] 3%|▎ | 2.08M/80.2M [00:00<00:09, 8.94MB/s] 11%|█ | 8.45M/80.2M [00:00<00:02, 31.5MB/s] 34%|███▍ | 27.1M/80.2M [00:00<00:00, 90.0MB/s] 62%|██████▏ | 49.9M/80.2M [00:00<00:00, 140MB/s] 93%|█████████▎| 75.0M/80.2M [00:00<00:00, 180MB/s] 100%|██████████| 80.2M/80.2M [00:00<00:00, 116MB/s] Selected model is a bag of 1 models. You will see that many progress bars per track. Separated tracks will be stored in /src/demix/htdemucs Separating track /tmp/tmp40u62vehx2mate.com - Sean Lennon. Parachute (128 kbps).mp3 0%| | 0.0/204.75 [00:00<?, ?seconds/s] 3%|██ | 5.85/204.75 [00:01<00:48, 4.13seconds/s] 6%|████ | 11.7/204.75 [00:01<00:21, 8.89seconds/s] 9%|████▉ | 17.549999999999997/204.75 [00:01<00:13, 14.27seconds/s] 11%|████████▏ | 23.4/204.75 [00:01<00:09, 20.03seconds/s] 14%|██████████▏ | 29.25/204.75 [00:01<00:06, 25.67seconds/s] 17%|█████████▉ | 35.099999999999994/204.75 [00:01<00:05, 30.96seconds/s] 20%|███████████▌ | 40.949999999999996/204.75 [00:02<00:04, 35.58seconds/s] 23%|████████████████▍ | 46.8/204.75 [00:02<00:03, 39.58seconds/s] 26%|██████████████████▎ | 52.65/204.75 [00:02<00:03, 42.85seconds/s] 29%|████████████████████▌ | 58.5/204.75 [00:02<00:03, 45.09seconds/s] 31%|██████████████████████▎ | 64.35/204.75 [00:02<00:02, 46.98seconds/s] 34%|████████████████████▏ | 70.19999999999999/204.75 [00:02<00:02, 47.99seconds/s] 37%|██████████████████████████▎ | 76.05/204.75 [00:02<00:02, 48.57seconds/s] 40%|███████████████████████▌ | 81.89999999999999/204.75 [00:02<00:02, 49.65seconds/s] 43%|██████████████████████████████▍ | 87.75/204.75 [00:03<00:02, 50.13seconds/s] 46%|████████████████████████████████▉ | 93.6/204.75 [00:03<00:02, 50.81seconds/s] 49%|████████████████████████████▋ | 99.44999999999999/204.75 [00:03<00:02, 51.13seconds/s] 51%|████████████████████████████████████▌ | 105.3/204.75 [00:03<00:01, 51.40seconds/s] 54%|███████████████████████████████▍ | 111.14999999999999/204.75 [00:03<00:01, 51.92seconds/s] 57%|████████████████████████████████████████▌ | 117.0/204.75 [00:03<00:01, 51.97seconds/s] 60%|██████████████████████████████████████████ | 122.85/204.75 [00:03<00:01, 51.79seconds/s] 63%|████████████████████████████████████████████▋ | 128.7/204.75 [00:03<00:01, 51.66seconds/s] 66%|██████████████████████████████████████ | 134.54999999999998/204.75 [00:03<00:01, 51.45seconds/s] 69%|███████████████████████████████████████▊ | 140.39999999999998/204.75 [00:04<00:01, 51.48seconds/s] 71%|██████████████████████████████████████████████████ | 146.25/204.75 [00:04<00:01, 51.72seconds/s] 74%|████████████████████████████████████████████████████▋ | 152.1/204.75 [00:04<00:01, 51.93seconds/s] 77%|█████████████████████████████████████████████████████▉ | 157.95/204.75 [00:04<00:00, 51.98seconds/s] 80%|██████████████████████████████████████████████▍ | 163.79999999999998/204.75 [00:04<00:00, 52.05seconds/s] 83%|████████████████████████████████████████████████ | 169.64999999999998/204.75 [00:04<00:00, 52.16seconds/s] 86%|████████████████████████████████████████████████████████████▊ | 175.5/204.75 [00:04<00:00, 52.24seconds/s] 89%|██████████████████████████████████████████████████████████████ | 181.35/204.75 [00:04<00:00, 52.34seconds/s] 91%|████████████████████████████████████████████████████████████████▉ | 187.2/204.75 [00:04<00:00, 52.46seconds/s] 94%|██████████████████████████████████████████████████████▋ | 193.04999999999998/204.75 [00:05<00:00, 52.10seconds/s] 97%|████████████████████████████████████████████████████████▎ | 198.89999999999998/204.75 [00:05<00:00, 52.45seconds/s] 100%|██████████████████████████████████████████████████████████████████████| 204.75/204.75 [00:05<00:00, 53.21seconds/s] 100%|██████████████████████████████████████████████████████████████████████| 204.75/204.75 [00:05<00:00, 38.93seconds/s] => Found 0 spectrograms already extracted, 1 to extract. Extracting spectrograms: 0%| | 0/1 [00:00<?, ?it/s] Extracting spectrograms: 100%|██████████| 1/1 [00:06<00:00, 6.05s/it] Extracting spectrograms: 100%|██████████| 1/1 [00:06<00:00, 6.05s/it] harmonix-fold0-0vra4ys2.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 4.97MB/s] harmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 4.96MB/s] harmonix-fold1-3ozjhtsj.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold1-3ozjhtsj.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 26.2MB/s] harmonix-fold2-gmgo0nsy.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold2-gmgo0nsy.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 77.6MB/s] harmonix-fold3-i92b7m8p.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold3-i92b7m8p.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 76.0MB/s] harmonix-fold4-1bql5qo0.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold4-1bql5qo0.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 75.9MB/s] harmonix-fold5-x4z5zeef.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold5-x4z5zeef.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 74.9MB/s] harmonix-fold6-x7t226rq.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold6-x7t226rq.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 76.9MB/s] harmonix-fold7-qwwskhg6.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold7-qwwskhg6.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 74.9MB/s] 0%| | 0/1 [00:00<?, ?it/s] Analyzing tmp40u62vehx2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 0%| | 0/1 [00:00<?, ?it/s] Analyzing tmp40u62vehx2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 100%|██████████| 1/1 [00:03<00:00, 3.53s/it] Analyzing tmp40u62vehx2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 100%|██████████| 1/1 [00:03<00:00, 3.53s/it] Visualizing results: 0%| | 0/1 [00:00<?, ?it/s] Visualizing results: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it] Visualizing results: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it] => Plots are successfully saved to ./viz Sonifying results: 0%| | 0/1 [00:00<?, ?it/s] Sonifying results: 100%|██████████| 1/1 [00:07<00:00, 7.62s/it] Sonifying results: 100%|██████████| 1/1 [00:07<00:00, 7.62s/it] => Sonified tracks are successfully saved to ./sonifPrediction
sakemin/all-in-one-music-structure-analyzer:e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048IDibh7b2dbsgsyflhzwkt3erqypyStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- activ
- embed
- model
- harmonix-all
- sonify
- visualize
- music_input
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
- include_embeddings
- include_activations
{ "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K51hRev0HcdDI8kMSoJrpAHxByYdRJ81qFpkDM6CXgh7fENO/%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.mp3", "include_embeddings": false, "include_activations": false }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; import fs from "node:fs"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "sakemin/all-in-one-music-structure-analyzer:e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048", { input: { activ: false, embed: false, model: "harmonix-all", sonify: true, visualize: true, music_input: "https://replicate.delivery/pbxt/K51hRev0HcdDI8kMSoJrpAHxByYdRJ81qFpkDM6CXgh7fENO/%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.mp3", include_embeddings: false, include_activations: false } } ); // To access the file URL: console.log(output[0].url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output[0]);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "sakemin/all-in-one-music-structure-analyzer:e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048", input={ "activ": False, "embed": False, "model": "harmonix-all", "sonify": True, "visualize": True, "music_input": "https://replicate.delivery/pbxt/K51hRev0HcdDI8kMSoJrpAHxByYdRJ81qFpkDM6CXgh7fENO/%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.mp3", "include_embeddings": False, "include_activations": False } ) # To access the file URL: print(output[0].url()) #=> "http://example.com" # To write the file to disk: with open("my-image.png", "wb") as file: file.write(output[0].read())To learn more, take a look at the guide on getting started with Python.
Run sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "sakemin/all-in-one-music-structure-analyzer:e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048", "input": { "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K51hRev0HcdDI8kMSoJrpAHxByYdRJ81qFpkDM6CXgh7fENO/%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.mp3", "include_embeddings": false, "include_activations": false } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
tmpsikwk8rz%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.json
Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "completed_at": "2023-12-20T06:09:19.817557Z", "created_at": "2023-12-20T06:06:55.920485Z", "data_removed": false, "error": null, "id": "ibh7b2dbsgsyflhzwkt3erqypy", "input": { "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K51hRev0HcdDI8kMSoJrpAHxByYdRJ81qFpkDM6CXgh7fENO/%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.mp3", "include_embeddings": false, "include_activations": false }, "logs": "=> Found 0 tracks already analyzed and 1 tracks to analyze.\n=> Found 0 tracks already demixed, 1 to demix.\nDownloading: \"https://dl.fbaipublicfiles.com/demucs/hybrid_transformer/955717e8-8726e21a.th\" to /root/.cache/torch/hub/checkpoints/955717e8-8726e21a.th\n 0%| | 0.00/80.2M [00:00<?, ?B/s]\n 1%|▏ | 1.11M/80.2M [00:00<00:07, 11.6MB/s]\n 19%|█▉ | 15.5M/80.2M [00:00<00:00, 93.6MB/s]\n 59%|█████▊ | 47.1M/80.2M [00:00<00:00, 202MB/s] \n 92%|█████████▏| 74.1M/80.2M [00:00<00:00, 234MB/s]\n100%|██████████| 80.2M/80.2M [00:00<00:00, 194MB/s]\nSelected model is a bag of 1 models. You will see that many progress bars per track.\nSeparated tracks will be stored in /src/demix/htdemucs\nSeparating track /tmp/tmpsikwk8rz잔혹한 천사의 테제 (신세기 에반게리온 op).mp3\n 0%| | 0.0/251.54999999999998 [00:00<?, ?seconds/s]\n 2%|█▍ | 5.85/251.54999999999998 [00:02<01:24, 2.92seconds/s]\n 5%|██▊ | 11.7/251.54999999999998 [00:02<00:36, 6.56seconds/s]\n 7%|███▏ | 17.549999999999997/251.54999999999998 [00:02<00:21, 10.95seconds/s]\n 9%|█████▌ | 23.4/251.54999999999998 [00:02<00:14, 15.83seconds/s]\n 12%|██████▊ | 29.25/251.54999999999998 [00:02<00:10, 21.26seconds/s]\n 14%|██████▍ | 35.099999999999994/251.54999999999998 [00:02<00:08, 26.73seconds/s]\n 16%|███████▍ | 40.949999999999996/251.54999999999998 [00:02<00:06, 31.98seconds/s]\n 19%|███████████▏ | 46.8/251.54999999999998 [00:02<00:05, 36.70seconds/s]\n 21%|████████████▎ | 52.65/251.54999999999998 [00:02<00:04, 40.69seconds/s]\n 23%|█████████████▉ | 58.5/251.54999999999998 [00:02<00:04, 43.91seconds/s]\n 26%|███████████████ | 64.35/251.54999999999998 [00:03<00:04, 46.46seconds/s]\n 28%|█████████████ | 70.19999999999999/251.54999999999998 [00:03<00:03, 48.49seconds/s]\n 30%|█████████████████▊ | 76.05/251.54999999999998 [00:03<00:04, 36.47seconds/s]\n 33%|███████████████▎ | 81.89999999999999/251.54999999999998 [00:03<00:04, 40.37seconds/s]\n 35%|████████████████████▌ | 87.75/251.54999999999998 [00:03<00:03, 43.65seconds/s]\n 37%|██████████████████████▎ | 93.6/251.54999999999998 [00:03<00:03, 46.27seconds/s]\n 40%|██████████████████▌ | 99.44999999999999/251.54999999999998 [00:03<00:03, 48.31seconds/s]\n 42%|████████████████████████▋ | 105.3/251.54999999999998 [00:04<00:02, 49.86seconds/s]\n 44%|████████████████████▎ | 111.14999999999999/251.54999999999998 [00:04<00:02, 51.06seconds/s]\n 47%|███████████████████████████▍ | 117.0/251.54999999999998 [00:04<00:02, 51.91seconds/s]\n 49%|████████████████████████████▎ | 122.85/251.54999999999998 [00:04<00:02, 52.49seconds/s]\n 51%|██████████████████████████████▏ | 128.7/251.54999999999998 [00:04<00:02, 52.94seconds/s]\n 53%|████████████████████████▌ | 134.54999999999998/251.54999999999998 [00:04<00:02, 53.13seconds/s]\n 56%|█████████████████████████▋ | 140.39999999999998/251.54999999999998 [00:04<00:02, 53.27seconds/s]\n 58%|█████████████████████████████████▋ | 146.25/251.54999999999998 [00:04<00:01, 53.43seconds/s]\n 60%|███████████████████████████████████▋ | 152.1/251.54999999999998 [00:04<00:01, 52.39seconds/s]\n 63%|████████████████████████████████████▍ | 157.95/251.54999999999998 [00:05<00:01, 52.23seconds/s]\n 65%|█████████████████████████████▉ | 163.79999999999998/251.54999999999998 [00:05<00:01, 52.76seconds/s]\n 67%|███████████████████████████████ | 169.64999999999998/251.54999999999998 [00:05<00:01, 53.17seconds/s]\n 70%|█████████████████████████████████████████▏ | 175.5/251.54999999999998 [00:05<00:01, 53.47seconds/s]\n 72%|█████████████████████████████████████████▊ | 181.35/251.54999999999998 [00:05<00:01, 53.73seconds/s]\n 74%|███████████████████████████████████████████▉ | 187.2/251.54999999999998 [00:05<00:01, 52.27seconds/s]\n 77%|███████████████████████████████████▎ | 193.04999999999998/251.54999999999998 [00:05<00:01, 52.87seconds/s]\n 79%|████████████████████████████████████▎ | 198.89999999999998/251.54999999999998 [00:05<00:00, 53.31seconds/s]\n 81%|███████████████████████████████████████████████▏ | 204.75/251.54999999999998 [00:05<00:00, 53.62seconds/s]\n 84%|█████████████████████████████████████████████████▍ | 210.6/251.54999999999998 [00:05<00:00, 53.88seconds/s]\n 86%|█████████████████████████████████████████████████▉ | 216.45/251.54999999999998 [00:06<00:00, 54.01seconds/s]\n 88%|████████████████████████████████████████▋ | 222.29999999999998/251.54999999999998 [00:06<00:00, 54.13seconds/s]\n 91%|█████████████████████████████████████████▋ | 228.14999999999998/251.54999999999998 [00:06<00:00, 54.24seconds/s]\n 93%|██████████████████████████████████████████████████████▉ | 234.0/251.54999999999998 [00:06<00:00, 54.32seconds/s]\n 95%|███████████████████████████████████████████████████████▎ | 239.85/251.54999999999998 [00:06<00:00, 54.37seconds/s]\n 98%|█████████████████████████████████████████████████████████▋ | 245.7/251.54999999999998 [00:06<00:00, 54.51seconds/s]\n100%|██████████████████████████████████████████████| 251.54999999999998/251.54999999999998 [00:06<00:00, 54.91seconds/s]\n100%|██████████████████████████████████████████████| 251.54999999999998/251.54999999999998 [00:06<00:00, 37.37seconds/s]\n=> Found 0 spectrograms already extracted, 1 to extract.\nExtracting spectrograms: 0%| | 0/1 [00:00<?, ?it/s]\nExtracting spectrograms: 100%|██████████| 1/1 [00:08<00:00, 8.13s/it]\nExtracting spectrograms: 100%|██████████| 1/1 [00:08<00:00, 8.13s/it]\nharmonix-fold0-0vra4ys2.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 13.2MB/s]\nharmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 13.2MB/s]\nharmonix-fold1-3ozjhtsj.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold1-3ozjhtsj.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 70.0MB/s]\nharmonix-fold2-gmgo0nsy.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold2-gmgo0nsy.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 168MB/s]\nharmonix-fold3-i92b7m8p.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold3-i92b7m8p.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 184MB/s]\nharmonix-fold4-1bql5qo0.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold4-1bql5qo0.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 188MB/s]\nharmonix-fold5-x4z5zeef.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold5-x4z5zeef.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 154MB/s]\nharmonix-fold6-x7t226rq.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold6-x7t226rq.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 61.4MB/s]\nharmonix-fold7-qwwskhg6.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold7-qwwskhg6.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 191MB/s]\n0%| | 0/1 [00:00<?, ?it/s]\nAnalyzing tmpsikwk8rz잔혹한 천사의 테제 (신세기 에반게리온 op).mp3: 0%| | 0/1 [00:00<?, ?it/s]\nAnalyzing tmpsikwk8rz잔혹한 천사의 테제 (신세기 에반게리온 op).mp3: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it]\nAnalyzing tmpsikwk8rz잔혹한 천사의 테제 (신세기 에반게리온 op).mp3: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it]\nVisualizing results: 0%| | 0/1 [00:00<?, ?it/s]/src/allin1/visualize.py:115: UserWarning: Glyph 4364 (\\N{HANGUL CHOSEONG CIEUC}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4449 (\\N{HANGUL JUNGSEONG A}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4523 (\\N{HANGUL JONGSEONG NIEUN}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4370 (\\N{HANGUL CHOSEONG HIEUH}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4457 (\\N{HANGUL JUNGSEONG O}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4520 (\\N{HANGUL JONGSEONG KIYEOK}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4366 (\\N{HANGUL CHOSEONG CHIEUCH}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4453 (\\N{HANGUL JUNGSEONG EO}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4361 (\\N{HANGUL CHOSEONG SIOS}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4363 (\\N{HANGUL CHOSEONG IEUNG}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4468 (\\N{HANGUL JUNGSEONG YI}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4368 (\\N{HANGUL CHOSEONG THIEUTH}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4454 (\\N{HANGUL JUNGSEONG E}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4469 (\\N{HANGUL JUNGSEONG I}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4352 (\\N{HANGUL CHOSEONG KIYEOK}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4359 (\\N{HANGUL CHOSEONG PIEUP}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:115: UserWarning: Glyph 4357 (\\N{HANGUL CHOSEONG RIEUL}) missing from current font.\nfig.tight_layout()\n/src/allin1/visualize.py:122: UserWarning: Glyph 4364 (\\N{HANGUL CHOSEONG CIEUC}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4449 (\\N{HANGUL JUNGSEONG A}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4523 (\\N{HANGUL JONGSEONG NIEUN}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4370 (\\N{HANGUL CHOSEONG HIEUH}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4457 (\\N{HANGUL JUNGSEONG O}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4520 (\\N{HANGUL JONGSEONG KIYEOK}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4366 (\\N{HANGUL CHOSEONG CHIEUCH}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4453 (\\N{HANGUL JUNGSEONG EO}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4361 (\\N{HANGUL CHOSEONG SIOS}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4363 (\\N{HANGUL CHOSEONG IEUNG}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4468 (\\N{HANGUL JUNGSEONG YI}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4368 (\\N{HANGUL CHOSEONG THIEUTH}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4454 (\\N{HANGUL JUNGSEONG E}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4469 (\\N{HANGUL JUNGSEONG I}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4352 (\\N{HANGUL CHOSEONG KIYEOK}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4359 (\\N{HANGUL CHOSEONG PIEUP}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\n/src/allin1/visualize.py:122: UserWarning: Glyph 4357 (\\N{HANGUL CHOSEONG RIEUL}) missing from current font.\nfig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight')\nVisualizing results: 100%|██████████| 1/1 [00:11<00:00, 11.17s/it]\nVisualizing results: 100%|██████████| 1/1 [00:11<00:00, 11.17s/it]\n=> Plots are successfully saved to ./viz\nSonifying results: 0%| | 0/1 [00:00<?, ?it/s]\nSonifying results: 100%|██████████| 1/1 [00:09<00:00, 9.71s/it]\nSonifying results: 100%|██████████| 1/1 [00:09<00:00, 9.71s/it]\n=> Sonified tracks are successfully saved to ./sonif", "metrics": { "predict_time": 70.708418, "total_time": 143.897072 }, "output": [ "https://replicate.delivery/pbxt/eqeU3VUH65rxZEftPkEWNRK8i7QGLBjiMjVi0a7peVy4wNQIB/tmpsikwk8rz%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.json", "https://replicate.delivery/pbxt/WOrTB4b98h7XO9fAejuMFp6odppOilR9QQfiGZj7oA2fwNQIB/tmpsikwk8rz%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.png", "https://replicate.delivery/pbxt/l36km1f9LBwsTSDEcY6cZ50ipVedad4o0ghUmYZyA9RPcDESA/tmpsikwk8rz%E1%84%8C%E1%85%A1%E1%86%AB%E1%84%92%E1%85%A9%E1%86%A8%E1%84%92%E1%85%A1%E1%86%AB%20%E1%84%8E%E1%85%A5%E1%86%AB%E1%84%89%E1%85%A1%E1%84%8B%E1%85%B4%20%E1%84%90%E1%85%A6%E1%84%8C%E1%85%A6%20%28%E1%84%89%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A6%E1%84%80%E1%85%B5%20%E1%84%8B%E1%85%A6%E1%84%87%E1%85%A1%E1%86%AB%E1%84%80%E1%85%A6%E1%84%85%E1%85%B5%E1%84%8B%E1%85%A9%E1%86%AB%20op%29.sonif.mp3" ], "started_at": "2023-12-20T06:08:09.109139Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/ibh7b2dbsgsyflhzwkt3erqypy", "cancel": "https://api.replicate.com/v1/predictions/ibh7b2dbsgsyflhzwkt3erqypy/cancel" }, "version": "e2570af7371c7be41de806ca07e7a7e782ba2ce4bdbdbf4e0f21f987a8d48048" }Generated in=> Found 0 tracks already analyzed and 1 tracks to analyze. => Found 0 tracks already demixed, 1 to demix. Downloading: "https://dl.fbaipublicfiles.com/demucs/hybrid_transformer/955717e8-8726e21a.th" to /root/.cache/torch/hub/checkpoints/955717e8-8726e21a.th 0%| | 0.00/80.2M [00:00<?, ?B/s] 1%|▏ | 1.11M/80.2M [00:00<00:07, 11.6MB/s] 19%|█▉ | 15.5M/80.2M [00:00<00:00, 93.6MB/s] 59%|█████▊ | 47.1M/80.2M [00:00<00:00, 202MB/s] 92%|█████████▏| 74.1M/80.2M [00:00<00:00, 234MB/s] 100%|██████████| 80.2M/80.2M [00:00<00:00, 194MB/s] Selected model is a bag of 1 models. You will see that many progress bars per track. Separated tracks will be stored in /src/demix/htdemucs Separating track /tmp/tmpsikwk8rz잔혹한 천사의 테제 (신세기 에반게리온 op).mp3 0%| | 0.0/251.54999999999998 [00:00<?, ?seconds/s] 2%|█▍ | 5.85/251.54999999999998 [00:02<01:24, 2.92seconds/s] 5%|██▊ | 11.7/251.54999999999998 [00:02<00:36, 6.56seconds/s] 7%|███▏ | 17.549999999999997/251.54999999999998 [00:02<00:21, 10.95seconds/s] 9%|█████▌ | 23.4/251.54999999999998 [00:02<00:14, 15.83seconds/s] 12%|██████▊ | 29.25/251.54999999999998 [00:02<00:10, 21.26seconds/s] 14%|██████▍ | 35.099999999999994/251.54999999999998 [00:02<00:08, 26.73seconds/s] 16%|███████▍ | 40.949999999999996/251.54999999999998 [00:02<00:06, 31.98seconds/s] 19%|███████████▏ | 46.8/251.54999999999998 [00:02<00:05, 36.70seconds/s] 21%|████████████▎ | 52.65/251.54999999999998 [00:02<00:04, 40.69seconds/s] 23%|█████████████▉ | 58.5/251.54999999999998 [00:02<00:04, 43.91seconds/s] 26%|███████████████ | 64.35/251.54999999999998 [00:03<00:04, 46.46seconds/s] 28%|█████████████ | 70.19999999999999/251.54999999999998 [00:03<00:03, 48.49seconds/s] 30%|█████████████████▊ | 76.05/251.54999999999998 [00:03<00:04, 36.47seconds/s] 33%|███████████████▎ | 81.89999999999999/251.54999999999998 [00:03<00:04, 40.37seconds/s] 35%|████████████████████▌ | 87.75/251.54999999999998 [00:03<00:03, 43.65seconds/s] 37%|██████████████████████▎ | 93.6/251.54999999999998 [00:03<00:03, 46.27seconds/s] 40%|██████████████████▌ | 99.44999999999999/251.54999999999998 [00:03<00:03, 48.31seconds/s] 42%|████████████████████████▋ | 105.3/251.54999999999998 [00:04<00:02, 49.86seconds/s] 44%|████████████████████▎ | 111.14999999999999/251.54999999999998 [00:04<00:02, 51.06seconds/s] 47%|███████████████████████████▍ | 117.0/251.54999999999998 [00:04<00:02, 51.91seconds/s] 49%|████████████████████████████▎ | 122.85/251.54999999999998 [00:04<00:02, 52.49seconds/s] 51%|██████████████████████████████▏ | 128.7/251.54999999999998 [00:04<00:02, 52.94seconds/s] 53%|████████████████████████▌ | 134.54999999999998/251.54999999999998 [00:04<00:02, 53.13seconds/s] 56%|█████████████████████████▋ | 140.39999999999998/251.54999999999998 [00:04<00:02, 53.27seconds/s] 58%|█████████████████████████████████▋ | 146.25/251.54999999999998 [00:04<00:01, 53.43seconds/s] 60%|███████████████████████████████████▋ | 152.1/251.54999999999998 [00:04<00:01, 52.39seconds/s] 63%|████████████████████████████████████▍ | 157.95/251.54999999999998 [00:05<00:01, 52.23seconds/s] 65%|█████████████████████████████▉ | 163.79999999999998/251.54999999999998 [00:05<00:01, 52.76seconds/s] 67%|███████████████████████████████ | 169.64999999999998/251.54999999999998 [00:05<00:01, 53.17seconds/s] 70%|█████████████████████████████████████████▏ | 175.5/251.54999999999998 [00:05<00:01, 53.47seconds/s] 72%|█████████████████████████████████████████▊ | 181.35/251.54999999999998 [00:05<00:01, 53.73seconds/s] 74%|███████████████████████████████████████████▉ | 187.2/251.54999999999998 [00:05<00:01, 52.27seconds/s] 77%|███████████████████████████████████▎ | 193.04999999999998/251.54999999999998 [00:05<00:01, 52.87seconds/s] 79%|████████████████████████████████████▎ | 198.89999999999998/251.54999999999998 [00:05<00:00, 53.31seconds/s] 81%|███████████████████████████████████████████████▏ | 204.75/251.54999999999998 [00:05<00:00, 53.62seconds/s] 84%|█████████████████████████████████████████████████▍ | 210.6/251.54999999999998 [00:05<00:00, 53.88seconds/s] 86%|█████████████████████████████████████████████████▉ | 216.45/251.54999999999998 [00:06<00:00, 54.01seconds/s] 88%|████████████████████████████████████████▋ | 222.29999999999998/251.54999999999998 [00:06<00:00, 54.13seconds/s] 91%|█████████████████████████████████████████▋ | 228.14999999999998/251.54999999999998 [00:06<00:00, 54.24seconds/s] 93%|██████████████████████████████████████████████████████▉ | 234.0/251.54999999999998 [00:06<00:00, 54.32seconds/s] 95%|███████████████████████████████████████████████████████▎ | 239.85/251.54999999999998 [00:06<00:00, 54.37seconds/s] 98%|█████████████████████████████████████████████████████████▋ | 245.7/251.54999999999998 [00:06<00:00, 54.51seconds/s] 100%|██████████████████████████████████████████████| 251.54999999999998/251.54999999999998 [00:06<00:00, 54.91seconds/s] 100%|██████████████████████████████████████████████| 251.54999999999998/251.54999999999998 [00:06<00:00, 37.37seconds/s] => Found 0 spectrograms already extracted, 1 to extract. Extracting spectrograms: 0%| | 0/1 [00:00<?, ?it/s] Extracting spectrograms: 100%|██████████| 1/1 [00:08<00:00, 8.13s/it] Extracting spectrograms: 100%|██████████| 1/1 [00:08<00:00, 8.13s/it] harmonix-fold0-0vra4ys2.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 13.2MB/s] harmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 13.2MB/s] harmonix-fold1-3ozjhtsj.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold1-3ozjhtsj.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 70.0MB/s] harmonix-fold2-gmgo0nsy.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold2-gmgo0nsy.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 168MB/s] harmonix-fold3-i92b7m8p.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold3-i92b7m8p.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 184MB/s] harmonix-fold4-1bql5qo0.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold4-1bql5qo0.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 188MB/s] harmonix-fold5-x4z5zeef.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold5-x4z5zeef.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 154MB/s] harmonix-fold6-x7t226rq.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold6-x7t226rq.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 61.4MB/s] harmonix-fold7-qwwskhg6.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold7-qwwskhg6.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 191MB/s] 0%| | 0/1 [00:00<?, ?it/s] Analyzing tmpsikwk8rz잔혹한 천사의 테제 (신세기 에반게리온 op).mp3: 0%| | 0/1 [00:00<?, ?it/s] Analyzing tmpsikwk8rz잔혹한 천사의 테제 (신세기 에반게리온 op).mp3: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it] Analyzing tmpsikwk8rz잔혹한 천사의 테제 (신세기 에반게리온 op).mp3: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it] Visualizing results: 0%| | 0/1 [00:00<?, ?it/s]/src/allin1/visualize.py:115: UserWarning: Glyph 4364 (\N{HANGUL CHOSEONG CIEUC}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4449 (\N{HANGUL JUNGSEONG A}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4523 (\N{HANGUL JONGSEONG NIEUN}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4370 (\N{HANGUL CHOSEONG HIEUH}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4457 (\N{HANGUL JUNGSEONG O}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4520 (\N{HANGUL JONGSEONG KIYEOK}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4366 (\N{HANGUL CHOSEONG CHIEUCH}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4453 (\N{HANGUL JUNGSEONG EO}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4361 (\N{HANGUL CHOSEONG SIOS}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4363 (\N{HANGUL CHOSEONG IEUNG}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4468 (\N{HANGUL JUNGSEONG YI}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4368 (\N{HANGUL CHOSEONG THIEUTH}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4454 (\N{HANGUL JUNGSEONG E}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4469 (\N{HANGUL JUNGSEONG I}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4352 (\N{HANGUL CHOSEONG KIYEOK}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4359 (\N{HANGUL CHOSEONG PIEUP}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:115: UserWarning: Glyph 4357 (\N{HANGUL CHOSEONG RIEUL}) missing from current font. fig.tight_layout() /src/allin1/visualize.py:122: UserWarning: Glyph 4364 (\N{HANGUL CHOSEONG CIEUC}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4449 (\N{HANGUL JUNGSEONG A}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4523 (\N{HANGUL JONGSEONG NIEUN}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4370 (\N{HANGUL CHOSEONG HIEUH}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4457 (\N{HANGUL JUNGSEONG O}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4520 (\N{HANGUL JONGSEONG KIYEOK}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4366 (\N{HANGUL CHOSEONG CHIEUCH}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4453 (\N{HANGUL JUNGSEONG EO}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4361 (\N{HANGUL CHOSEONG SIOS}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4363 (\N{HANGUL CHOSEONG IEUNG}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4468 (\N{HANGUL JUNGSEONG YI}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4368 (\N{HANGUL CHOSEONG THIEUTH}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4454 (\N{HANGUL JUNGSEONG E}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4469 (\N{HANGUL JUNGSEONG I}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4352 (\N{HANGUL CHOSEONG KIYEOK}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4359 (\N{HANGUL CHOSEONG PIEUP}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') /src/allin1/visualize.py:122: UserWarning: Glyph 4357 (\N{HANGUL CHOSEONG RIEUL}) missing from current font. fig.savefig(out_dir / f'{result.path.stem}.pdf', bbox_inches='tight') Visualizing results: 100%|██████████| 1/1 [00:11<00:00, 11.17s/it] Visualizing results: 100%|██████████| 1/1 [00:11<00:00, 11.17s/it] => Plots are successfully saved to ./viz Sonifying results: 0%| | 0/1 [00:00<?, ?it/s] Sonifying results: 100%|██████████| 1/1 [00:09<00:00, 9.71s/it] Sonifying results: 100%|██████████| 1/1 [00:09<00:00, 9.71s/it] => Sonified tracks are successfully saved to ./sonifPrediction
sakemin/all-in-one-music-structure-analyzer:001b4137be6ac67bdc28cb5cffacf128b874f530258d033de23121e785cb7290IDofu2ymdbv6iwlqh3htdy2df2rqStatusSucceededSourceWebHardwareA40 (Large)Total durationCreatedInput
- activ
- embed
- model
- harmonix-all
- sonify
- visualize
- music_input
- Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
- include_embeddings
- include_activations
{ "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", "include_embeddings": false, "include_activations": false }Install Replicate’s Node.js client library:npm install replicateImport and set up the client:import Replicate from "replicate"; import fs from "node:fs"; const replicate = new Replicate({ auth: process.env.REPLICATE_API_TOKEN, });Run sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run( "sakemin/all-in-one-music-structure-analyzer:001b4137be6ac67bdc28cb5cffacf128b874f530258d033de23121e785cb7290", { input: { activ: false, embed: false, model: "harmonix-all", sonify: true, visualize: true, music_input: "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", include_embeddings: false, include_activations: false } } ); // To access the file URL: console.log(output[0].url()); //=> "http://example.com" // To write the file to disk: fs.writeFile("my-image.png", output[0]);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:pip install replicateImport the client:import replicateRun sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run( "sakemin/all-in-one-music-structure-analyzer:001b4137be6ac67bdc28cb5cffacf128b874f530258d033de23121e785cb7290", input={ "activ": False, "embed": False, "model": "harmonix-all", "sonify": True, "visualize": True, "music_input": "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", "include_embeddings": False, "include_activations": False } ) # To access the file URL: print(output[0].url()) #=> "http://example.com" # To write the file to disk: with open("my-image.png", "wb") as file: file.write(output[0].read())To learn more, take a look at the guide on getting started with Python.
Run sakemin/all-in-one-music-structure-analyzer using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN" \ -H "Content-Type: application/json" \ -H "Prefer: wait" \ -d $'{ "version": "sakemin/all-in-one-music-structure-analyzer:001b4137be6ac67bdc28cb5cffacf128b874f530258d033de23121e785cb7290", "input": { "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", "include_embeddings": false, "include_activations": false } }' \ https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
tmphbi1m7kax2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.json
Video Player is loading.Current Time 00:00:000/Duration 00:00:000Loaded: 0%Stream Type LIVERemaining Time -00:00:0001x- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
{ "completed_at": "2023-12-21T09:07:04.696262Z", "created_at": "2023-12-21T09:04:43.008830Z", "data_removed": false, "error": null, "id": "ofu2ymdbv6iwlqh3htdy2df2rq", "input": { "activ": false, "embed": false, "model": "harmonix-all", "sonify": true, "visualize": true, "music_input": "https://replicate.delivery/pbxt/K3iP4RhDPayT24NMYswahQ7kYfG1NS4vhNaF3PZVSZoLaSSY/x2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.mp3", "include_embeddings": false, "include_activations": false }, "logs": "=> Found 0 tracks already analyzed and 1 tracks to analyze.\n=> Found 0 tracks already demixed, 1 to demix.\nDownloading: \"https://dl.fbaipublicfiles.com/demucs/hybrid_transformer/955717e8-8726e21a.th\" to /root/.cache/torch/hub/checkpoints/955717e8-8726e21a.th\n 0%| | 0.00/80.2M [00:00<?, ?B/s]\n 0%| | 104k/80.2M [00:00<01:21, 1.03MB/s]\n 1%| | 488k/80.2M [00:00<00:31, 2.68MB/s]\n 2%|▏ | 1.96M/80.2M [00:00<00:09, 8.46MB/s]\n 10%|▉ | 7.84M/80.2M [00:00<00:02, 29.2MB/s]\n 38%|███▊ | 30.9M/80.2M [00:00<00:00, 105MB/s] \n 68%|██████▊ | 54.8M/80.2M [00:00<00:00, 155MB/s]\n 97%|█████████▋| 77.6M/80.2M [00:00<00:00, 182MB/s]\n100%|██████████| 80.2M/80.2M [00:00<00:00, 117MB/s]\nSelected model is a bag of 1 models. You will see that many progress bars per track.\nSeparated tracks will be stored in /src/demix/htdemucs\nSeparating track /tmp/tmphbi1m7kax2mate.com - Sean Lennon. Parachute (128 kbps).mp3\n 0%| | 0.0/204.75 [00:00<?, ?seconds/s]\n 3%|██ | 5.85/204.75 [00:01<01:02, 3.19seconds/s]\n 6%|████ | 11.7/204.75 [00:01<00:27, 7.12seconds/s]\n 9%|████▉ | 17.549999999999997/204.75 [00:02<00:15, 11.75seconds/s]\n 11%|████████▏ | 23.4/204.75 [00:02<00:10, 16.92seconds/s]\n 14%|██████████▏ | 29.25/204.75 [00:02<00:07, 22.37seconds/s]\n 17%|█████████▉ | 35.099999999999994/204.75 [00:02<00:06, 27.74seconds/s]\n 20%|███████████▌ | 40.949999999999996/204.75 [00:02<00:04, 32.84seconds/s]\n 23%|████████████████▍ | 46.8/204.75 [00:02<00:04, 37.21seconds/s]\n 26%|██████████████████▎ | 52.65/204.75 [00:02<00:03, 40.95seconds/s]\n 29%|████████████████████▌ | 58.5/204.75 [00:02<00:03, 43.60seconds/s]\n 31%|██████████████████████▎ | 64.35/204.75 [00:02<00:03, 45.56seconds/s]\n 34%|████████████████████▏ | 70.19999999999999/204.75 [00:03<00:02, 47.30seconds/s]\n 37%|██████████████████████████▎ | 76.05/204.75 [00:03<00:02, 48.58seconds/s]\n 40%|███████████████████████▌ | 81.89999999999999/204.75 [00:03<00:02, 49.59seconds/s]\n 43%|██████████████████████████████▍ | 87.75/204.75 [00:03<00:02, 50.27seconds/s]\n 46%|████████████████████████████████▉ | 93.6/204.75 [00:03<00:02, 50.95seconds/s]\n 49%|████████████████████████████▋ | 99.44999999999999/204.75 [00:03<00:02, 51.35seconds/s]\n 51%|████████████████████████████████████▌ | 105.3/204.75 [00:03<00:01, 51.61seconds/s]\n 54%|███████████████████████████████▍ | 111.14999999999999/204.75 [00:03<00:01, 51.40seconds/s]\n 57%|████████████████████████████████████████▌ | 117.0/204.75 [00:03<00:01, 51.55seconds/s]\n 60%|██████████████████████████████████████████ | 122.85/204.75 [00:04<00:01, 52.05seconds/s]\n 63%|████████████████████████████████████████████▋ | 128.7/204.75 [00:04<00:01, 52.24seconds/s]\n 66%|██████████████████████████████████████ | 134.54999999999998/204.75 [00:04<00:01, 51.83seconds/s]\n 69%|███████████████████████████████████████▊ | 140.39999999999998/204.75 [00:04<00:01, 51.48seconds/s]\n 71%|██████████████████████████████████████████████████ | 146.25/204.75 [00:04<00:01, 51.40seconds/s]\n 74%|████████████████████████████████████████████████████▋ | 152.1/204.75 [00:04<00:01, 51.40seconds/s]\n 77%|█████████████████████████████████████████████████████▉ | 157.95/204.75 [00:04<00:00, 51.45seconds/s]\n 80%|██████████████████████████████████████████████▍ | 163.79999999999998/204.75 [00:04<00:00, 51.26seconds/s]\n 83%|████████████████████████████████████████████████ | 169.64999999999998/204.75 [00:04<00:00, 51.05seconds/s]\n 86%|████████████████████████████████████████████████████████████▊ | 175.5/204.75 [00:05<00:00, 51.64seconds/s]\n 89%|██████████████████████████████████████████████████████████████ | 181.35/204.75 [00:05<00:00, 52.30seconds/s]\n 91%|████████████████████████████████████████████████████████████████▉ | 187.2/204.75 [00:05<00:00, 51.43seconds/s]\n 94%|██████████████████████████████████████████████████████▋ | 193.04999999999998/204.75 [00:05<00:00, 51.65seconds/s]\n 97%|████████████████████████████████████████████████████████▎ | 198.89999999999998/204.75 [00:05<00:00, 49.10seconds/s]\n100%|██████████████████████████████████████████████████████████████████████| 204.75/204.75 [00:05<00:00, 50.66seconds/s]\n100%|██████████████████████████████████████████████████████████████████████| 204.75/204.75 [00:05<00:00, 36.00seconds/s]\n=> Found 0 spectrograms already extracted, 1 to extract.\nExtracting spectrograms: 0%| | 0/1 [00:00<?, ?it/s]\nExtracting spectrograms: 100%|██████████| 1/1 [00:06<00:00, 6.23s/it]\nExtracting spectrograms: 100%|██████████| 1/1 [00:06<00:00, 6.23s/it]\nharmonix-fold0-0vra4ys2.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 5.04MB/s]\nharmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 5.03MB/s]\nharmonix-fold1-3ozjhtsj.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold1-3ozjhtsj.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 26.8MB/s]\nharmonix-fold2-gmgo0nsy.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold2-gmgo0nsy.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 77.8MB/s]\nharmonix-fold3-i92b7m8p.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold3-i92b7m8p.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 81.7MB/s]\nharmonix-fold4-1bql5qo0.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold4-1bql5qo0.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 78.5MB/s]\nharmonix-fold5-x4z5zeef.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold5-x4z5zeef.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 77.5MB/s]\nharmonix-fold6-x7t226rq.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold6-x7t226rq.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 76.5MB/s]\nharmonix-fold7-qwwskhg6.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s]\nharmonix-fold7-qwwskhg6.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 77.7MB/s]\n0%| | 0/1 [00:00<?, ?it/s]\nAnalyzing tmphbi1m7kax2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 0%| | 0/1 [00:00<?, ?it/s]\nAnalyzing tmphbi1m7kax2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 100%|██████████| 1/1 [00:03<00:00, 3.43s/it]\nAnalyzing tmphbi1m7kax2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 100%|██████████| 1/1 [00:03<00:00, 3.43s/it]\nVisualizing results: 0%| | 0/1 [00:00<?, ?it/s]\nVisualizing results: 100%|██████████| 1/1 [00:10<00:00, 10.77s/it]\nVisualizing results: 100%|██████████| 1/1 [00:10<00:00, 10.77s/it]\n=> Plots are successfully saved to ./viz\nSonifying results: 0%| | 0/1 [00:00<?, ?it/s]\nSonifying results: 100%|██████████| 1/1 [00:07<00:00, 7.53s/it]\nSonifying results: 100%|██████████| 1/1 [00:07<00:00, 7.53s/it]\n=> Sonified tracks are successfully saved to ./sonif", "metrics": { "predict_time": 65.818421, "total_time": 141.687432 }, "output": [ "https://replicate.delivery/pbxt/vmeY0lK6XzVOFKjJcGEJFsrK7gpjrcLQOhXzifrjoBp2IbESA/tmphbi1m7kax2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.json", "https://replicate.delivery/pbxt/989hApZF7c7RB535295mWrCQ43npy2QxfHeMJfoY9jnvR2IkA/tmphbi1m7kax2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.png", "https://replicate.delivery/pbxt/UGeLnwlwBwT6cKpwjvCSoeYJX5bYH1n8E2elbdffi6e2NyGhE/tmphbi1m7kax2mate.com%20-%20Sean%20Lennon.%20Parachute%20%28128%20kbps%29.sonif.mp3" ], "started_at": "2023-12-21T09:05:58.877841Z", "status": "succeeded", "urls": { "get": "https://api.replicate.com/v1/predictions/ofu2ymdbv6iwlqh3htdy2df2rq", "cancel": "https://api.replicate.com/v1/predictions/ofu2ymdbv6iwlqh3htdy2df2rq/cancel" }, "version": "001b4137be6ac67bdc28cb5cffacf128b874f530258d033de23121e785cb7290" }Generated in=> Found 0 tracks already analyzed and 1 tracks to analyze. => Found 0 tracks already demixed, 1 to demix. Downloading: "https://dl.fbaipublicfiles.com/demucs/hybrid_transformer/955717e8-8726e21a.th" to /root/.cache/torch/hub/checkpoints/955717e8-8726e21a.th 0%| | 0.00/80.2M [00:00<?, ?B/s] 0%| | 104k/80.2M [00:00<01:21, 1.03MB/s] 1%| | 488k/80.2M [00:00<00:31, 2.68MB/s] 2%|▏ | 1.96M/80.2M [00:00<00:09, 8.46MB/s] 10%|▉ | 7.84M/80.2M [00:00<00:02, 29.2MB/s] 38%|███▊ | 30.9M/80.2M [00:00<00:00, 105MB/s] 68%|██████▊ | 54.8M/80.2M [00:00<00:00, 155MB/s] 97%|█████████▋| 77.6M/80.2M [00:00<00:00, 182MB/s] 100%|██████████| 80.2M/80.2M [00:00<00:00, 117MB/s] Selected model is a bag of 1 models. You will see that many progress bars per track. Separated tracks will be stored in /src/demix/htdemucs Separating track /tmp/tmphbi1m7kax2mate.com - Sean Lennon. Parachute (128 kbps).mp3 0%| | 0.0/204.75 [00:00<?, ?seconds/s] 3%|██ | 5.85/204.75 [00:01<01:02, 3.19seconds/s] 6%|████ | 11.7/204.75 [00:01<00:27, 7.12seconds/s] 9%|████▉ | 17.549999999999997/204.75 [00:02<00:15, 11.75seconds/s] 11%|████████▏ | 23.4/204.75 [00:02<00:10, 16.92seconds/s] 14%|██████████▏ | 29.25/204.75 [00:02<00:07, 22.37seconds/s] 17%|█████████▉ | 35.099999999999994/204.75 [00:02<00:06, 27.74seconds/s] 20%|███████████▌ | 40.949999999999996/204.75 [00:02<00:04, 32.84seconds/s] 23%|████████████████▍ | 46.8/204.75 [00:02<00:04, 37.21seconds/s] 26%|██████████████████▎ | 52.65/204.75 [00:02<00:03, 40.95seconds/s] 29%|████████████████████▌ | 58.5/204.75 [00:02<00:03, 43.60seconds/s] 31%|██████████████████████▎ | 64.35/204.75 [00:02<00:03, 45.56seconds/s] 34%|████████████████████▏ | 70.19999999999999/204.75 [00:03<00:02, 47.30seconds/s] 37%|██████████████████████████▎ | 76.05/204.75 [00:03<00:02, 48.58seconds/s] 40%|███████████████████████▌ | 81.89999999999999/204.75 [00:03<00:02, 49.59seconds/s] 43%|██████████████████████████████▍ | 87.75/204.75 [00:03<00:02, 50.27seconds/s] 46%|████████████████████████████████▉ | 93.6/204.75 [00:03<00:02, 50.95seconds/s] 49%|████████████████████████████▋ | 99.44999999999999/204.75 [00:03<00:02, 51.35seconds/s] 51%|████████████████████████████████████▌ | 105.3/204.75 [00:03<00:01, 51.61seconds/s] 54%|███████████████████████████████▍ | 111.14999999999999/204.75 [00:03<00:01, 51.40seconds/s] 57%|████████████████████████████████████████▌ | 117.0/204.75 [00:03<00:01, 51.55seconds/s] 60%|██████████████████████████████████████████ | 122.85/204.75 [00:04<00:01, 52.05seconds/s] 63%|████████████████████████████████████████████▋ | 128.7/204.75 [00:04<00:01, 52.24seconds/s] 66%|██████████████████████████████████████ | 134.54999999999998/204.75 [00:04<00:01, 51.83seconds/s] 69%|███████████████████████████████████████▊ | 140.39999999999998/204.75 [00:04<00:01, 51.48seconds/s] 71%|██████████████████████████████████████████████████ | 146.25/204.75 [00:04<00:01, 51.40seconds/s] 74%|████████████████████████████████████████████████████▋ | 152.1/204.75 [00:04<00:01, 51.40seconds/s] 77%|█████████████████████████████████████████████████████▉ | 157.95/204.75 [00:04<00:00, 51.45seconds/s] 80%|██████████████████████████████████████████████▍ | 163.79999999999998/204.75 [00:04<00:00, 51.26seconds/s] 83%|████████████████████████████████████████████████ | 169.64999999999998/204.75 [00:04<00:00, 51.05seconds/s] 86%|████████████████████████████████████████████████████████████▊ | 175.5/204.75 [00:05<00:00, 51.64seconds/s] 89%|██████████████████████████████████████████████████████████████ | 181.35/204.75 [00:05<00:00, 52.30seconds/s] 91%|████████████████████████████████████████████████████████████████▉ | 187.2/204.75 [00:05<00:00, 51.43seconds/s] 94%|██████████████████████████████████████████████████████▋ | 193.04999999999998/204.75 [00:05<00:00, 51.65seconds/s] 97%|████████████████████████████████████████████████████████▎ | 198.89999999999998/204.75 [00:05<00:00, 49.10seconds/s] 100%|██████████████████████████████████████████████████████████████████████| 204.75/204.75 [00:05<00:00, 50.66seconds/s] 100%|██████████████████████████████████████████████████████████████████████| 204.75/204.75 [00:05<00:00, 36.00seconds/s] => Found 0 spectrograms already extracted, 1 to extract. Extracting spectrograms: 0%| | 0/1 [00:00<?, ?it/s] Extracting spectrograms: 100%|██████████| 1/1 [00:06<00:00, 6.23s/it] Extracting spectrograms: 100%|██████████| 1/1 [00:06<00:00, 6.23s/it] harmonix-fold0-0vra4ys2.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 5.04MB/s] harmonix-fold0-0vra4ys2.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 5.03MB/s] harmonix-fold1-3ozjhtsj.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold1-3ozjhtsj.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 26.8MB/s] harmonix-fold2-gmgo0nsy.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold2-gmgo0nsy.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 77.8MB/s] harmonix-fold3-i92b7m8p.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold3-i92b7m8p.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 81.7MB/s] harmonix-fold4-1bql5qo0.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold4-1bql5qo0.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 78.5MB/s] harmonix-fold5-x4z5zeef.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold5-x4z5zeef.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 77.5MB/s] harmonix-fold6-x7t226rq.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold6-x7t226rq.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 76.5MB/s] harmonix-fold7-qwwskhg6.pth: 0%| | 0.00/1.40M [00:00<?, ?B/s] harmonix-fold7-qwwskhg6.pth: 100%|██████████| 1.40M/1.40M [00:00<00:00, 77.7MB/s] 0%| | 0/1 [00:00<?, ?it/s] Analyzing tmphbi1m7kax2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 0%| | 0/1 [00:00<?, ?it/s] Analyzing tmphbi1m7kax2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 100%|██████████| 1/1 [00:03<00:00, 3.43s/it] Analyzing tmphbi1m7kax2mate.com - Sean Lennon. Parachute (128 kbps).mp3: 100%|██████████| 1/1 [00:03<00:00, 3.43s/it] Visualizing results: 0%| | 0/1 [00:00<?, ?it/s] Visualizing results: 100%|██████████| 1/1 [00:10<00:00, 10.77s/it] Visualizing results: 100%|██████████| 1/1 [00:10<00:00, 10.77s/it] => Plots are successfully saved to ./viz Sonifying results: 0%| | 0/1 [00:00<?, ?it/s] Sonifying results: 100%|██████████| 1/1 [00:07<00:00, 7.53s/it] Sonifying results: 100%|██████████| 1/1 [00:07<00:00, 7.53s/it] => Sonified tracks are successfully saved to ./sonif
Want to make some of these yourself?
Run this model
