erickluis00/all-in-one-audio:5de3dc64 – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

erickluis00 /all-in-one-audio:5de3dc64

Playground API

Input

music_input

file

An audio file input to analyze.

visualize

boolean

Save visualizations

Default: false

sonify

boolean

Save sonifications

Default: false

activ

boolean

Save frame-level raw activations from sigmoid and softmax

Default: false

embed

boolean

Save frame-level embeddings

Default: false

model

string

Name of the pretrained model to use

Default: "harmonix-all"

include_activations

boolean

Whether to include activations in the analysis results or not.

Default: false

include_embeddings

boolean

Whether to include embeddings in the analysis results or not.

Default: false

audioSeparator

boolean

TEST AUDIO SEPARATOR MDX NET

Default: false

audioSeparatorModel

string

Shift + Return to add a new line

Name of the pretrained model to use: https://raw.githubusercontent.com/TRvlvr/application_data/main/filelists/download_checks.json | Default: Kim_Vocal_2.onnx

Default: "Kim_Vocal_2.onnx"

Run this model in Node.js with one line of code:

npx create-replicate --model=erickluis00/all-in-one-audio

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run erickluis00/all-in-one-audio using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "erickluis00/all-in-one-audio:5de3dc64fc11b6a7961f275d759bf06e064e3ca9ca5852fdc30f905e7eaca85c",
  {
    input: {
      activ: false,
      embed: false,
      model: "harmonix-all",
      sonify: false,
      visualize: false,
      audioSeparator: false,
      include_embeddings: false,
      audioSeparatorModel: "Kim_Vocal_2.onnx",
      include_activations: false
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run erickluis00/all-in-one-audio using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "erickluis00/all-in-one-audio:5de3dc64fc11b6a7961f275d759bf06e064e3ca9ca5852fdc30f905e7eaca85c",
    input={
        "activ": False,
        "embed": False,
        "model": "harmonix-all",
        "sonify": False,
        "visualize": False,
        "audioSeparator": False,
        "include_embeddings": False,
        "audioSeparatorModel": "Kim_Vocal_2.onnx",
        "include_activations": False
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run erickluis00/all-in-one-audio using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "5de3dc64fc11b6a7961f275d759bf06e064e3ca9ca5852fdc30f905e7eaca85c",
    "input": {
      "activ": false,
      "embed": false,
      "model": "harmonix-all",
      "sonify": false,
      "visualize": false,
      "audioSeparator": false,
      "include_embeddings": false,
      "audioSeparatorModel": "Kim_Vocal_2.onnx",
      "include_activations": false
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/erickluis00/all-in-one-audio@sha256:5de3dc64fc11b6a7961f275d759bf06e064e3ca9ca5852fdc30f905e7eaca85c \
  -i 'activ=false' \
  -i 'embed=false' \
  -i 'model="harmonix-all"' \
  -i 'sonify=false' \
  -i 'visualize=false' \
  -i 'audioSeparator=false' \
  -i 'include_embeddings=false' \
  -i 'audioSeparatorModel="Kim_Vocal_2.onnx"' \
  -i 'include_activations=false'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/erickluis00/all-in-one-audio@sha256:5de3dc64fc11b6a7961f275d759bf06e064e3ca9ca5852fdc30f905e7eaca85c
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "activ": false,
      "embed": false,
      "model": "harmonix-all",
      "sonify": false,
      "visualize": false,
      "audioSeparator": false,
      "include_embeddings": false,
      "audioSeparatorModel": "Kim_Vocal_2.onnx",
      "include_activations": false
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

No output yet! Press "Submit" to start a prediction.