erium / whisperx

audio: Video Player is loading.
Current Time 00:00:000
Duration 00:00:000
Loaded: 0%
Stream Type LIVE
Remaining Time 00:00:000

1x
Chapters
descriptions off, selected
captions settings, opens captions settings dialog
captions off, selected
Beginning of dialog window. Escape will cancel and close the window.
TextColorTransparency
BackgroundColorTransparency
WindowColorTransparency
Font Size
Text Edge Style
Font Family
End of dialog window.
debug
diarize
language: de
batch_size: 32

{
  "audio": "https://replicate.delivery/pbxt/K3BGhaLBJ3nhPfDteXbTA8xIuQvC5dR3wViyiX0OKuzrVJ6f/erium.wav",
  "debug": false,
  "diarize": true,
  "language": "de",
  "batch_size": 32
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run erium/whisperx using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "erium/whisperx:73d8393ff3c06a6de2b03634c984912b5981f03b323f13715ceabfba071acd77",
  {
    input: {
      audio: "https://replicate.delivery/pbxt/K3BGhaLBJ3nhPfDteXbTA8xIuQvC5dR3wViyiX0OKuzrVJ6f/erium.wav",
      debug: false,
      diarize: true,
      language: "de",
      batch_size: 32
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run erium/whisperx using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "erium/whisperx:73d8393ff3c06a6de2b03634c984912b5981f03b323f13715ceabfba071acd77",
    input={
        "audio": "https://replicate.delivery/pbxt/K3BGhaLBJ3nhPfDteXbTA8xIuQvC5dR3wViyiX0OKuzrVJ6f/erium.wav",
        "debug": False,
        "diarize": True,
        "language": "de",
        "batch_size": 32
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run erium/whisperx using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "erium/whisperx:73d8393ff3c06a6de2b03634c984912b5981f03b323f13715ceabfba071acd77",
    "input": {
      "audio": "https://replicate.delivery/pbxt/K3BGhaLBJ3nhPfDteXbTA8xIuQvC5dR3wViyiX0OKuzrVJ6f/erium.wav",
      "debug": false,
      "diarize": true,
      "language": "de",
      "batch_size": 32
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

[{"text": " Ihr h\u00f6rt die IRIUM Podcast, der Data Science und Machine Learning Podcast f\u00fcr Young Professionals und Studienabsolventen, die wirklich wissen wollen, was in der Arbeitswelt abgeht.", "start": 0.009, "end": 10.742, "speaker": "SPEAKER_00"}]

{
  "completed_at": "2023-12-15T01:24:04.328650Z",
  "created_at": "2023-12-15T01:19:21.467078Z",
  "data_removed": false,
  "error": null,
  "id": "hduvntbbvadmwa2dcfd3ko5xle",
  "input": {
    "audio": "https://replicate.delivery/pbxt/K3BGhaLBJ3nhPfDteXbTA8xIuQvC5dR3wViyiX0OKuzrVJ6f/erium.wav",
    "debug": false,
    "diarize": true,
    "language": "de",
    "batch_size": 32
  },
  "logs": "Lightning automatically upgraded your loaded checkpoint from v1.5.4 to v2.1.2. To apply the upgrade to your files permanently, run `python -m pytorch_lightning.utilities.upgrade_checkpoint torch_models/whisperx-vad-segmentation.bin`\nModel was trained with pyannote.audio 0.0.1, yours is 3.1.0. Bad things might happen unless you revert pyannote.audio to 0.x.\nModel was trained with torch 1.10.0+cu102, yours is 2.0.0+cu117. Bad things might happen unless you revert torch to 1.x.\npytorch_model.bin:   0%|          | 0.00/26.6M [00:00<?, ?B/s]\npytorch_model.bin:  39%|███▉      | 10.5M/26.6M [00:00<00:00, 60.1MB/s]\npytorch_model.bin: 100%|██████████| 26.6M/26.6M [00:00<00:00, 93.8MB/s]\npytorch_model.bin: 100%|██████████| 26.6M/26.6M [00:00<00:00, 85.6MB/s]\nconfig.yaml:   0%|          | 0.00/221 [00:00<?, ?B/s]\nconfig.yaml: 100%|██████████| 221/221 [00:00<00:00, 893kB/s]",
  "metrics": {
    "predict_time": 17.522428,
    "total_time": 282.861572
  },
  "output": "[{\"text\": \" Ihr h\\u00f6rt die IRIUM Podcast, der Data Science und Machine Learning Podcast f\\u00fcr Young Professionals und Studienabsolventen, die wirklich wissen wollen, was in der Arbeitswelt abgeht.\", \"start\": 0.009, \"end\": 10.742, \"speaker\": \"SPEAKER_00\"}]",
  "started_at": "2023-12-15T01:23:46.806222Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/hduvntbbvadmwa2dcfd3ko5xle",
    "cancel": "https://api.replicate.com/v1/predictions/hduvntbbvadmwa2dcfd3ko5xle/cancel"
  },
  "version": "73d8393ff3c06a6de2b03634c984912b5981f03b323f13715ceabfba071acd77"
}

Generated in

17.5 seconds

Tweak it Share Report View full prediction

Want to make some of these yourself?

Run this model