stayallive/whisper-subtitles – Run with an API on Replicate

stayallive / whisper-subtitles

Generate subtitles (.srt and .vtt) from audio files using OpenAI's Whisper models.

Cold

Public
5.2K runs
T4
GitHub
License

Run with an API

Playground API Examples README Versions

Input

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

audio_path

*file

Audio file to generate subtitles for.

model_name

string

Name of the Whisper model to use.

Default: "small"

language

string

Language of the audio.

Default: "en"

vad_filter

boolean

Enable the voice activity detection (VAD) to filter out parts of the audio without speech.

Default: true

Run this model in Node.js with one line of code:

npx create-replicate --model=stayallive/whisper-subtitles

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run stayallive/whisper-subtitles using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "stayallive/whisper-subtitles:b97ba81004e7132181864c885a76cae0e56bc61caa4190a395f6d8ba45b7a969",
  {
    input: {
      language: "en",
      audio_path: "https://replicate.delivery/pbxt/IrETbKtxjksIYsBNRXynBGKpMxCYQzvSjsgsk3XMqp9NkvWc/preamble.wav",
      model_name: "small.en",
      vad_filter: true
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run stayallive/whisper-subtitles using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "stayallive/whisper-subtitles:b97ba81004e7132181864c885a76cae0e56bc61caa4190a395f6d8ba45b7a969",
    input={
        "language": "en",
        "audio_path": "https://replicate.delivery/pbxt/IrETbKtxjksIYsBNRXynBGKpMxCYQzvSjsgsk3XMqp9NkvWc/preamble.wav",
        "model_name": "small.en",
        "vad_filter": True
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run stayallive/whisper-subtitles using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "stayallive/whisper-subtitles:b97ba81004e7132181864c885a76cae0e56bc61caa4190a395f6d8ba45b7a969",
    "input": {
      "language": "en",
      "audio_path": "https://replicate.delivery/pbxt/IrETbKtxjksIYsBNRXynBGKpMxCYQzvSjsgsk3XMqp9NkvWc/preamble.wav",
      "model_name": "small.en",
      "vad_filter": true
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

preview

We, the people of the United States, in order to form a more perfect union, establish justice, ensure domestic tranquility, provide for the common defense, promote the general welfare, and secure the blessings of liberty to ourselves and our posterity to ordain and establish this Constitution for the United States of America.

srt_file

tmplcado2_xpreamble.en.srt

vtt_file

tmplcado2_xpreamble.en.vtt

Generated in

8.0 seconds

Tweak itReport

This output was created using a different version of the model, stayallive/whisper-subtitles:4fcbb183.

Run time and cost

This model costs approximately $0.052 to run on Replicate, or 19 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 4 minutes. The predict time for this model varies significantly based on the inputs.

Readme

Generate subtitles (.srt and .vtt) from audio files using OpenAI’s Whisper models.

Using faster-whisper, a reimplementation of OpenAI’s Whisper model using CTranslate2, which is a fast inference engine for Transformer models.

This is a fork of m1guelpf/whisper-subtitles with added support for VAD, selecting a language, use the language specific models and download the .vtt/.srt files directly from the result.