jagilley / free-vc

Change voice for spoken text

  • Public
  • 64.2K runs
  • GitHub
  • Paper
Run with an API
Playground API Examples README Versions

Input

Output

Run time and cost

This model costs approximately $0.051 to run on Replicate, or 19 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 4 minutes.

Readme

Given any spoken text, change the voice of the person who speaks it to another person.

Model description

This model adopts the end-to-end framework of VITS for high-quality waveform reconstruction, and propose strategies for clean content information extraction without text annotation. It disentangles content information by imposing an information bottleneck to WavLM features, and propose the spectrogram-resize based data augmentation to improve the purity of extracted content information.

Model types

There are three model types available: 1. FreeVC-s, the proposed model that uses non-pretrained speaker encoder 2. FreeVC, the proposed model that uses pretrained speaker encoder, and 3. FreeVC (24k), the same as the above but at 24khz