pseudoram / rvc-v2

Speech to speech with any RVC v2 trained AI voice

Warm

Public
623.1K runs
T4
GitHub
License

Run with an API

Playground API Examples README Versions

Input

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

input_audio

file

Upload your audio file here.

rvc_model

string

RVC model for a specific voice. If using a custom model, this should match the name of the downloaded model. If a 'custom_rvc_model_download_url' is provided, this will be automatically set to the name of the downloaded model.

Default: "Obama"

custom_rvc_model_download_url

string

Shift + Return to add a new line

https://huggingface.co/Argax/doofenshmirtz-RUS/resolve/main/doofenshmirtz.ziphttps://huggingface.co/Argax/doofenshmirtz-RUS/resolve/main/doofenshmirtz.zip

URL to download a custom RVC model. If provided, the model will be downloaded (if it doesn't already exist) and used for prediction, regardless of the 'rvc_model' value.

pitch_change

number

Adjust pitch of AI vocals in semitones. Use positive values to increase pitch, negative to decrease.

Default: 0

index_rate

number

(minimum: 0, maximum: 1)

Control how much of the AI's accent to leave in the vocals.

Default: 0.5

filter_radius

integer

(minimum: 0, maximum: 7)

If >=3: apply median filtering to the harvested pitch results.

Default: 3

rms_mix_rate

number

(minimum: 0, maximum: 1)

Control how much to use the original vocal's loudness (0) or a fixed loudness (1).

Default: 0.25

f0_method

string

Pitch detection algorithm. 'rmvpe' for clarity in vocals, 'mangio-crepe' for smoother vocals.

Default: "rmvpe"

crepe_hop_length

integer

When `f0_method` is set to `mangio-crepe`, this controls how often it checks for pitch changes in milliseconds.

Default: 128

protect

number

(minimum: 0, maximum: 0.5)

Control how much of the original vocals' breath and voiceless consonants to leave in the AI vocals. Set 0.5 to disable.

Default: 0.33

output_format

string

wav for best quality and large file size, mp3 for decent quality and small file size.

Default: "mp3"

Run this model in Node.js with one line of code:

npx create-replicate --model=pseudoram/rvc-v2

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run pseudoram/rvc-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "pseudoram/rvc-v2:d18e2e0a6a6d3af183cc09622cebba8555ec9a9e66983261fc64c8b1572b7dce",
  {
    input: {
      protect: 0.5,
      f0_method: "rmvpe",
      rvc_model: "CUSTOM",
      index_rate: 1,
      input_audio: "https://replicate.delivery/pbxt/LAxQbQLiKJZevqiV9Raodpdd6W0ihu3Wnb1K6xCpE6rcUIu5/ttsMP3.com_VoiceText_2024-6-29_0-22-2.mp3",
      pitch_change: 8,
      rms_mix_rate: 1,
      filter_radius: 1,
      output_format: "mp3",
      crepe_hop_length: 128,
      custom_rvc_model_download_url: "https://huggingface.co/Argax/doofenshmirtz-RUS/resolve/main/doofenshmirtz.zip"
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run pseudoram/rvc-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "pseudoram/rvc-v2:d18e2e0a6a6d3af183cc09622cebba8555ec9a9e66983261fc64c8b1572b7dce",
    input={
        "protect": 0.5,
        "f0_method": "rmvpe",
        "rvc_model": "CUSTOM",
        "index_rate": 1,
        "input_audio": "https://replicate.delivery/pbxt/LAxQbQLiKJZevqiV9Raodpdd6W0ihu3Wnb1K6xCpE6rcUIu5/ttsMP3.com_VoiceText_2024-6-29_0-22-2.mp3",
        "pitch_change": 8,
        "rms_mix_rate": 1,
        "filter_radius": 1,
        "output_format": "mp3",
        "crepe_hop_length": 128,
        "custom_rvc_model_download_url": "https://huggingface.co/Argax/doofenshmirtz-RUS/resolve/main/doofenshmirtz.zip"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run pseudoram/rvc-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "d18e2e0a6a6d3af183cc09622cebba8555ec9a9e66983261fc64c8b1572b7dce",
    "input": {
      "protect": 0.5,
      "f0_method": "rmvpe",
      "rvc_model": "CUSTOM",
      "index_rate": 1,
      "input_audio": "https://replicate.delivery/pbxt/LAxQbQLiKJZevqiV9Raodpdd6W0ihu3Wnb1K6xCpE6rcUIu5/ttsMP3.com_VoiceText_2024-6-29_0-22-2.mp3",
      "pitch_change": 8,
      "rms_mix_rate": 1,
      "filter_radius": 1,
      "output_format": "mp3",
      "crepe_hop_length": 128,
      "custom_rvc_model_download_url": "https://huggingface.co/Argax/doofenshmirtz-RUS/resolve/main/doofenshmirtz.zip"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

{
  "completed_at": "2024-06-28T15:50:05.133598Z",
  "created_at": "2024-06-28T15:49:57.082000Z",
  "data_removed": false,
  "error": null,
  "id": "0aknpm7wv9rge0cgby4t7qwfe8",
  "input": {
    "protect": 0.5,
    "f0_method": "rmvpe",
    "rvc_model": "CUSTOM",
    "index_rate": 1,
    "input_audio": "https://replicate.delivery/pbxt/LAxQbQLiKJZevqiV9Raodpdd6W0ihu3Wnb1K6xCpE6rcUIu5/ttsMP3.com_VoiceText_2024-6-29_0-22-2.mp3",
    "pitch_change": 8,
    "rms_mix_rate": 1,
    "filter_radius": 1,
    "output_format": "mp3",
    "crepe_hop_length": 128,
    "custom_rvc_model_download_url": "https://huggingface.co/Argax/doofenshmirtz-RUS/resolve/main/doofenshmirtz.zip"
  },
  "logs": "[!] The model will be downloaded as 'doofenshmirtz'.\n[!] Voice model directory doofenshmirtz already exists. Overwriting...\n[*] Downloading model from https://huggingface.co/Argax/doofenshmirtz-RUS/resolve/main/doofenshmirtz.zip...\n[*] Extracting model to /src/rvc_models/doofenshmirtz...\n2024-06-28 15:49:59 | INFO | fairseq.tasks.hubert_pretraining | current directory is /src\n2024-06-28 15:49:59 | INFO | fairseq.tasks.hubert_pretraining | HubertPretrainingTask Config {'_name': 'hubert_pretraining', 'data': 'metadata', 'fine_tuning': False, 'labels': ['km'], 'label_dir': 'label', 'label_rate': 50.0, 'sample_rate': 16000, 'normalize': False, 'enable_padding': False, 'max_keep_size': None, 'max_sample_size': 250000, 'min_sample_size': 32000, 'single_target': False, 'random_crop': True, 'pad_audio': False}\n2024-06-28 15:49:59 | INFO | fairseq.models.hubert.hubert | HubertModel Config: {'_name': 'hubert', 'label_rate': 50.0, 'extractor_mode': default, 'encoder_layers': 12, 'encoder_embed_dim': 768, 'encoder_ffn_embed_dim': 3072, 'encoder_attention_heads': 12, 'activation_fn': gelu, 'layer_type': transformer, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation_dropout': 0.0, 'encoder_layerdrop': 0.05, 'dropout_input': 0.1, 'dropout_features': 0.1, 'final_dim': 256, 'untie_final_proj': True, 'layer_norm_first': False, 'conv_feature_layers': '[(512,10,5)] + [(512,3,2)] * 4 + [(512,2,2)] * 2', 'conv_bias': False, 'logit_temp': 0.1, 'target_glu': False, 'feature_grad_mult': 0.1, 'mask_length': 10, 'mask_prob': 0.8, 'mask_selection': static, 'mask_other': 0.0, 'no_mask_overlap': False, 'mask_min_space': 1, 'mask_channel_length': 10, 'mask_channel_prob': 0.0, 'mask_channel_selection': static, 'mask_channel_other': 0.0, 'no_mask_channel_overlap': False, 'mask_channel_min_space': 1, 'conv_pos': 128, 'conv_pos_groups': 16, 'latent_temp': [2.0, 0.5, 0.999995], 'skip_masked': False, 'skip_nomask': False, 'checkpoint_activations': False, 'required_seq_len_multiple': 2, 'depthwise_conv_kernel_size': 31, 'attn_type': '', 'pos_enc_type': 'abs', 'fp16': False}\ngin_channels: 256 self.spk_embed_dim: 109\n<All keys matched successfully>\n[+] Converted audio generated at /src/voice_output/converted_tmp_fayvycvttsMP3.com_VoiceText_2024-6-29_0-22-2.wav",
  "metrics": {
    "predict_time": 8.007438933,
    "total_time": 8.051598
  },
  "output": "https://replicate.delivery/czjl/GuWgtsY9FsoUFd2oGDoCfIlygLtPcShApT96mYi02VCWbkhJA/converted_tmp_fayvycvttsMP3.com_VoiceText_2024-6-29_0-22-2.wav",
  "started_at": "2024-06-28T15:49:57.126159Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/0aknpm7wv9rge0cgby4t7qwfe8",
    "cancel": "https://api.replicate.com/v1/predictions/0aknpm7wv9rge0cgby4t7qwfe8/cancel"
  },
  "version": "d18e2e0a6a6d3af183cc09622cebba8555ec9a9e66983261fc64c8b1572b7dce"
}

Generated in

8.0 seconds

Tweak it ShareReport

[!] The model will be downloaded as 'doofenshmirtz'.
[!] Voice model directory doofenshmirtz already exists. Overwriting...
[*] Downloading model from https://huggingface.co/Argax/doofenshmirtz-RUS/resolve/main/doofenshmirtz.zip...
[*] Extracting model to /src/rvc_models/doofenshmirtz...
2024-06-28 15:49:59 | INFO | fairseq.tasks.hubert_pretraining | current directory is /src
2024-06-28 15:49:59 | INFO | fairseq.tasks.hubert_pretraining | HubertPretrainingTask Config {'_name': 'hubert_pretraining', 'data': 'metadata', 'fine_tuning': False, 'labels': ['km'], 'label_dir': 'label', 'label_rate': 50.0, 'sample_rate': 16000, 'normalize': False, 'enable_padding': False, 'max_keep_size': None, 'max_sample_size': 250000, 'min_sample_size': 32000, 'single_target': False, 'random_crop': True, 'pad_audio': False}
2024-06-28 15:49:59 | INFO | fairseq.models.hubert.hubert | HubertModel Config: {'_name': 'hubert', 'label_rate': 50.0, 'extractor_mode': default, 'encoder_layers': 12, 'encoder_embed_dim': 768, 'encoder_ffn_embed_dim': 3072, 'encoder_attention_heads': 12, 'activation_fn': gelu, 'layer_type': transformer, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation_dropout': 0.0, 'encoder_layerdrop': 0.05, 'dropout_input': 0.1, 'dropout_features': 0.1, 'final_dim': 256, 'untie_final_proj': True, 'layer_norm_first': False, 'conv_feature_layers': '[(512,10,5)] + [(512,3,2)] * 4 + [(512,2,2)] * 2', 'conv_bias': False, 'logit_temp': 0.1, 'target_glu': False, 'feature_grad_mult': 0.1, 'mask_length': 10, 'mask_prob': 0.8, 'mask_selection': static, 'mask_other': 0.0, 'no_mask_overlap': False, 'mask_min_space': 1, 'mask_channel_length': 10, 'mask_channel_prob': 0.0, 'mask_channel_selection': static, 'mask_channel_other': 0.0, 'no_mask_channel_overlap': False, 'mask_channel_min_space': 1, 'conv_pos': 128, 'conv_pos_groups': 16, 'latent_temp': [2.0, 0.5, 0.999995], 'skip_masked': False, 'skip_nomask': False, 'checkpoint_activations': False, 'required_seq_len_multiple': 2, 'depthwise_conv_kernel_size': 31, 'attn_type': '', 'pos_enc_type': 'abs', 'fp16': False}
gin_channels: 256 self.spk_embed_dim: 109
<All keys matched successfully>
[+] Converted audio generated at /src/voice_output/converted_tmp_fayvycvttsMP3.com_VoiceText_2024-6-29_0-22-2.wav

Run time and cost

This model costs approximately $0.0029 to run on Replicate, or 344 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 13 seconds.

Readme

RVC Voice Transformer v2

Transform any voice with the power of RVC v2 models!

🌟 Highlights

User-friendly
Custom RVC v2 model support
Fine-tuned voice conversion settings

🔍 Model Hunt

Discover new voices on platforms like Hugging Face. Find, import, and start transforming!

⚠️ Use Responsibly

Avoid using for:

Personal attacks
Ideological propaganda
Unauthorized impersonation
Fraudulent activities

Remember: With great power comes great responsibility!

🙏 Credits

Built upon SociallyIneptWeeb’s AICoverGen, inspired by zsxkib, reimagined by PseudoRAM.

📜 License

MIT License - See LICENSE for the fine print.

Disclaimer: Creator not responsible for misuse. Use at your own risk!