ONNX 模型库
返回模型

说明文档

<div align="center">

<h1>Retrieval-based-Voice-Conversion-WebUI</h1> 一个简单易用的基于VITS的语音转换(变声器)框架<br><br>

madewithlove

<img src="https://counter.seku.su/cmoe?name=rvc&theme=r34" /><br>

Open In Colab Licence Huggingface

Discord

更新日志 | 常见问题解答 | AutoDL·5分钱训练AI歌手 | 对照实验记录 | 在线演示

</div>


English | 中文简体 | 日本語 | 한국어 (韓國語) | 土耳其语

点击此处查看我们的演示视频!

使用RVC进行实时语音转换:w-okada/voice-changer

基础模型使用近50小时的高质量VCTK开源数据进行训练。无需担心版权问题,请放心使用。

敬请期待RVCv3基础模型:更多参数、更多数据、更好效果、推理速度几乎相同,且训练所需数据更少。

简介

本仓库具有以下特点:

  • 使用top1替换输入源特征为训练集特征,以消除音色泄漏。
  • 即使在相对较低配置的显卡上也能快速训练。
  • 即使训练数据较少也能获得良好效果(建议收集至少10分钟低背景噪音的语音数据)。
  • 可以通过合并模型来改变音色(借助ckpt-merge选项卡)。
  • 简单易用的网页界面。
  • 可以调用UVR5模型快速分离人声和伴奏。
  • 使用最先进的语音音高算法InterSpeech2023-RMVPE来消除哑音问题。效果更好,比crepe_full更快,且资源消耗更少。
  • 支持A卡和I卡的加速。

环境配置

在Python 3.8以上版本的环境中运行以下命令。

(Windows/Linux)
首先通过pip安装主要依赖:

# 安装Pytorch及其核心依赖,如已安装可跳过。
# 参见:https://pytorch.org/get-started/locally/
pip install torch torchvision torchaudio

# 对于使用Nvidia Ampere架构(RTX30xx)的Windows用户,根据#21的经验,需要指定Pytorch对应的CUDA版本。
# pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117

您可以使用poetry来安装依赖:

# 安装Poetry依赖管理工具,如已安装可跳过。
# 参见:https://python-poetry.org/docs/#installation
curl -sSL https://install.python-poetry.org | python3 -

# 使用poetry安装依赖。
poetry install

或者您可以使用pip来安装依赖:

Nvidia显卡:

pip install -r requirements.txt

AMD/Intel显卡:
pip install -r requirements-dml.txt


Mac用户可以执行run.sh来安装依赖:

sh ./run.sh

准备其他预训练模型

RVC需要其他预训练模型进行推理和训练。

您可以从我们的Hugging Face空间下载这些模型。

以下是RVC所需的模型和其他文件列表:

./assets/hubert/hubert_base.pt

./assets/pretrained 

./assets/uvr5_weights

如需测试v2版本的模型,还需下载:

./assets/pretrained_v2

如果您使用Windows,可能需要ffmpeg和ffprobe的以下文件,如果您已经安装了ffmpeg和ffprobe,可以跳过此步骤。

Ubuntu/Debian用户可以使用apt install ffmpeg安装这两个库。Mac用户可以使用brew install ffmpeg安装(前提:已安装brew)。

FFMPEG: https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/ffmpeg.exe

FFPROBE: https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/ffprobe.exe

如果您想使用最新的RMVPE语音音高算法,请下载音高模型参数并将其放在RVC根目录下。

https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/rmvpe.pt

需要DML环境的AMD/Intel显卡用户需要下载:


https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/rmvpe.onnx

然后运行以下命令启动WebUI:

python infer-web.py

如果您使用Windows或macOS,可以下载并解压RVC-beta.7z。Windows用户可以运行go-web.bat来启动WebUI,而macOS用户可以运行sh ./run.sh。

还包含一份新手简易教程.doc供参考。

通过命令行运行

commander.py文件用于在命令行中运行旧模型和新模型,方法如下:

运行早期模型:

runtime\python.exe commander.py 0 "C:\您的根目录路径\INPUTS_VOCAL\vocal.wav" "C:\您的根目录路径\logs\MODEL_v1.index" harvest "test_v1.wav" "C:\您的根目录路径\weights\MODEL_V1.pth" 0.66 cuda:0 True 3 0 1 0.33

新模型:

 runtime\python.exe commander.py 0 "C:\您的根目录路径\INPUTS_VOCAL\vocal.wav" "C:\您的根目录路径\logs\MODEL_v2.index" harvest "test_v2.wav" "C:\您的根目录路径\weights\MODEL.pth" 0.6 cuda:0 True 5 True 3 0 2 0.33

参数说明:

要通过命令行使用此脚本,您需要指定一些参数。以下是命令结构和每个参数的说明:

runtime\python.exe commander.py [f0up_key] [input_path] [index_path] [f0method] [opt_path] [model_path] [index_rate] [device] [is_half] [filter_radius] [resample_sr] [rms_mix_rate] [protect]

参数说明:

  1. python commander.py:此命令用于执行您的Python脚本。

  2. f0up_key:指定基频(F0)更新的键。(例如:0)

  3. input_path:您要处理的输入音频文件路径。(例如:"C:\路径\到\文件\vocal.wav")

  4. index_path:存储或检索处理附加信息的索引文件路径。(例如:"C:\路径\到\文件\logs\MODEL_v2.index")

  5. f0method:用于从音频文件中提取音高(F0)的方法。可选值为"harvest"或"pm"。(例如:"harvest")

  6. opt_path:处理后的音频文件保存路径。(例如:"C:\路径\到\文件\输出.wav")

  7. model_path:用于处理的模型文件路径。(例如:"C:\路径\到\模型\model.pth")

  8. index_rate:处理过程中使用的索引率。必须是浮点数值。(例如:0.6)

  9. device:执行处理的设备。可选值为GPU标识符(如"cuda:0")或"cpu"。(例如:"cuda:0")

  10. is_half:指示模型是否在处理过程中使用混合精度的布尔值。可选值为True或False。(例如:True)

  11. filter_radius:滤波器半径大小,整数值。(例如:5)

  12. resample_sr:重采样的采样率,整数值。(例如:44100)

  13. rms_mix_rate:处理过程中用于调整RMS混音的比率,浮点数值。(例如:0.5)

  14. protect:处理过程中用于调整保护参数的值,浮点数值。(例如:0.33)

使用示例:

python commander.py 0 "C:\路径\到\文件\vocal.wav" "C:\路径\到\文件\logs\MODEL_v2.index" harvest "C:\路径\到\文件\输出.wav" "C:\路径\到\模型\model.pth" 0.6 cuda:0 True 5 44100 0.5 0.33

致谢

感谢所有贡献者的付出

<a href="https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/graphs/contributors" target="_blank"> <img src="https://contrib.rocks/image?repo=RVC-Project/Retrieval-based-Voice-Conversion-WebUI" /> </a>

secretguest/NVIDIA_RVC

作者 secretguest

↓ 0 ♥ 2

创建时间: 2023-09-09 07:35:59+00:00

更新时间: 2025-08-27 22:34:01+00:00

在 Hugging Face 上查看

文件 (227)

.env
.gitattributes
.gitignore
ARCHIVES_FULL/RVC.zip
ARCHIVES_FULL/pretrained.zip
ARCHIVES_FULL/pretrained_v2.zip
Dockerfile
LICENSE
MIT协议暨相关引用库协议
README.md
Retrieval_based_Voice_Conversion_WebUI.ipynb
Retrieval_based_Voice_Conversion_WebUI_v2.ipynb
assets/hubert/hubert_base.pt
assets/pretrained/D32k.pth
assets/pretrained/D40k.pth
assets/pretrained/D48k.pth
assets/pretrained/G32k.pth
assets/pretrained/G40k.pth
assets/pretrained/G48k.pth
assets/pretrained/f0D32k.pth
assets/pretrained/f0D40k.pth
assets/pretrained/f0D48k.pth
assets/pretrained/f0G32k.pth
assets/pretrained/f0G40k.pth
assets/pretrained/f0G48k.pth
assets/pretrained_v2/D32k.pth
assets/pretrained_v2/D40k.pth
assets/pretrained_v2/D48k.pth
assets/pretrained_v2/G32k.pth
assets/pretrained_v2/G40k.pth
assets/pretrained_v2/G48k.pth
assets/pretrained_v2/f0D32k.pth
assets/pretrained_v2/f0D40k.pth
assets/pretrained_v2/f0D48k.pth
assets/pretrained_v2/f0G32k.pth
assets/pretrained_v2/f0G40k.pth
assets/pretrained_v2/f0G48k.pth
assets/rmvpe/rmvpe.onnx ONNX
assets/rmvpe/rmvpe.pt
assets/uvr5_weights/HP2_all_vocals.pth
assets/uvr5_weights/HP3_all_vocals.pth
assets/uvr5_weights/HP5_only_main_vocal.pth
assets/uvr5_weights/VR-DeEchoAggressive.pth
assets/uvr5_weights/VR-DeEchoDeReverb.pth
assets/uvr5_weights/VR-DeEchoNormal.pth
assets/uvr5_weights/onnx_dereverb_By_FoxJoy/vocals.onnx ONNX
assets/weights/guanguanV1.pth
assets/weights/keruanV1.pth
assets/weights/kikiV1.pth
assets/weights/youzhanv2-xi.pth
commander.py
configs/config.json
configs/config.py
configs/v1/32k.json
configs/v1/40k.json
configs/v1/48k.json
configs/v2/32k.json
configs/v2/48k.json
docker-compose.yml
docs/cn/Changelog_CN.md
docs/cn/README.md
docs/cn/faq.md
docs/en/Changelog_EN.md
docs/en/README.en.md
docs/en/faiss_tips_en.md
docs/en/faq_en.md
docs/en/training_tips_en.md
docs/fr/Changelog_FR.md
docs/fr/README.fr.md
docs/fr/faiss_tips_fr.md
docs/fr/faq_fr.md
docs/fr/training_tips_fr.md
docs/jp/README.ja.md
docs/jp/faiss_tips_ja.md
docs/jp/training_tips_ja.md
docs/kr/Changelog_KO.md
docs/kr/README.ko.han.md
docs/kr/README.ko.md
docs/kr/faiss_tips_ko.md
docs/kr/training_tips_ko.md
docs/tr/Changelog_TR.md
docs/tr/README.tr.md
docs/tr/faiss_tips_tr.md
docs/tr/faq_tr.md
docs/tr/training_tips_tr.md
docs/小白简易教程.doc
environment_dml.yaml
ffmpeg.exe
ffprobe.exe
go-fast.bat
go-fast.sh
go-realtime-gui-dml.bat
go-realtime-gui.bat
go-web-dml.bat
go-web.bat
gui_v1.py
i18n/i18n.py
i18n/locale/en_US.json
i18n/locale/es_ES.json
i18n/locale/fr_FR.json
i18n/locale/it_IT.json
i18n/locale/ja_JP.json
i18n/locale/ru_RU.json
i18n/locale/tr_TR.json
i18n/locale/zh_CN.json
i18n/locale/zh_HK.json
i18n/locale/zh_SG.json
i18n/locale/zh_TW.json
i18n/locale_diff.py
i18n/scan_i18n.py
infer-web.py
infer/lib/audio.py
infer/lib/infer_pack/attentions.py
infer/lib/infer_pack/commons.py
infer/lib/infer_pack/models.py
infer/lib/infer_pack/models_onnx.py
infer/lib/infer_pack/modules.py
infer/lib/infer_pack/modules/F0Predictor/DioF0Predictor.py
infer/lib/infer_pack/modules/F0Predictor/F0Predictor.py
infer/lib/infer_pack/modules/F0Predictor/HarvestF0Predictor.py
infer/lib/infer_pack/modules/F0Predictor/PMF0Predictor.py
infer/lib/infer_pack/modules/F0Predictor/__init__.py
infer/lib/infer_pack/onnx_inference.py
infer/lib/infer_pack/transforms.py
infer/lib/rmvpe.py
infer/lib/slicer2.py
infer/lib/train/data_utils.py
infer/lib/train/losses.py
infer/lib/train/mel_processing.py
infer/lib/train/process_ckpt.py
infer/lib/train/utils.py
infer/lib/uvr5_pack/lib_v5/dataset.py
infer/lib/uvr5_pack/lib_v5/layers.py
infer/lib/uvr5_pack/lib_v5/layers_123812KB .py
infer/lib/uvr5_pack/lib_v5/layers_123821KB.py
infer/lib/uvr5_pack/lib_v5/layers_33966KB.py
infer/lib/uvr5_pack/lib_v5/layers_537227KB.py
infer/lib/uvr5_pack/lib_v5/layers_537238KB.py
infer/lib/uvr5_pack/lib_v5/layers_new.py
infer/lib/uvr5_pack/lib_v5/model_param_init.py
infer/lib/uvr5_pack/lib_v5/modelparams/1band_sr16000_hl512.json
infer/lib/uvr5_pack/lib_v5/modelparams/1band_sr32000_hl512.json
infer/lib/uvr5_pack/lib_v5/modelparams/1band_sr33075_hl384.json
infer/lib/uvr5_pack/lib_v5/modelparams/1band_sr44100_hl1024.json
infer/lib/uvr5_pack/lib_v5/modelparams/1band_sr44100_hl256.json
infer/lib/uvr5_pack/lib_v5/modelparams/1band_sr44100_hl512.json
infer/lib/uvr5_pack/lib_v5/modelparams/1band_sr44100_hl512_cut.json
infer/lib/uvr5_pack/lib_v5/modelparams/2band_32000.json
infer/lib/uvr5_pack/lib_v5/modelparams/2band_44100_lofi.json
infer/lib/uvr5_pack/lib_v5/modelparams/2band_48000.json
infer/lib/uvr5_pack/lib_v5/modelparams/3band_44100.json
infer/lib/uvr5_pack/lib_v5/modelparams/3band_44100_mid.json
infer/lib/uvr5_pack/lib_v5/modelparams/3band_44100_msb2.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_44100.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_44100_mid.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_44100_msb.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_44100_msb2.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_44100_reverse.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_44100_sw.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_v2.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_v2_sn.json
infer/lib/uvr5_pack/lib_v5/modelparams/4band_v3.json
infer/lib/uvr5_pack/lib_v5/modelparams/ensemble.json
infer/lib/uvr5_pack/lib_v5/nets.py
infer/lib/uvr5_pack/lib_v5/nets_123812KB.py
infer/lib/uvr5_pack/lib_v5/nets_123821KB.py
infer/lib/uvr5_pack/lib_v5/nets_33966KB.py
infer/lib/uvr5_pack/lib_v5/nets_537227KB.py
infer/lib/uvr5_pack/lib_v5/nets_537238KB.py
infer/lib/uvr5_pack/lib_v5/nets_61968KB.py
infer/lib/uvr5_pack/lib_v5/nets_new.py
infer/lib/uvr5_pack/lib_v5/spec_utils.py
infer/lib/uvr5_pack/name_params.json
infer/lib/uvr5_pack/utils.py
infer/modules/ipex/__init__.py
infer/modules/ipex/attention.py
infer/modules/ipex/gradscaler.py
infer/modules/ipex/hijacks.py
infer/modules/onnx/export.py
infer/modules/train/extract/extract_f0_print.py
infer/modules/train/extract/extract_f0_rmvpe.py
infer/modules/train/extract/extract_f0_rmvpe_dml.py
infer/modules/train/extract_feature_print.py
infer/modules/train/preprocess.py
infer/modules/train/train.py
infer/modules/uvr5/mdxnet.py
infer/modules/uvr5/modules.py
infer/modules/uvr5/preprocess.py
infer/modules/vc/__init__.py
infer/modules/vc/modules.py
infer/modules/vc/pipeline.py
infer/modules/vc/utils.py
logs/mute/0_gt_wavs/mute32k.wav
logs/mute/0_gt_wavs/mute40k.wav
logs/mute/0_gt_wavs/mute48k.wav
logs/mute/1_16k_wavs/mute.wav
logs/mute/2a_f0/mute.wav.npy
logs/mute/2b-f0nsf/mute.wav.npy
logs/mute/3_feature256/mute.npy
logs/mute/3_feature768/mute.npy
myInferFast.py
poetry.lock
pyproject.toml
requirements-dml.txt
requirements-ipex.txt
requirements-win-for-realtime_vc_gui-dml.txt
requirements-win-for-realtime_vc_gui.txt
requirements.txt
run.sh
tools/app.py
tools/calc_rvc_model_similarity.py
tools/dlmodels.bat
tools/dlmodels.sh
tools/export_onnx.py
tools/infer/infer-pm-index256.py
tools/infer/train-index-v2.py
tools/infer/train-index.py
tools/infer/trans_weights.py
tools/infer_batch_rvc.py
tools/infer_cli.py
tools/onnx_inference_demo.py
tools/rvc_for_realtime.py
tools/torchgate/__init__.py
tools/torchgate/torchgate.py
tools/torchgate/utils.py
vc_infer_pipeline.py
venv.sh