k2-fsa/ZipVoice
By k2-fsa · ↓ 0 · ♥ 44 · Updated 2025-08-19
What's in this repo
This page lists the files in k2-fsa/ZipVoice, including fm_decoder.onnx, fm_decoder_int8.onnx, text_encoder.onnx and more.
- 8 ONNX models (.onnx files)
- 40 files, including 14 .json, 8 .onnx, 7 .pt, 7 .txt, 2 .safetensors, 1 .md
- Repository size ~5.3 GB
- Last updated 2025-08-19
ONNX files
| File | Size | Download |
|---|---|---|
| zipvoice/fm_decoder.onnx | 455 MB | Download |
| zipvoice/fm_decoder_int8.onnx | 119 MB | Download |
| zipvoice/text_encoder.onnx | 16.8 MB | Download |
| zipvoice/text_encoder_int8.onnx | 5.3 MB | Download |
| zipvoice_distill/fm_decoder.onnx | 455 MB | Download |
| zipvoice_distill/fm_decoder_int8.onnx | 119 MB | Download |
| zipvoice_distill/text_encoder.onnx | 16.8 MB | Download |
| zipvoice_distill/text_encoder_int8.onnx | 5.3 MB | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
ZipVoice⚡: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching
This model consists of checkpoints for two fast and high-quality non-autoregressive zero-shot text-to-speech models:
-
ZipVoice, for single-speaker speech generation. Details in paper and demo.
-
ZipVoice-Dialog, for spoken dialogue generation. Details in paper and demo.
See our Github repository ZipVoice for instructions on using our models.
1. Explanation of each directory
| Directory | Model Type | Training Data | Initialized from |
|---|---|---|---|
| zipvoice | ZipVoice | Emilia | - |
| zipvoice_libritts | ZipVoice | LibriTTS | - |
| zipvoice_distill | ZipVoice-Distill | Emilia | zipvoice/model.pt |
| zipvoice_distill_libritts | ZipVoice-Distill | LibriTTS | zipvoice_libritts/model.pt |
| zipvoice_dialog | ZipVoice-Dialog | OpenDialog + in-house dataset | zipvoice/model.pt |
| zipvoice_dialog_opendialog | ZipVoice-Dialog | OpenDialog | zipvoice/model.pt |
| zipvoice_dialog_stereo | ZipVoice-Dialog-Stereo | in-house dataset | zipvoice_dialog/model.pt |
2. Discussion & Communication
You can directly discuss on Github Issues.
You can also scan the QR code to join our wechat group or follow our wechat official account.
| Wechat Group | Wechat Official Account |
|---|---|
 |
 |
3. Citation
@article{zhu2025zipvoice,
title={ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching},
author={Zhu, Han and Kang, Wei and Yao, Zengwei and Guo, Liyong and Kuang, Fangjun and Li, Zhaoqing and Zhuang, Weiji and Lin, Long and Povey, Daniel},
journal={arXiv preprint arXiv:2506.13053},
year={2025}
}
@article{zhu2025zipvoicedialog,
title={ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching},
author={Zhu, Han and Kang, Wei and Guo, Liyong and Yao, Zengwei and Kuang, Fangjun and Zhuang, Weiji and Li, Zhaoqing and Han, Zhifeng and Zhang, Dong and Zhang, Xin and Song, Xingchen and Lin, Long and Povey, Daniel},
journal={arXiv preprint arXiv:2507.09318},
year={2025}
}
Model info
Created: 2025-06-15
Updated: 2025-08-19
View on Hugging Face