license: cc-by-4.0 datasets:

• openslr/librispeech_asr language:
• en pipeline_tag: audio-to-audio

SSLZip

使用方法

import onnxruntime as ort
from transformers import HubertModel
import torch

# 加载上游 HuBERT 模型
upstream = HubertModel.from_pretrained("facebook/hubert-base-ls960")
upstream.eval()

# 加载自编码器模型
postprocessor = ort.InferenceSession("sslzip_16.onnx")
node_name = postprocessor.get_inputs()[0].name

# 准备输入波形（假设为 16kHz 音频）
x = torch.randn(1, 16000)

# 提取用于下游任务的潜在表示
with torch.inference_mode():
    h = upstream(x, output_hidden_states=True).hidden_states[-1]
    z = postprocessor.run(None, {node_name: h.cpu().numpy()})[0]

# 按需使用 z
print(z.shape)

许可协议

该预训练模型使用 LibriSpeech 语料库开发，并在相同许可协议（CC BY 4.0）下分发。
使用本模型时，请注明名古屋工业大学和 Techno-Speech, Inc. 的贡献。

引用

@InProceedings{yoshimura2025sslzip,
  author = {Takenori Yoshimura and Shinji Takaki and Kazuhiro Nakamura and Keiichiro Oura and Takato Fujimoto and Kei Hashimoto and Yoshihiko Nankaku and Keiichi Tokuda},
  title = {{SSLZip}: Simple autoencoding for enhancing self-supervised speech representations in speech generation},
  booktitle = {13th ISCA Speech Synthesis Workshop (SSW 2025)},
  pages = {xxx--xxx},
  year = {2025},
}