lokkju/nemotron-speech-streaming-en-0.6b-int8

By lokkju · ↓ 0 · ♥ 1 · Updated 2026-01-30

What's in this repo

This page lists the files in lokkju/nemotron-speech-streaming-en-0.6b-int8, including decoder_joint.onnx, encoder.onnx.

2 ONNX models (.onnx files)
5 files, including 2 .onnx, 1 .md, 1 .model
Last updated 2026-01-30

ONNX files

File	Size	Download
decoder_joint.onnx	—	Download
encoder.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

nemotron-speech-streaming-en-0.6b-int8

Quantized ONNX model for streaming speech recognition, derived from altunenes/parakeet-rs (nemotron-speech-streaming-en-0.6b).

Quantization Method

Dynamic int8 quantization (onnxruntime quantize_dynamic, QInt8 weights)

Files

File	Description
`encoder.onnx`	Quantized encoder (stateful, cache-aware streaming)
`decoder_joint.onnx`	Quantized decoder + joint network
`tokenizer.model`	SentencePiece tokenizer (unchanged from source)

Usage

These models are designed for use with parakeet-rs or compatible ONNX Runtime inference pipelines. The encoder is stateful with cache tensors for streaming inference (cache_last_channel, cache_last_time, cache_last_channel_len).

Source

Quantized from the ONNX models in altunenes/parakeet-rs subdirectory nemotron-speech-streaming-en-0.6b/.

Model info

onnx asr speech-recognition streaming quantized int8 base_model:altunenes/parakeet-rs base_model:quantized:altunenes/parakeet-rs license:other region:us

↓ 0 ♥ 1

Created: 2026-01-30

Updated: 2026-01-30

View on Hugging Face

Files (5)

.gitattributes

README.md

decoder_joint.onnx ONNX

encoder.onnx ONNX

tokenizer.model

Related models

More models

No task type declared.