Kutalia/madlad400-3b-mt-onnx

By Kutalia · ↓ 1 · ♥ 1 · Updated 2025-07-27

What's in this repo

This page lists the files in Kutalia/madlad400-3b-mt-onnx, including decoder_model_merged_quantized.onnx, decoder_model_quantized.onnx, decoder_with_past_model_quantized.onnx and more.

4 ONNX models (.onnx files)
12 files, including 5 .json, 4 .onnx, 1 .md, 1 .model
Last updated 2025-07-27

ONNX files

File	Size	Download
onnx/decoder_model_merged_quantized.onnx	—	Download
onnx/decoder_model_quantized.onnx	—	Download
onnx/decoder_with_past_model_quantized.onnx	—	Download
onnx/encoder_model_quantized.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

This is same model as https://huggingface.co/ISoloist1/madlad400-3b-mt-onnx but with folder structure optimized for Transformers.js

ONNX version of google/madlad400-3b-mt

Converted and quantized with optimum-cli

Convert to ONNX:

optimum-cli onnxruntime export --model google/madlad400-3b-mt <output_path> --legacy

Quantization:

optimum-cli onnxruntime quantize --onnx_model <input_model_path> -o <output_model_path> --avx512_vnni

Model info

translation

onnx t5 text2text-generation text-generation-inference translation base_model:google/madlad400-3b-mt base_model:quantized:google/madlad400-3b-mt license:apache-2.0 region:us

↓ 1 ♥ 1

Created: 2025-07-27

Updated: 2025-07-27

View on Hugging Face

Files (12)

.gitattributes

README.md

config.json

onnx/decoder_model_merged_quantized.onnx ONNX

onnx/decoder_model_quantized.onnx ONNX

onnx/decoder_with_past_model_quantized.onnx ONNX

onnx/encoder_model_quantized.onnx ONNX

ort_config.json

special_tokens_map.json

spiece.model

tokenizer.json

tokenizer_config.json

Related models

More from Kutalia

No other models by this author.

More translation models

Browse all translation models