lelloman/xlm-roberta-base-onnx-int8

By lelloman · ↓ 0 · ♥ 0 · Updated 2025-12-31

What's in this repo

This page lists the files in lelloman/xlm-roberta-base-onnx-int8, including xlm_roberta_base_int8.onnx.

1 ONNX models (.onnx files)
3 files, including 1 .md, 1 .onnx
Last updated 2025-12-31

ONNX files

File	Size	Download
xlm_roberta_base_int8.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

XLM-RoBERTa Base ONNX (INT8 Quantized)

INT8 quantized ONNX export of xlm-roberta-base for efficient on-device inference.

Model Details

Base model: xlm-roberta-base (278M params)
Format: ONNX
Quantization: INT8 dynamic quantization
Size: ~509MB (vs ~1.1GB unquantized)

Usage

This model is designed for use with LoRA adapters applied at runtime. The weights are exported with do_constant_folding=False to allow in-memory patching.

Files

xlm_roberta_base_int8.onnx - INT8 quantized ONNX model

Export Details

Exported using:

transformers
optimum
onnxruntime

With dynamic INT8 quantization for reduced model size while maintaining accuracy.

Model info

onnx xlm-roberta int8 quantized license:mit region:us

↓ 0 ♥ 0

Created: 2025-12-31

Updated: 2025-12-31

View on Hugging Face

Files (3)

.gitattributes

README.md

xlm_roberta_base_int8.onnx ONNX

Related models

More models

No task type declared.