atekrugis/modernbert-intent-router-onnx-quantized
By atekrugis · ↓ 0 · ♥ 0 · Updated 2026-03-21
What's in this repo
This page lists the files in atekrugis/modernbert-intent-router-onnx-quantized, including model_quantized.onnx.
- 1 ONNX models (.onnx files)
- 3 files, including 1 .md, 1 .onnx
- Last updated 2026-03-21
ONNX files
| File | Size | Download |
|---|---|---|
| model_quantized.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
ModernBERT Intent Router - Quantized ONNX
Model Description
This model is an optimized version of atekrugis/intent-router-v11-modernbert. It uses a ModernBERT transformer body for generating embeddings and an XGBoost forest head for intent classification.
Quantization Details
- Format: ONNX
- Optimization Strategy: Dynamic Int8 Quantization
- Quantization Tool:
onnxruntime.quantization
Results
- Original Size: 568.93 MB
- Quantized Size: 142.96 MB
- Size Reduction: 74.9%
Baseline Performance (Pre-Quantization)
- Math Intent: 99.7%
- Coding Intent: 99.9%
- Weather (Agentic) Intent: 99.4%
Usage
This model is designed for high-efficiency CPU inference using ONNX Runtime with significantly reduced memory footprint.
Files (3)
Related models
More from atekrugis
No other models by this author.
More models
No task type declared.