pythn/intent-classification-onnx-quantized

By pythn · ↓ 0 · ♥ 0 · Updated 2025-08-05

What's in this repo

This page lists the files in pythn/intent-classification-onnx-quantized, including model.onnx, model_quantized.onnx.

2 ONNX models (.onnx files)
10 files, including 5 .json, 2 .onnx, 1 .md, 1 .txt
Last updated 2025-08-05

ONNX files

File	Size	Download
onnx/model.onnx	—	Download
onnx/model_quantized.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Intent Classification ONNX Quantized

Quantized ONNX version for fast inference.

Usage

from optimum.onnxruntime import ORTModelForFeatureExtraction
from transformers import AutoTokenizer

model = ORTModelForFeatureExtraction.from_pretrained("pythn/intent-classification-onnx-quantized")
tokenizer = AutoTokenizer.from_pretrained("pythn/intent-classification-onnx-quantized")

text = "I want to book a flight"
inputs = tokenizer(text, return_tensors="pt")
outputs = model(**inputs)

Performance

~4x smaller size
2-4x faster inference
Minimal accuracy loss

Model info

optimum

optimum onnx quantized int8 intent-classification base_model:rbojja/intent-classification-small base_model:quantized:rbojja/intent-classification-small region:us

↓ 0 ♥ 0

Created: 2025-08-05

Updated: 2025-08-05

View on Hugging Face

Files (10)

.gitattributes

README.md

onnx/config.json

onnx/model.onnx ONNX

onnx/model_quantized.onnx ONNX

onnx/ort_config.json

tokenizer/special_tokens_map.json

tokenizer/tokenizer.json

tokenizer/tokenizer_config.json

tokenizer/vocab.txt

Related models

More from pythn

No other models by this author.

More models

No task type declared.