Novadata-Technologies/Reason-ModernColBERT-ONNX-8bit

By Novadata-Technologies · ↓ 0 · ♥ 0 · Updated 2026-03-20

What's in this repo

This page lists the files in Novadata-Technologies/Reason-ModernColBERT-ONNX-8bit, including model.onnx, model_int8.onnx.

2 ONNX models (.onnx files)
7 files, including 3 .json, 2 .onnx, 1 .md
Last updated 2026-03-20

ONNX files

File	Size	Download
model.onnx	—	Download
model_int8.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Reason-ModernColBERT-ONNX-8bit

ONNX export of lightonai/Reason-ModernColBERT for fast CPU inference.

Model Details

Source Model: lightonai/Reason-ModernColBERT
Embedding Dimension: 128
Format: ONNX (FP32 + INT8)

Files

File	Description
`model.onnx`	FP32 ONNX model
`model_int8.onnx`	INT8 quantized model (faster)
`tokenizer.json`	Tokenizer configuration
`config_sentence_transformers.json`	Model configuration

Usage with colbert-onnx (Rust)

use colbert_onnx::Colbert;

let mut model = Colbert::from_pretrained("path/to/model")?;
let embeddings = model.encode_documents(&["Hello world"])?;

Export Tool

This model was exported using pylate-onnx-export:

pip install "pylate-onnx-export @ git+https://github.com/lightonai/next-plaid.git#subdirectory=onnx/python"
pylate-onnx-export lightonai/Reason-ModernColBERT --push-to-hub Novadata-Technologies/Reason-ModernColBERT-ONNX-8bit

Model info

feature-extraction colbert-onnx

colbert-onnx onnx colbert sentence-transformers feature-extraction license:mit region:us

↓ 0 ♥ 0

Created: 2026-03-19

Updated: 2026-03-20

View on Hugging Face

Files (7)

.gitattributes

README.md

config_sentence_transformers.json

model.onnx ONNX

model_int8.onnx ONNX

onnx_config.json

tokenizer.json

Related models

More feature-extraction models

Browse all feature-extraction models