ONNX Model Zoo

lightonai/answerai-colbert-small-v1-onnx

By lightonai · ↓ 0 · ♥ 1 · Updated 2026-01-22

What's in this repo

This page lists the files in lightonai/answerai-colbert-small-v1-onnx, including model.onnx, model_int8.onnx.

  • 2 ONNX models (.onnx files)
  • 7 files, including 3 .json, 2 .onnx, 1 .md
  • Last updated 2026-01-22

ONNX files

File Size Download
model.onnx — Download
model_int8.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

answerai-colbert-small-v1-onnx

ONNX export of answerdotai/answerai-colbert-small-v1 for fast CPU inference.

Model Details

Files

File Description
model.onnx FP32 ONNX model
model_int8.onnx INT8 quantized model (faster)
tokenizer.json Tokenizer configuration
config_sentence_transformers.json Model configuration

Usage with colbert-onnx (Rust)

use colbert_onnx::Colbert;

let mut model = Colbert::from_pretrained("path/to/model")?;
let embeddings = model.encode_documents(&["Hello world"])?;

Export Tool

This model was exported using pylate-onnx-export:

pip install "pylate-onnx-export @ git+https://github.com/lightonai/next-plaid.git#subdirectory=onnx/python"
pylate-onnx-export answerdotai/answerai-colbert-small-v1 --push-to-hub lightonai/answerai-colbert-small-v1-onnx

Model info

feature-extraction colbert-onnx
colbert-onnx onnx colbert sentence-transformers feature-extraction license:mit region:eu
↓ 0 ♥ 1

Created: 2026-01-22

Updated: 2026-01-22

View on Hugging Face

Files (7)

.gitattributes
README.md
config_sentence_transformers.json
model.onnx ONNX
model_int8.onnx ONNX
onnx_config.json
tokenizer.json

Related models

More from lightonai

More feature-extraction models

Browse all feature-extraction models

Popular models