raphaelsty/model-test
By raphaelsty · ↓ 0 · ♥ 0 · Updated 2026-01-23
What's in this repo
This page lists the files in raphaelsty/model-test, including model.onnx, model_int8.onnx.
- 2 ONNX models (.onnx files)
- 7 files, including 3 .json, 2 .onnx, 1 .md
- Last updated 2026-01-23
ONNX files
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
model-test
ONNX export of mixedbread-ai/mxbai-edge-colbert-v0-32m for fast CPU inference.
Model Details
- Source Model: mixedbread-ai/mxbai-edge-colbert-v0-32m
- Embedding Dimension: 64
- Format: ONNX (FP32 + INT8)
Files
| File | Description |
|---|---|
model.onnx |
FP32 ONNX model |
model_int8.onnx |
INT8 quantized model (faster) |
tokenizer.json |
Tokenizer configuration |
config_sentence_transformers.json |
Model configuration |
Usage with colbert-onnx (Rust)
use colbert_onnx::Colbert;
let mut model = Colbert::from_pretrained("path/to/model")?;
let embeddings = model.encode_documents(&["Hello world"])?;
Export Tool
This model was exported using pylate-onnx-export:
pip install "pylate-onnx-export @ git+https://github.com/lightonai/next-plaid.git#subdirectory=onnx/python"
pylate-onnx-export mixedbread-ai/mxbai-edge-colbert-v0-32m --push-to-hub raphaelsty/model-test
Model info
feature-extraction
colbert-onnx
colbert-onnx
onnx
colbert
sentence-transformers
feature-extraction
license:mit
region:us
↓ 0
♥ 0
Created: 2026-01-23
Updated: 2026-01-23
View on Hugging FaceFiles (7)
.gitattributes
README.md
config_sentence_transformers.json
model.onnx
ONNX
model_int8.onnx
ONNX
onnx_config.json
tokenizer.json