jrc2139/e5-small-v2-ONNX
By jrc2139 · ↓ 0 · ♥ 0 · Updated 2026-02-06
What's in this repo
This page lists the files in jrc2139/e5-small-v2-ONNX, including model.onnx, model_qint4.onnx, model_qint8_arm64.onnx and more.
- 6 ONNX models (.onnx files)
- 17 files, including 8 .json, 6 .onnx, 1 .md, 1 .txt
- Last updated 2026-02-06
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/model.onnx | — | Download |
| onnx/model_qint4.onnx | — | Download |
| onnx/model_qint8_arm64.onnx | — | Download |
| onnx/model_qint8_avx512.onnx | — | Download |
| onnx/model_qint8_avx512_vnni.onnx | — | Download |
| onnx/model_quint8_avx2.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
ONNX Quantized versions of intfloat/e5-small-v2
This repository contains ONNX export and multiple quantized versions of intfloat/e5-small-v2.
Usage
from sentence_transformers import SentenceTransformer
# Load Int8 model (ARM64 example)
model = SentenceTransformer(
"jrc2139/e5-small-v2-ONNX",
backend="onnx",
model_kwargs={"file_name": "onnx/model_qint8_arm64.onnx"},
trust_remote_code=True
)
Model info
feature-extraction
sentence-transformers
sentence-transformers
onnx
bert
feature-extraction
transformers
onnxruntime
reranker
int8
int4
base_model:intfloat/e5-small-v2
base_model:quantized:intfloat/e5-small-v2
text-embeddings-inference
↓ 0
♥ 0
Created: 2025-12-30
Updated: 2026-02-06
View on Hugging FaceFiles (17)
.gitattributes
1_Pooling/config.json
README.md
config.json
config_sentence_transformers.json
modules.json
onnx/model.onnx
ONNX
onnx/model_qint4.onnx
ONNX
onnx/model_qint8_arm64.onnx
ONNX
onnx/model_qint8_avx512.onnx
ONNX
onnx/model_qint8_avx512_vnni.onnx
ONNX
onnx/model_quint8_avx2.onnx
ONNX
sentence_bert_config.json
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.txt