TrendHD/all-MiniLM-L6-v2-int8
By TrendHD · ↓ 1 · ♥ 0 · Updated 2026-02-05
What's in this repo
This page lists the files in TrendHD/all-MiniLM-L6-v2-int8, including all-MiniLM-L6-v2-int8.onnx.
- 1 ONNX models (.onnx files)
- 8 files, including 4 .json, 1 .md, 1 .onnx, 1 .txt
- Last updated 2026-02-05
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/all-MiniLM-L6-v2-int8.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
all-MiniLM-L6-v2 (INT8, ONNX)
This repository contains an INT8-quantized version of all-MiniLM-L6-v2. The quantize dynamic quantization method was used for maximum cross-platform compatibility.
Based on the original model: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2
Post-training INT8 quantization
Optimized for cross-platform compatibility
Suitable for embeddings, semantic search, and text classification
Note: This is a derivative work with quantization only.
Model info
sentence-similarity
sentence-transformers
sentence-transformers
onnx
bert
int8
dynamic
sentence-similarity
en
base_model:sentence-transformers/all-MiniLM-L6-v2
base_model:quantized:sentence-transformers/all-MiniLM-L6-v2
license:apache-2.0
text-embeddings-inference
endpoints_compatible
↓ 1
♥ 0
Created: 2026-02-05
Updated: 2026-02-05
View on Hugging FaceFiles (8)
.gitattributes
README.md
config.json
onnx/all-MiniLM-L6-v2-int8.onnx
ONNX
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.txt