luiggy2620/modernbert-onnx
By luiggy2620 · ↓ 3 · ♥ 0 · Updated 2025-08-03
What's in this repo
This page lists the files in luiggy2620/modernbert-onnx, including model_quantized.onnx.
- 1 ONNX models (.onnx files)
- 9 files, including 6 .json, 1 .md, 1 .onnx
- Last updated 2025-08-03
ONNX files
| File | Size | Download |
|---|---|---|
| model_quantized.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
MiniLM-L12-v2 Embed base Legal Public Deed - Matryoshka (ONNX Quantized)
This is an ONNX quantized version of the MiniLM-L12-v2 Embed base Legal Public Deed - Matryoshka model. It has been optimized for faster inference and a smaller file size, while maintaining comparable performance to the original model.
This version is recommended for production deployments and applications where latency and memory footprint are critical, especially when running inference on CPUs or resource-constrained devices.
Model Details
Quantization Architecture
- Quantization Type: Int8 (8-bit quantization).
- Model Size: Significantly reduced compared to the original float32 model.
Model Description
- Model Type: Sentence Transformer (ONNX)
- Base model: sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
- Maximum Sequence Length: 128 tokens
- Output Dimensionality: 384 dimensions
- Similarity Function: Cosine Similarity
- Language: es
- License: apache-2.0
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
- Optimum: Hugging Face Optimum
Usage
To use this quantized ONNX model with the sentence-transformers library, make sure you have the necessary dependencies installed:
pip install -U sentence-transformers optimum onnx onnxruntimeModel info
Created: 2025-07-08
Updated: 2025-08-03
View on Hugging Face