xtlalert/ms-marco-onnx-3
By xtlalert · ↓ 0 · ♥ 0 · Updated 2025-04-09
What's in this repo
This page lists the files in xtlalert/ms-marco-onnx-3, including model_qint8_avx512_vnni.onnx.
- 1 ONNX models (.onnx files)
- 9 files, including 5 .json, 1 .md, 1 .onnx, 1 .txt
- Last updated 2025-04-09
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/model_qint8_avx512_vnni.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
https://huggingface.co/cross-encoder/ms-marco-MiniLM-L-6-v2 with ONNX weights to be compatible with Transformers.js.
Usage (Transformers.js)
If you haven't already, you can install the Transformers.js JavaScript library from NPM using:
npm i @xenova/transformers
Example: Information Retrieval w/ Xenova/ms-marco-MiniLM-L-6-v2.
import { AutoTokenizer, AutoModelForSequenceClassification } from '@xenova/transformers';
const model = await AutoModelForSequenceClassification.from_pretrained('Xenova/ms-marco-MiniLM-L-6-v2');
const tokenizer = await AutoTokenizer.from_pretrained('Xenova/ms-marco-MiniLM-L-6-v2');
const features = tokenizer(
['How many people live in Berlin?', 'How many people live in Berlin?'],
{
text_pair: [
'Berlin has a population of 3,520,031 registered inhabitants in an area of 891.82 square kilometers.',
'New York City is famous for the Metropolitan Museum of Art.',
],
padding: true,
truncation: true,
}
)
const scores = await model(features)
console.log(scores);
// quantized: [ 8.663132667541504, -11.245542526245117 ]
// unquantized: [ 8.845855712890625, -11.245561599731445 ]
Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).
Model info
Created: 2025-04-09
Updated: 2025-04-09
View on Hugging Face