nixiesearch/e5-large-v2-onnx

By nixiesearch · ↓ 6 · ♥ 1 · Updated 2023-11-10

What's in this repo

This page lists the files in nixiesearch/e5-large-v2-onnx, including model.onnx, model_opt2_QInt8.onnx.

2 ONNX models (.onnx files)
10 files, including 5 .json, 2 .onnx, 1 .md, 1 .txt
Last updated 2023-11-10

ONNX files

File	Size	Download
model.onnx	—	Download
model_opt2_QInt8.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

ONNX version of intfloat/e5-large-v2

This is a sentence-transformers model: It maps sentences & paragraphs to a N dimensional dense vector space and can be used for tasks like clustering or semantic search.

The model conversion was made with onnx-convert tool with the following parameters:

python convert.sh --model_id intfloat/e5-large-v2 --quantize QInt8 --optimize 2

There are two versions of model available:

model.onnx - Float32 version, with optimize=2
model_opt2_QInt8.onnx - QInt8 quantized version, with optimize=2

License

Apache 2.0

Model info

feature-extraction sentence-transformers

sentence-transformers onnx bert feature-extraction sentence-similarity en dataset:s2orc dataset:flax-sentence-embeddings/stackexchange_xml dataset:ms_marco dataset:gooaq dataset:yahoo_answers_topics dataset:code_search_net

↓ 6 ♥ 1

Created: 2023-11-07

Updated: 2023-11-10

View on Hugging Face

Files (10)

.gitattributes

README.md

config.json

model.onnx ONNX

model_opt2_QInt8.onnx ONNX

quantize_config.json

special_tokens_map.json

tokenizer.json

tokenizer_config.json

vocab.txt

Related models

More feature-extraction models

Browse all feature-extraction models