llmware/jina-reranker-turbo-onnx

By llmware · ↓ 4 · ♥ 1 · Updated 2025-02-11

What's in this repo

This page lists the files in llmware/jina-reranker-turbo-onnx, including model.onnx, model_bnb4.onnx, model_fp16.onnx and more.

7 ONNX models (.onnx files)
15 files, including 7 .onnx, 5 .json, 1 .md, 1 .txt
Last updated 2025-02-11

ONNX files

File	Size	Download
model.onnx	—	Download
model_bnb4.onnx	—	Download
model_fp16.onnx	—	Download
model_int8.onnx	—	Download
model_q4.onnx	—	Download
model_quantized.onnx	—	Download
model_uint8.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

jina-reranker-turbo-onnx

jina-reranker-turbo-onnx is an OpenVino packaging of Jinaai/jina-reranker-v1-turbo-en, providing a very small, very fast inference implementation, optimized for AI PCs.

jina-reranker-v1-turbo-onnx is a tiny specialized semantic reranker that ranks the similarity between a query and a text passage.

Model Description

Developed by: jinaai
Quantized by: llmware
Model type: jina-reranker-v1-turbo-en
Parameters: 38 million
Model Parent: jinaai/jina-reranker-v1-turbo-en
Language(s) (NLP): English
License: Apache 2.0
Uses: Semantic similarity classification and ranking
RAG Benchmark Accuracy Score: NA
Quantization: fp16

Model Card Contact

llmware on github

llmware on hf

llmware website

Model info

onnx bert green p1 llmware-semantic custom_code base_model:jinaai/jina-reranker-v1-turbo-en base_model:quantized:jinaai/jina-reranker-v1-turbo-en license:apache-2.0 region:us

↓ 4 ♥ 1

Created: 2025-01-12

Updated: 2025-02-11

View on Hugging Face

Files (15)

.gitattributes

README.md

config.json

merges.txt

model.onnx ONNX

model_bnb4.onnx ONNX

model_fp16.onnx ONNX

model_int8.onnx ONNX

model_q4.onnx ONNX

model_quantized.onnx ONNX

model_uint8.onnx ONNX

special_tokens_map.json

tokenizer.json

tokenizer_config.json

vocab.json

Related models

More models

No task type declared.