jrc2139/granite-embedding-english-r2-ONNX

By jrc2139 · ↓ 3 · ♥ 1 · Updated 2026-02-06

What's in this repo

This page lists the files in jrc2139/granite-embedding-english-r2-ONNX, including model.onnx, model_qint4.onnx, model_qint8_arm64.onnx and more.

6 ONNX models (.onnx files)
16 files, including 8 .json, 6 .onnx, 1 .md
Last updated 2026-02-06

ONNX files

File	Size	Download
onnx/model.onnx	—	Download
onnx/model_qint4.onnx	—	Download
onnx/model_qint8_arm64.onnx	—	Download
onnx/model_qint8_avx512.onnx	—	Download
onnx/model_qint8_avx512_vnni.onnx	—	Download
onnx/model_quint8_avx2.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

ONNX Quantized versions of ibm-granite/granite-embedding-english-r2

This repository contains ONNX export and multiple quantized versions of ibm-granite/granite-embedding-english-r2.

Usage

from sentence_transformers import SentenceTransformer

# Load Int8 model (ARM64 example)
model = SentenceTransformer(
    "jrc2139/granite-embedding-english-r2-ONNX",
    backend="onnx",
    model_kwargs={"file_name": "onnx/model_qint8_arm64.onnx"},
    trust_remote_code=True
)

Model info

feature-extraction sentence-transformers

sentence-transformers onnx modernbert feature-extraction transformers onnxruntime reranker int8 int4 base_model:ibm-granite/granite-embedding-english-r2 base_model:quantized:ibm-granite/granite-embedding-english-r2 text-embeddings-inference

↓ 3 ♥ 1

Created: 2025-12-11

Updated: 2026-02-06

View on Hugging Face

Files (16)

.gitattributes

1_Pooling/config.json

README.md

config.json

config_sentence_transformers.json

modules.json

onnx/model.onnx ONNX

onnx/model_qint4.onnx ONNX

onnx/model_qint8_arm64.onnx ONNX

onnx/model_qint8_avx512.onnx ONNX

onnx/model_qint8_avx512_vnni.onnx ONNX

onnx/model_quint8_avx2.onnx ONNX

sentence_bert_config.json

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More feature-extraction models

Browse all feature-extraction models