jrc2139/embeddinggemma-300m-qat-q8_0-unquantized-ONNX

By jrc2139 · ↓ 12 · ♥ 0 · Updated 2026-02-27

What's in this repo

This page lists the files in jrc2139/embeddinggemma-300m-qat-q8_0-unquantized-ONNX, including model.onnx, model_q4.onnx, model_qint8_arm64.onnx and more.

6 ONNX models (.onnx files)
20 files, including 10 .json, 6 .onnx, 2 .safetensors, 1 .md
Last updated 2026-02-27

ONNX files

File	Size	Download
onnx/model.onnx	—	Download
onnx/model_q4.onnx	—	Download
onnx/model_qint8_arm64.onnx	—	Download
onnx/model_qint8_avx512.onnx	—	Download
onnx/model_qint8_avx512_vnni.onnx	—	Download
onnx/model_quint8_avx2.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

ONNX Quantized versions of google/embeddinggemma-300m

This repository contains ONNX export and multiple quantized versions of google/embeddinggemma-300m-qat-q8_0-unquantized.

Usage

from sentence_transformers import SentenceTransformer

# Load Int8 model (ARM64 example)
model = SentenceTransformer(
    "jrc2139/embeddinggemma-300m",
    backend="onnx",
    model_kwargs={"file_name": "onnx/model_q4.onnx"},
    trust_remote_code=True
)

Model info

feature-extraction sentence-transformers

sentence-transformers onnx safetensors gemma3_text feature-extraction transformers onnxruntime reranker int8 int4 base_model:google/embeddinggemma-300m base_model:quantized:google/embeddinggemma-300m

↓ 12 ♥ 0

Created: 2026-02-06

Updated: 2026-02-27

View on Hugging Face

Files (20)

.gitattributes

1_Pooling/config.json

2_Dense/config.json

2_Dense/model.safetensors

3_Dense/config.json

3_Dense/model.safetensors

README.md

config.json

config_sentence_transformers.json

modules.json

onnx/model.onnx ONNX

onnx/model_q4.onnx ONNX

onnx/model_qint8_arm64.onnx ONNX

onnx/model_qint8_avx512.onnx ONNX

onnx/model_qint8_avx512_vnni.onnx ONNX

onnx/model_quint8_avx2.onnx ONNX

sentence_bert_config.json

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More feature-extraction models

Browse all feature-extraction models