keisuke-miyako/gemma-2-2B-it-onnx-int4

By keisuke-miyako · ↓ 0 · ♥ 0 · Updated 2026-02-18

What's in this repo

This page lists the files in keisuke-miyako/gemma-2-2B-it-onnx-int4, including model.onnx.

1 ONNX models (.onnx files)
11 files, including 5 .json, 1 .md, 1 .jinja, 1 .onnx, 1 .data, 1 .model
Last updated 2026-02-18

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

optimum-cli export onnx \
  --model google/gemma-2b-it \
  --opset 17 \
  --framework pt \
  ~/.onnx/gemma-2b-it-pt

c.f. https://github.com/huggingface/optimum/issues/1755

fail

python -m onnxruntime_genai.models.builder \
  -m ~/.onnx/gemma-2b-it-pt \
  -o ~/.onnx/gemma-2b-it-onnx-int4-cpu \
  -p int4 \
  -e cpu

python \
  -m onnxruntime_genai.models.builder \
  -m google/gemma-2-2b-it \
  -p fp16 \
  -e cpu \
  -o ~/.onnx/gemma-2b-it-onnx-fp16-cpu

Model info

onnx gemma2 base_model:google/gemma-2-2b-it base_model:quantized:google/gemma-2-2b-it region:us

↓ 0 ♥ 0

Created: 2026-01-04

Updated: 2026-02-18

View on Hugging Face

Files (11)

.gitattributes

README.md

chat_template.jinja

config.json

genai_config.json

model.onnx ONNX

model.onnx.data

special_tokens_map.json

tokenizer.json

tokenizer.model

tokenizer_config.json

Related models

More models

No task type declared.