xiaoyao9184/Qwen3-0.6B-onnx-genai

By xiaoyao9184 · ↓ 0 · ♥ 0 · Updated 2026-03-05

What's in this repo

This page lists the files in xiaoyao9184/Qwen3-0.6B-onnx-genai, including model.onnx and more.

5 ONNX models (.onnx files)
32 files, including 15 .json, 5 .jinja, 5 .onnx, 5 .data, 1 .md
Last updated 2026-03-05

ONNX files

File	Size	Download
cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/model.onnx	—	Download
cpu_and_mobile/cpu-int4-rtn-block-32/model.onnx	—	Download
cuda/cuda-fp16/model.onnx	—	Download
cuda/cuda-int4-rtn-block-32/model.onnx	—	Download
directml/dml-int4-awq-block-128/model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Qwen3-0.6B (ONNX Runtime GenAI)

This is an ONNX Runtime GenAI version of Qwen/Qwen3-0.6B. It was automatically converted and uploaded using convert-to-genai space.

Model info

onnxruntime-genai

onnxruntime-genai onnx base_model:Qwen/Qwen3-0.6B base_model:quantized:Qwen/Qwen3-0.6B region:us

↓ 0 ♥ 0

Created: 2026-03-05

Updated: 2026-03-05

View on Hugging Face

Files (32)

.gitattributes

README.md

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/chat_template.jinja

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/genai_config.json

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/model.onnx ONNX

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/model.onnx.data

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/tokenizer.json

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/tokenizer_config.json

cpu_and_mobile/cpu-int4-rtn-block-32/chat_template.jinja

cpu_and_mobile/cpu-int4-rtn-block-32/genai_config.json

cpu_and_mobile/cpu-int4-rtn-block-32/model.onnx ONNX

cpu_and_mobile/cpu-int4-rtn-block-32/model.onnx.data

cpu_and_mobile/cpu-int4-rtn-block-32/tokenizer.json

cpu_and_mobile/cpu-int4-rtn-block-32/tokenizer_config.json

cuda/cuda-fp16/chat_template.jinja

cuda/cuda-fp16/genai_config.json

cuda/cuda-fp16/model.onnx ONNX

cuda/cuda-fp16/model.onnx.data

cuda/cuda-fp16/tokenizer.json

cuda/cuda-fp16/tokenizer_config.json

cuda/cuda-int4-rtn-block-32/chat_template.jinja

cuda/cuda-int4-rtn-block-32/genai_config.json

cuda/cuda-int4-rtn-block-32/model.onnx ONNX

cuda/cuda-int4-rtn-block-32/model.onnx.data

cuda/cuda-int4-rtn-block-32/tokenizer.json

cuda/cuda-int4-rtn-block-32/tokenizer_config.json

directml/dml-int4-awq-block-128/chat_template.jinja

directml/dml-int4-awq-block-128/genai_config.json

directml/dml-int4-awq-block-128/model.onnx ONNX

directml/dml-int4-awq-block-128/model.onnx.data

directml/dml-int4-awq-block-128/tokenizer.json

directml/dml-int4-awq-block-128/tokenizer_config.json

Related models

More models

No task type declared.