anthonymikinka/Qwen3-0.6B-w_uint4_per_group_asym-awq

By anthonymikinka · ↓ 0 · ♥ 0 · Updated 2025-10-11

What's in this repo

This page lists the files in anthonymikinka/Qwen3-0.6B-w_uint4_per_group_asym-awq, including model.onnx.

1 ONNX models (.onnx files)
13 files, including 6 .json, 2 .data, 1 .md, 1 .jinja, 1 .txt, 1 .onnx
Last updated 2025-10-11

ONNX files

File	Size	Download
model/model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Modified Microsoft/Olive, Microsoft/Onnxgenruntime-ai, and AMD Quark to accept and configure qwen3 for AMD NPU support. This is still in the works, as one of the layers was left out due to complexity.

RyzenAI 1.6.0 dropped 3 days ago and it supports Qwen3. Maybe this would run on there. I am on RyzenAI 1.5.1, I am encoutering the following issue a layer not being a registered function/op.

Loading model from: Qwen3-0.6B-w_uint4_per_group_asym-awq-FINAL\model

onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Load model from Qwen3-0.6B-w_uint4_per_group_asym-awq-FINAL\model\model.onnx failed:Fatal error: com.amd:AMDSimplifiedLayerNormalization(-1) is not a registered function/op

Model info

text-generation

onnx qwen3 text-generation base_model:Qwen/Qwen3-0.6B base_model:quantized:Qwen/Qwen3-0.6B region:us

↓ 0 ♥ 0

Created: 2025-10-11

Updated: 2025-10-11

View on Hugging Face

Files (13)

.gitattributes

README.md

model/added_tokens.json

model/chat_template.jinja

model/genai_config.json

model/merges.txt

model/model.data

model/model.onnx ONNX

model/model.onnx.data

model/special_tokens_map.json

model/tokenizer.json

model/tokenizer_config.json

model/vocab.json

Related models

More from anthonymikinka

No other models by this author.

More text-generation models

Browse all text-generation models