broadfield-dev/Qwen3-0.6B-20260105-055554-onnx

By broadfield-dev · ↓ 0 · ♥ 0 · Updated 2026-01-05

What's in this repo

This page lists the files in broadfield-dev/Qwen3-0.6B-20260105-055554-onnx, including model.onnx.

1 ONNX models (.onnx files)
14 files, including 8 .json, 1 .md, 1 .jinja, 1 .txt, 1 .onnx, 1 .data
Last updated 2026-01-05

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

ONNX Export: Qwen/Qwen3-0.6B

Original Model: Qwen/Qwen3-0.6B
Task: text-generation
Optimization: INT8 (ARM64)
Opset: 18

Usage


from tokenizers import Tokenizer
import onnxruntime as ort
import numpy as np
# 1. Load Tokenizer
tokenizer = Tokenizer.from_pretrained("broadfield-dev/Qwen3-0.6B-20260105-055554-onnx")
# 2. Load Model
session = ort.InferenceSession("model.onnx")
# 3. Inference
text = "Hello world"
encoding = tokenizer.encode(text)
inputs = {
    "input_ids": np.array([encoding.ids], dtype=np.int64),
    "attention_mask": np.array([encoding.attention_mask], dtype=np.int64)
}
logits = session.run(None, inputs)[0]
print(logits.shape)

Model info

text-generation transformers

transformers onnx qwen3 text-generation onnxruntime tokenizers optimum pure-onnx int8 quantized mobile conversational

↓ 0 ♥ 0

Created: 2026-01-05

Updated: 2026-01-05

View on Hugging Face

Files (14)

.gitattributes

README.md

added_tokens.json

chat_template.jinja

config.json

generation_config.json

merges.txt

model.onnx ONNX

model_quantized.onnx.data

ort_config.json

special_tokens_map.json

tokenizer.json

tokenizer_config.json

vocab.json

Related models

More text-generation models

Browse all text-generation models