xiaoyao9184/Qwen2.5-0.5B-Instruct-onnx-genai

By xiaoyao9184 · ↓ 0 · ♥ 0 · Updated 2025-07-13

What's in this repo

This page lists the files in xiaoyao9184/Qwen2.5-0.5B-Instruct-onnx-genai, including model.onnx and more.

5 ONNX models (.onnx files)
52 files, including 30 .json, 5 .jinja, 5 .txt, 5 .onnx, 5 .data, 1 .md
Last updated 2025-07-13

ONNX files

File	Size	Download
cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/model.onnx	—	Download
cpu_and_mobile/cpu-int4-rtn-block-32/model.onnx	—	Download
cuda/cuda-fp16/model.onnx	—	Download
cuda/cuda-int4-rtn-block-32/model.onnx	—	Download
directml/dml-int4-awq-block-128/model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Qwen2.5-0.5B-Instruct (ONNX Runtime GenAI)

This is an ONNX Runtime GenAI version of Qwen/Qwen2.5-0.5B-Instruct. It was automatically converted and uploaded using this space.

Model info

onnxruntime-genai

onnxruntime-genai onnx base_model:Qwen/Qwen2.5-0.5B-Instruct base_model:quantized:Qwen/Qwen2.5-0.5B-Instruct region:us

↓ 0 ♥ 0

Created: 2025-06-22

Updated: 2025-07-13

View on Hugging Face

Files (52)

.gitattributes

README.md

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/added_tokens.json

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/chat_template.jinja

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/genai_config.json

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/merges.txt

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/model.onnx ONNX

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/model.onnx.data

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/special_tokens_map.json

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/tokenizer.json

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/tokenizer_config.json

cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/vocab.json

cpu_and_mobile/cpu-int4-rtn-block-32/added_tokens.json

cpu_and_mobile/cpu-int4-rtn-block-32/chat_template.jinja

cpu_and_mobile/cpu-int4-rtn-block-32/genai_config.json

cpu_and_mobile/cpu-int4-rtn-block-32/merges.txt

cpu_and_mobile/cpu-int4-rtn-block-32/model.onnx ONNX

cpu_and_mobile/cpu-int4-rtn-block-32/model.onnx.data

cpu_and_mobile/cpu-int4-rtn-block-32/special_tokens_map.json

cpu_and_mobile/cpu-int4-rtn-block-32/tokenizer.json

cpu_and_mobile/cpu-int4-rtn-block-32/tokenizer_config.json

cpu_and_mobile/cpu-int4-rtn-block-32/vocab.json

cuda/cuda-fp16/added_tokens.json

cuda/cuda-fp16/chat_template.jinja

cuda/cuda-fp16/genai_config.json

cuda/cuda-fp16/merges.txt

cuda/cuda-fp16/model.onnx ONNX

cuda/cuda-fp16/model.onnx.data

cuda/cuda-fp16/special_tokens_map.json

cuda/cuda-fp16/tokenizer.json

cuda/cuda-fp16/tokenizer_config.json

cuda/cuda-fp16/vocab.json

cuda/cuda-int4-rtn-block-32/added_tokens.json

cuda/cuda-int4-rtn-block-32/chat_template.jinja

cuda/cuda-int4-rtn-block-32/genai_config.json

cuda/cuda-int4-rtn-block-32/merges.txt

cuda/cuda-int4-rtn-block-32/model.onnx ONNX

cuda/cuda-int4-rtn-block-32/model.onnx.data

cuda/cuda-int4-rtn-block-32/special_tokens_map.json

cuda/cuda-int4-rtn-block-32/tokenizer.json

cuda/cuda-int4-rtn-block-32/tokenizer_config.json

cuda/cuda-int4-rtn-block-32/vocab.json

directml/dml-int4-awq-block-128/added_tokens.json

directml/dml-int4-awq-block-128/chat_template.jinja

directml/dml-int4-awq-block-128/genai_config.json

directml/dml-int4-awq-block-128/merges.txt

directml/dml-int4-awq-block-128/model.onnx ONNX

directml/dml-int4-awq-block-128/model.onnx.data

directml/dml-int4-awq-block-128/special_tokens_map.json

directml/dml-int4-awq-block-128/tokenizer.json

directml/dml-int4-awq-block-128/tokenizer_config.json

directml/dml-int4-awq-block-128/vocab.json

Related models

More models

No task type declared.