llmware/qwen2.5-1.5b-instruct-onnx-qnn

By llmware · ↓ 11 · ♥ 0 · Updated 2025-12-20

What's in this repo

This page lists the files in llmware/qwen2.5-1.5b-instruct-onnx-qnn, including context_ctx.onnx, embeddings.onnx, iterator_ctx.onnx and more.

4 ONNX models (.onnx files)
22 files, including 10 .json, 4 .bin, 4 .onnx, 1 .md, 1 .jinja, 1 .txt
Last updated 2025-12-20

ONNX files

File	Size	Download
context_ctx.onnx	—	Download
embeddings.onnx	—	Download
iterator_ctx.onnx	—	Download
lm_head.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

qwen2.5-1.5b-instruct-onnx-qnn

qwen2.5-1.5b-instruct-onnx-qnn is an ONNX QNN int4 quantized version of Qwen2.5-1.5B-Instruct, providing a very fast inference implementation, optimized for AI PCs using Qualcommm NPU.

This is from the latest release series from Qwen.

Model Description

Developed by: Qwen
Quantized by: llmware
Model type: qwen2.5
Parameters: 1.5 billion
Model Parent: Qwen/Qwen2.5-1.5B-Instruct
Language(s) (NLP): English
License: Apache 2.0
Uses: Chat, general-purpose LLM
Quantization: int4
Backend: qairt 2.36, ort 1.22.2, ortg 0.9

Model Card Contact

llmware on github

llmware on hf

llmware website

Model info

onnx qwen2 green llmware-chat p2 qnn emerald license:apache-2.0 4-bit gptq region:us

↓ 11 ♥ 0

Created: 2025-12-20

Updated: 2025-12-20

View on Hugging Face

Files (22)

.gitattributes

README.md

added_tokens.json

chat_template.jinja

config.json

context_0_ctx_qnn.bin

context_1_ctx_qnn.bin

context_2_ctx_qnn.bin

context_3_ctx_qnn.bin

context_ctx.onnx ONNX

embeddings.onnx ONNX

genai_config.json

generation_config.json

hash_record_sha256.json

inference_model.json

iterator_ctx.onnx ONNX

lm_head.onnx ONNX

merges.txt

special_tokens_map.json

tokenizer.json

tokenizer_config.json

vocab.json

Related models

More models

No task type declared.