lokinfey/Phi-4-mini-onnx-qnn-npu

By lokinfey · ↓ 0 · ♥ 1 · Updated 2025-08-12

What's in this repo

This page lists the files in lokinfey/Phi-4-mini-onnx-qnn-npu, including context_ctx.onnx, embeddings.onnx, iterator_ctx.onnx and more.

4 ONNX models (.onnx files)
24 files, including 10 .json, 4 .bin, 4 .onnx, 2 .py, 1 .md, 1 .jinja
Last updated 2025-08-12

ONNX files

File	Size	Download
model/context_ctx.onnx	—	Download
model/embeddings.onnx	—	Download
model/iterator_ctx.onnx	—	Download
model/lm_head.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Phi-4-mini-onnx-qnn-npu

This is a quantized INT4 model based on Qualcomm Copilot+PC NPU. You can deploy it on Copilot+PC devices.

Note: This is unoffical version,just for test and dev.

Installation

Please use Windows 11 + Copilot, install Foundry Local 0.6.87

winget install Microsoft.FoundryLocal

Download Models

Please use Huggingface CLI download this model

hf download lokinfey/Phi-4-mini-onnx-qnn-npu --local-dir Your Phi-4-mini-onnx-qnn-npu Path

add inference_model.json to Your Phi-4-mini-onnx-qnn-npu Path/model

Deployment


foundry service stop

foundry cache cd Your Phi-4-mini-onnx-qnn-npu

You can run foundry cache ls to check model status

Running


foundry model run Phi-4-mini-qnn-npu

Model info

onnx license:mit region:us

↓ 0 ♥ 1

Created: 2025-08-05

Updated: 2025-08-12

View on Hugging Face

Files (24)

.gitattributes

README.md

inference_model.json

model/added_tokens.json

model/chat_template.jinja

model/config.json

model/configuration_phi3.py

model/context_0_ctx_qnn.bin

model/context_1_ctx_qnn.bin

model/context_2_ctx_qnn.bin

model/context_3_ctx_qnn.bin

model/context_ctx.onnx ONNX

model/embeddings.onnx ONNX

model/genai_config.json

model/generation_config.json

model/iterator_ctx.onnx ONNX

model/lm_head.onnx ONNX

model/merges.txt

model/modeling_phi3.py

model/special_tokens_map.json

model/tokenizer.json

model/tokenizer_config.json

model/vocab.json

model_config.json

Related models

More models

No task type declared.