lwanming/Phi-3.5-mini-instruct-onnx

By lwanming · ↓ 0 · ♥ 0 · Updated 2025-11-06

What's in this repo

This page lists the files in lwanming/Phi-3.5-mini-instruct-onnx, including model.onnx and more.

2 ONNX models (.onnx files)
14 files, including 8 .json, 2 .onnx, 2 .data, 1 .md
Last updated 2025-11-06

ONNX files

File	Size	Download
honry-phi3.5-webgpu-QGather-model/model.onnx	—	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Base on https://huggingface.co/microsoft/Phi-3.5-mini-instruct

Convert to onnx model using https://github.com/microsoft/onnxruntime-genai

Using command: python -m onnxruntime_genai.models.builder -m microsoft/Phi-3.5-mini-instruct -o Phi-3.5-mini-instruct-onnx -e webgpu -c cache-dir -p int4 --extra_options int4_block_size=32 int4_accuracy_level=4

The generated external data (model.onnx.data) is larger than 2GB, which is not suitable for ORT-Web. I use an additional Python script to move some data into model.onnx.

Model info

onnx license:apache-2.0 region:us

↓ 0 ♥ 0

Created: 2025-07-18

Updated: 2025-11-06

View on Hugging Face

Files (14)

.gitattributes

README.md

genai_config.json

honry-phi3.5-webgpu-QGather-model/genai_config.json

honry-phi3.5-webgpu-QGather-model/model.onnx ONNX

honry-phi3.5-webgpu-QGather-model/model.onnx.data

honry-phi3.5-webgpu-QGather-model/special_tokens_map.json

honry-phi3.5-webgpu-QGather-model/tokenizer.json

honry-phi3.5-webgpu-QGather-model/tokenizer_config.json

model.onnx ONNX

model.onnx.data

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.