lwanming/TinyLlama-1.1B-Chat-v1.0-webgpu-v2

By lwanming · ↓ 0 · ♥ 0 · Updated 2025-11-21

What's in this repo

This page lists the files in lwanming/TinyLlama-1.1B-Chat-v1.0-webgpu-v2, including model.onnx.

1 ONNX models (.onnx files)
8 files, including 4 .json, 1 .md, 1 .onnx, 1 .data
Last updated 2025-11-21

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Build with onnxruntime-genai at head of commit: da58e20df8b33e4ea8638798232720c834d798c1, and with this PR applied.

python builder.py -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 -o TinyLlama-1.1B-Chat-v1.0-webgpu-v2 -c honry-cache-dir -p int4 -e webgpu --extra_options int4_block_size=32 int4_accuracy_level=4 int4_op_types_to_quantize=MatMul/Gather enable_webgpu_graph=true

Model info

onnx region:us

↓ 0 ♥ 0

Created: 2025-11-21

Updated: 2025-11-21

View on Hugging Face

Files (8)

.gitattributes

README.md

genai_config.json

model.onnx ONNX

model.onnx.data

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.