ONNX Model Zoo

lwanming/TinyLlama-1.1B-Chat-v1.0-webgpu-transformers

By lwanming · ↓ 0 · ♥ 0 · Updated 2026-02-06

What's in this repo

This page lists the files in lwanming/TinyLlama-1.1B-Chat-v1.0-webgpu-transformers, including model_q4f16.onnx.

  • 1 ONNX models (.onnx files)
  • 12 files, including 7 .json, 1 .md, 1 .onnx, 1 .onnx_data, 1 .model
  • Last updated 2026-02-06

ONNX files

File Size Download
onnx/model_q4f16.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Build with onnxruntime-genai at head of commit: da58e20df8b33e4ea8638798232720c834d798c1

python builder.py -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 -o TinyLlama-1.1B-Chat-v1.0-webgpu-v2 -c honry-cache-dir -p int4 -e webgpu --extra_options int4_block_size=32 int4_accuracy_level=4 int4_op_types_to_quantize=MatMul/Gather enable_webgpu_graph=true

Model info

onnx llama region:us
↓ 0 ♥ 0

Created: 2026-02-06

Updated: 2026-02-06

View on Hugging Face

Files (12)

.gitattributes
README.md
config.json
eval_results.json
genai_config.json
generation_config.json
onnx/model_q4f16.onnx ONNX
onnx/model_q4f16.onnx_data
special_tokens_map.json
tokenizer.json
tokenizer.model
tokenizer_config.json

Related models