lwanming/TinyLlama-1.1B-Chat-v1.0-onnx-webgpu

By lwanming · ↓ 0 · ♥ 0 · Updated 2025-10-23

What's in this repo

This page lists the files in lwanming/TinyLlama-1.1B-Chat-v1.0-onnx-webgpu, including model.onnx.

1 ONNX models (.onnx files)
8 files, including 4 .json, 1 .md, 1 .onnx, 1 .data
Last updated 2025-10-23

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

license: apache-2.0

Base on https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0

Convert to onnx model using https://github.com/microsoft/onnxruntime-genai (commit: 74ec1becd9ca84099c2e8cfaa4798a8a9fc66beb)

Using command:

onnxruntime-genai\src\python\py\models> python builder.py -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 \
-o model-output-path -c model-cache-dir -e webgpu -p int4 --extra_options int4_block_size=32 \
int4_accuracy_level=4 int4_op_types_to_quantize=MatMul/Gather

Model info

onnx license:mit region:us

↓ 0 ♥ 0

Created: 2025-10-23

Updated: 2025-10-23

View on Hugging Face

Files (8)

.gitattributes

README.md

genai_config.json

model.onnx ONNX

model.onnx.data

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.