ONNX Model Zoo

Makatia/TinyLlama_TinyLlama-1.1B-Chat-v1.0_onnx

By Makatia · ↓ 0 · ♥ 2 · Updated 2025-07-14

What's in this repo

This page lists the files in Makatia/TinyLlama_TinyLlama-1.1B-Chat-v1.0_onnx.

  • No .onnx files in this repository
  • 3 files, including 1 .md, 1 .7z
  • Last updated 2025-07-14

ONNX files

This repository has no .onnx files. See the full file list on the right for other formats.

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

license: mit library_name: onnxruntime tags:

  • tinyllama
  • onnx
  • quantized
  • edge-llm
  • raspberry-pi
  • local-inference model_creator: TinyLlama language: en

TinyLlama-1.1B-Chat-v1.0 (ONNX): Local LLM Model Repository

This repository contains quantized ONNX exports of TinyLlama/TinyLlama-1.1B-Chat-v1.0, optimized for efficient local inference on resource-constrained devices such as Raspberry Pi and other ARM-based single-board computers.

🟦 ONNX Model

Included files:

  • model.onnx
  • model_quantized.onnx
  • model.onnx.data (if sharded)
  • Configuration files (config.json, tokenizer.json, etc.)

Recommended for: ONNX Runtime, Kleidi AI, and other compatible frameworks.

Quick Start

import onnxruntime as ort

session = ort.InferenceSession("model.onnx")
# ... inference code here ...

The ONNX export enables efficient inference on CPUs, NPUs, and other accelerators, making it ideal for local or edge deployments.

📋 Credits

Maintainer: Makatia

Model info

onnxruntime
onnxruntime tinyllama onnx quantized edge-llm raspberry-pi local-inference en license:mit region:us
↓ 0 ♥ 2

Created: 2025-07-13

Updated: 2025-07-14

View on Hugging Face

Files (3)

.gitattributes
README.md
TinyLlama_TinyLlama-1.1B-Chat-v1.0_onnx.7z

Related models

More from Makatia

More models

No task type declared.

Popular models