ONNX Model Zoo

shoibl/tinyllama-onnx

By shoibl · ↓ 2 · ♥ 0 · Updated 2024-02-08

What's in this repo

This page lists the files in shoibl/tinyllama-onnx, including decoder_model.onnx, decoder_model_merged_quantized.onnx, model.onnx and more.

  • 4 ONNX models (.onnx files)
  • 19 files, including 7 .json, 4 .onnx, 2 .onnx_data, 1 .model
  • Last updated 2024-02-08

ONNX files

File Size Download
onnx/decoder_model.onnx — Download
onnx/decoder_model_merged_quantized.onnx — Download
onnx/model.onnx — Download
onnx/model_quantized.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

No README provided by the author.

Model info

text-generation transformers
transformers onnx llama text-generation conversational endpoints_compatible region:us
↓ 2 ♥ 0

Created: 2024-02-08

Updated: 2024-02-08

View on Hugging Face

Files (19)

.gitattributes
Constant_162_attr__value
Constant_169_attr__value
Constant_170_attr__value
Constant_177_attr__value
added_tokens.json
config.json
generation_config.json
onnx/decoder_model.onnx ONNX
onnx/decoder_model.onnx_data
onnx/model.onnx ONNX
onnx/model.onnx_data
onnx/model_quantized.onnx ONNX
quantize_config.json
special_tokens_map.json
tokenizer.json
tokenizer.model
tokenizer_config.json

Related models