sinatras/Llama-3.2-3B-Instruct-ONNX-Q4

By sinatras · ↓ 2 · ♥ 0 · Updated 2024-09-25

What's in this repo

This page lists the files in sinatras/Llama-3.2-3B-Instruct-ONNX-Q4, including model_q4.onnx.

1 ONNX models (.onnx files)
9 files, including 5 .json, 1 .md, 1 .onnx, 1 .onnx_data
Last updated 2024-09-25

ONNX files

File	Size	Download
onnx/model_q4.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

No README provided by the author.

Model info

onnx llama base_model:meta-llama/Llama-3.2-3B-Instruct base_model:quantized:meta-llama/Llama-3.2-3B-Instruct license:llama3.2 region:us

↓ 2 ♥ 0

Created: 2024-09-25

Updated: 2024-09-25

View on Hugging Face

Files (9)

.gitattributes

README.md

config.json

generation_config.json

onnx/model_q4.onnx ONNX

onnx/model_q4.onnx_data

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.