barflyman/Llama-3.2-3B-Instruct-ONNX
By barflyman · ↓ 0 · ♥ 0 · Updated 2025-12-15
What's in this repo
This page lists the files in barflyman/Llama-3.2-3B-Instruct-ONNX, including model.onnx, model_bnb4.onnx, model_fp16.onnx and more.
- 8 ONNX models (.onnx files)
- 38 files, including 8 .onnx, 8 .onnx_data, 6 .json, 4 .onnx_data_1, 2 .md, 2 .onnx_data_2
- Last updated 2025-12-15
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/model.onnx | — | Download |
| onnx/model_bnb4.onnx | — | Download |
| onnx/model_fp16.onnx | — | Download |
| onnx/model_int8.onnx | — | Download |
| onnx/model_q4.onnx | — | Download |
| onnx/model_q4f16.onnx | — | Download |
| onnx/model_quantized.onnx | — | Download |
| onnx/model_uint8.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
Llama 3.2 3B Inst. ONNX model
Llama 3.2 is licensed under die Llama 3.2 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.
Model info
onnx
llama
license:llama3.2
region:us
↓ 0
♥ 0
Created: 2025-12-13
Updated: 2025-12-15
View on Hugging FaceFiles (38)
.gitattributes
LICENSE.txt
README.md
USE_POLICY.md
chat_template.jinja
config.json
generation_config.json
onnx/model.onnx
ONNX
onnx/model.onnx_data
onnx/model.onnx_data_1
onnx/model.onnx_data_2
onnx/model.onnx_data_3
onnx/model.onnx_data_4
onnx/model.onnx_data_5
onnx/model.onnx_data_6
onnx/model_bnb4.onnx
ONNX
onnx/model_bnb4.onnx_data
onnx/model_fp16.onnx
ONNX
onnx/model_fp16.onnx_data
onnx/model_fp16.onnx_data_1
onnx/model_fp16.onnx_data_2
onnx/model_fp16.onnx_data_3
onnx/model_int8.onnx
ONNX
onnx/model_int8.onnx_data
onnx/model_q4.onnx
ONNX
onnx/model_q4.onnx_data
onnx/model_q4.onnx_data_1
onnx/model_q4f16.onnx
ONNX
onnx/model_q4f16.onnx_data
onnx/model_q4f16.onnx_data_1
onnx/model_quantized.onnx
ONNX
onnx/model_quantized.onnx_data
onnx/model_uint8.onnx
ONNX
onnx/model_uint8.onnx_data
quantize_config.json
special_tokens_map.json
tokenizer.json
tokenizer_config.json
Related models
More from barflyman
More models
No task type declared.