elribonazo/test
By elribonazo · ↓ 1 · ♥ 0 · Updated 2025-02-28
What's in this repo
This page lists the files in elribonazo/test, including model.onnx, model_bnb4.onnx, model_fp16.onnx and more.
- 8 ONNX models (.onnx files)
- 24 files, including 8 .onnx, 8 .onnx_data, 6 .json, 1 .md
- Last updated 2025-02-28
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/model.onnx | — | Download |
| onnx/model_bnb4.onnx | — | Download |
| onnx/model_fp16.onnx | — | Download |
| onnx/model_int8.onnx | — | Download |
| onnx/model_q4.onnx | — | Download |
| onnx/model_q4f16.onnx | — | Download |
| onnx/model_quantized.onnx | — | Download |
| onnx/model_uint8.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
Uploaded model
- Developed by: elribonazo
- License: apache-2.0
- Finetuned from model : unsloth/meta-llama-3.1-8b-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Model info
text-generation
transformers
transformers
onnx
llama
text-generation
text-generation-inference
unsloth
trl
conversational
en
license:apache-2.0
endpoints_compatible
region:us
↓ 1
♥ 0
Created: 2025-02-21
Updated: 2025-02-28
View on Hugging FaceFiles (24)
.gitattributes
README.md
config.json
generation_config.json
onnx/model.onnx
ONNX
onnx/model.onnx_data
onnx/model_bnb4.onnx
ONNX
onnx/model_bnb4.onnx_data
onnx/model_fp16.onnx
ONNX
onnx/model_fp16.onnx_data
onnx/model_int8.onnx
ONNX
onnx/model_int8.onnx_data
onnx/model_q4.onnx
ONNX
onnx/model_q4.onnx_data
onnx/model_q4f16.onnx
ONNX
onnx/model_q4f16.onnx_data
onnx/model_quantized.onnx
ONNX
onnx/model_quantized.onnx_data
onnx/model_uint8.onnx
ONNX
onnx/model_uint8.onnx_data
quantize_config.json
special_tokens_map.json
tokenizer.json
tokenizer_config.json