dewdev/text-generation
By dewdev · ↓ 0 · ♥ 0 · Updated 2025-02-03
What's in this repo
This page lists the files in dewdev/text-generation, including Llama-3.2-1B-Instruct-QUInt8.onnx, Qwen2.5-0.5B-Instruct-QUInt8.onnx, TinyLlama-1.1B-Chat-v1.0_q4.onnx and more.
- 5 ONNX models (.onnx files)
- 9 files, including 5 .onnx, 3 .json
- Last updated 2025-02-03
ONNX files
| File | Size | Download |
|---|---|---|
| Llama-3.2-1B-Instruct-QUInt8.onnx | — | Download |
| Qwen2.5-0.5B-Instruct-QUInt8.onnx | — | Download |
| TinyLlama-1.1B-Chat-v1.0_q4.onnx | — | Download |
| TinyLlama-1.1B-Chat-v1.0_q8f32.onnx | — | Download |
| bloomz-560m-QUInt8.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
No README provided by the author.
Files (9)
.gitattributes
Llama-3.2-1B-Instruct-QUInt8.onnx
ONNX
Qwen2.5-0.5B-Instruct-QUInt8.onnx
ONNX
TinyLlama-1.1B-Chat-v1.0_q4.onnx
ONNX
TinyLlama-1.1B-Chat-v1.0_q8f32.onnx
ONNX
bloomz-560m-QUInt8.onnx
ONNX
special_tokens_map.json
tokenizer.json
tokenizer_config.json
Related models
More from dewdev
More models
No task type declared.