ChoiceAI/Llama-3.1-8B-Instruct-ONNX

By ChoiceAI · ↓ 0 · ♥ 0 · Updated 2025-06-07

What's in this repo

This page lists the files in ChoiceAI/Llama-3.1-8B-Instruct-ONNX, including model.onnx, model_fp16.onnx, model_q4.onnx.

3 ONNX models (.onnx files)
14 files, including 5 .json, 3 .onnx, 3 .onnx_data, 1 .md
Last updated 2025-06-07

ONNX files

File	Size	Download
model.onnx	—	Download
onnx/model_fp16.onnx	—	Download
onnx/model_q4.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

license: llama3.1

The README content appears to be empty. Let me fetch it from HuggingFace first. The README appears to be minimal. Let me check the full model page: The README for this model is essentially empty — it only contains YAML frontmatter with the license:

---
license: llama3.1
---

There's no content to translate. Would you like me to:

Translate just the frontmatter (though typically YAML frontmatter is kept as-is)
Write a descriptive Chinese README for this ONNX model based on what it is (a Llama 3.1 8B Instruct ONNX conversion)?

Model info

onnx llama license:llama3.1 region:us

↓ 0 ♥ 0

Created: 2025-06-07

Updated: 2025-06-07

View on Hugging Face

Files (14)

.gitattributes

NOTICE

README.md

config.json

generation_config.json

model.onnx ONNX

model.onnx_data

onnx/model_fp16.onnx ONNX

onnx/model_fp16.onnx_data

onnx/model_q4.onnx ONNX

onnx/model_q4.onnx_data

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More from ChoiceAI

No other models by this author.

More models

No task type declared.