steerapi/Llama-2-7b-chat-hf-onnx-awq
By steerapi · ↓ 1 · ♥ 0 · Updated 2023-08-09
What's in this repo
This page lists the files in steerapi/Llama-2-7b-chat-hf-onnx-awq, including decoder_model.onnx, decoder_model_merged.onnx, decoder_model_merged_quantized.onnx and more.
- 5 ONNX models (.onnx files)
- 20 files, including 7 .json, 5 .onnx, 5 .onnx_data, 1 .data, 1 .model
- Last updated 2023-08-09
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/decoder_model.onnx | — | Download |
| onnx/decoder_model_merged.onnx | — | Download |
| onnx/decoder_model_merged_quantized.onnx | — | Download |
| onnx/decoder_with_past_model.onnx | — | Download |
| onnx/q1/decoder_model_merged_quantized.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
No README provided by the author.
Model info
text-generation
transformers
transformers
onnx
llama
text-generation
endpoints_compatible
region:us
↓ 1
♥ 0
Created: 2023-08-09
Updated: 2023-08-09
View on Hugging FaceFiles (20)
.gitattributes
config.json
generation_config.json
onnx/decoder_model.onnx
ONNX
onnx/decoder_model.onnx_data
onnx/decoder_model_merged.onnx
ONNX
onnx/decoder_model_merged.onnx_data
onnx/decoder_model_merged_quantized.onnx.data
onnx/decoder_model_merged_quantized.onnx_data
onnx/decoder_with_past_model.onnx
ONNX
onnx/decoder_with_past_model.onnx_data
onnx/q1/decoder_model_merged_quantized.onnx_data
onnx/quantize_config.json
quantize_config.json
special_tokens_map.json
tokenizer.json
tokenizer.model
tokenizer_config.json