steerapi/Llama-2-7b-chat-hf-onnx
By steerapi · ↓ 3 · ♥ 5 · Updated 2023-08-08
What's in this repo
This page lists the files in steerapi/Llama-2-7b-chat-hf-onnx, including decoder_model.onnx, decoder_model_fp16.onnx, decoder_model_merged.onnx and more.
- 8 ONNX models (.onnx files)
- 37 files, including 14 .json, 8 .onnx, 7 .onnx_data, 2 .data, 1 .model
- Last updated 2023-08-08
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/decoder_model.onnx | — | Download |
| onnx/decoder_model_fp16.onnx | — | Download |
| onnx/decoder_model_merged.onnx | — | Download |
| onnx/decoder_model_merged_fp16.onnx | — | Download |
| onnx/decoder_model_merged_quantized.onnx | — | Download |
| onnx/decoder_with_past_model.onnx | — | Download |
| onnx/decoder_with_past_model_fp16.onnx | — | Download |
| onnx/q1/decoder_model_merged_quantized.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
No README provided by the author.
Model info
text-generation
transformers
transformers
onnx
llama
text-generation
endpoints_compatible
region:us
↓ 3
♥ 5
Created: 2023-08-04
Updated: 2023-08-08
View on Hugging FaceFiles (37)
.gitattributes
.ipynb_checkpoints/config-checkpoint.json
.ipynb_checkpoints/generation_config-checkpoint.json
.ipynb_checkpoints/ort_config-checkpoint.json
.ipynb_checkpoints/special_tokens_map-checkpoint.json
.ipynb_checkpoints/tokenizer-checkpoint.json
.ipynb_checkpoints/tokenizer_config-checkpoint.json
Constant_106_attr__value
Constant_114_attr__value
Constant_162_attr__value
Constant_170_attr__value
config.json
generation_config.json
onnx/.ipynb_checkpoints/quantize_config-checkpoint.json
onnx/decoder_model.onnx
ONNX
onnx/decoder_model.onnx_data
onnx/decoder_model_fp16.onnx
ONNX
onnx/decoder_model_fp16.onnx_data
onnx/decoder_model_merged.onnx
ONNX
onnx/decoder_model_merged.onnx_data
onnx/decoder_model_merged_fp16.onnx
ONNX
onnx/decoder_model_merged_fp16.onnx_data
onnx/decoder_model_merged_quantized.onnx.data
onnx/decoder_model_merged_quantized.onnx_data
onnx/decoder_with_past_model.onnx
ONNX
onnx/decoder_with_past_model.onnx_data
onnx/decoder_with_past_model_fp16.onnx
ONNX
onnx/decoder_with_past_model_fp16.onnx_data
onnx/ort_config.json
onnx/q1/decoder_model_merged_quantized.onnx.data
onnx/quantize_config.json
special_tokens_map.json
tokenizer.json
tokenizer.model
tokenizer_config.json