aless2212/gemma-1.1-7b-it-onnx-fp16
By aless2212 · ↓ 0 · ♥ 0 · Updated 2024-04-07
What's in this repo
This page lists the files in aless2212/gemma-1.1-7b-it-onnx-fp16, including rank_0_gemma-1.1-7b-it_decoder_merged_model_fp16.onnx.
- 1 ONNX models (.onnx files)
- 10 files, including 5 .json, 1 .md, 1 .onnx, 1 .data, 1 .model
- Last updated 2024-04-07
ONNX files
| File | Size | Download |
|---|---|---|
| rank_0_gemma-1.1-7b-it_decoder_merged_model_fp16.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
I'm only uploading float16 models because base models are mostly bfloat16 so its useless to, upcast to float32.
Model info
text-generation
transformers
transformers
onnx
gemma
text-generation
conversational
license:apache-2.0
endpoints_compatible
region:us
↓ 0
♥ 0
Created: 2024-04-07
Updated: 2024-04-07
View on Hugging FaceFiles (10)
.gitattributes
README.md
config.json
generation_config.json
rank_0_gemma-1.1-7b-it_decoder_merged_model_fp16.onnx
ONNX
rank_0_gemma-1.1-7b-it_decoder_merged_model_fp16.onnx.data
special_tokens_map.json
tokenizer.json
tokenizer.model
tokenizer_config.json