fxmarty/opt-125m-smoothquant-onnx
By fxmarty · ↓ 6 · ♥ 0 · Updated 2023-10-26
What's in this repo
This page lists the files in fxmarty/opt-125m-smoothquant-onnx, including model_quantized.onnx.
- 1 ONNX models (.onnx files)
- 15 files, including 7 .json, 2 .py, 2 .pt, 1 .md, 1 .txt, 1 .onnx
- Last updated 2023-10-26
ONNX files
| File | Size | Download |
|---|---|---|
| model_quantized.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
FOR DEVELOPMENT ONLY. USE AT YOUR OWN RISK.
Model info
text-generation
transformers
transformers
onnx
opt
text-generation
license:mit
endpoints_compatible
region:us
↓ 6
♥ 0
Created: 2023-10-26
Updated: 2023-10-26
View on Hugging FaceFiles (15)
.gitattributes
README.md
compare.py
config.json
generation_config.json
logits_cpu.pt
logits_vitis.pt
merges.txt
model_quantized.onnx
ONNX
ort_config.json
run_model.py
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.json