ucalyptus/prem-1B-chat-ONNX
By ucalyptus · ↓ 6 · ♥ 1 · Updated 2024-05-13
What's in this repo
This page lists the files in ucalyptus/prem-1B-chat-ONNX, including decoder_model.onnx, decoder_model_quantized.onnx, model.onnx and more.
- 4 ONNX models (.onnx files)
- 18 files, including 7 .json, 4 .onnx, 2 .onnx_data, 1 .md, 1 .model
- Last updated 2024-05-13
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/decoder_model.onnx | — | Download |
| onnx/decoder_model_quantized.onnx | — | Download |
| onnx/model.onnx | — | Download |
| onnx/model_quantized.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
https://huggingface.co/premai-io/prem-1B-chat with ONNX weights to be compatible with Transformers.js.
Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).
Model info
Created: 2024-05-13
Updated: 2024-05-13
View on Hugging Face