fcogidi/BARTxiv
By fcogidi · ↓ 3 · ♥ 0 · Updated 2024-12-01
What's in this repo
This page lists the files in fcogidi/BARTxiv, including decoder_model.onnx, decoder_model_bnb4.onnx, decoder_model_fp16.onnx and more.
- 32 ONNX models (.onnx files)
- 42 files, including 32 .onnx, 7 .json, 1 .md, 1 .txt
- Last updated 2024-12-01
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/decoder_model.onnx | — | Download |
| onnx/decoder_model_bnb4.onnx | — | Download |
| onnx/decoder_model_fp16.onnx | — | Download |
| onnx/decoder_model_int8.onnx | — | Download |
| onnx/decoder_model_merged.onnx | — | Download |
| onnx/decoder_model_merged_bnb4.onnx | — | Download |
| onnx/decoder_model_merged_fp16.onnx | — | Download |
| onnx/decoder_model_merged_int8.onnx | — | Download |
| onnx/decoder_model_merged_q4.onnx | — | Download |
| onnx/decoder_model_merged_q4f16.onnx | — | Download |
Showing 10 of 32 .onnx files — see the full file list on the right.
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
https://huggingface.co/JustinDu/BARTxiv with ONNX weights to be compatible with Transformers.js.
Steps to get ONNX quantized weights
- Use optimum-cli to convert the PyTorch weights to ONNX format.
optimum-cli export onnx --model JustinDu/BARTxiv BARTxiv_onnx
- Use the
quantizescript in the Transformers.js repo to quantize the ONNX weights.
python -m scripts.quantize --input_folder BARTxiv_onnx --output_folder BARTxiv_onnx/onnx
Move the .onnx files in the BARTxiv_onnx folder to BARTxiv_onnx/onnx (these are the FP32 weights).
Model info
Created: 2024-12-01
Updated: 2024-12-01
View on Hugging Face