joaopn/roberta-large-openai-detector-onnx-fp16
By joaopn · ↓ 2 · ♥ 1 · Updated 2024-09-29
What's in this repo
This page lists the files in joaopn/roberta-large-openai-detector-onnx-fp16, including model.onnx.
- 1 ONNX models (.onnx files)
- 9 files, including 5 .json, 1 .md, 1 .txt, 1 .onnx
- Last updated 2024-09-29
ONNX files
| File | Size | Download |
|---|---|---|
| model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
RoBERTa Large OpenAI Detector
This model is a FP16 optimized version of openai-community/roberta-large-openai-detector. It runs exclusively on the GPU. The speedup compared to the base ONNX and pytorch versions depends chiefly on your GPU's FP16:FP32 ratio. For more comparison benchmarks and sample code of a related model, check here: https://github.com/joaopn/gpu_benchmark_goemotions.
You will need the GPU version of the ONNX Runtime. It can be installed with
pip install optimum[onnxruntime-gpu] --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-12/pypi/simple/
For convenience, this benchmark repo provides an environment.yml file to create a conda env with all the requirements.
Model info
Created: 2024-09-29
Updated: 2024-09-29
View on Hugging Face