Deepchecks/roberta_toxicity_classifier_onnx
By Deepchecks · ↓ 13 · ♥ 0 · Updated 2023-10-02
What's in this repo
This page lists the files in Deepchecks/roberta_toxicity_classifier_onnx, including model_optimized.onnx.
- 1 ONNX models (.onnx files)
- 10 files, including 6 .json, 1 .md, 1 .txt, 1 .onnx
- Last updated 2023-10-02
ONNX files
| File | Size | Download |
|---|---|---|
| model_optimized.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
This model represents an ONNX-optimized version of the original roberta_toxicity_classifier model. It has been specifically tailored for GPUs and may exhibit variations in performance when run on CPUs.
Dependencies
Please install the following dependency before you begin working with the model:
pip install optimum[onnxruntime-gpu]
How to use
from transformers import AutoTokenizer
from optimum.onnxruntime import ORTModelForSequenceClassification
from optimum.pipelines import pipeline
# load tokenizer and model weights
tokenizer = AutoTokenizer.from_pretrained('Deepchecks/roberta_toxicity_classifier_onnx')
model = ORTModelForSequenceClassification.from_pretrained('Deepchecks/roberta_toxicity_classifier_onnx')
# prepare the pipeline and generate inferences
pip = pipeline(task='text-classification', model=model, tokenizer=tokenizer, device=device, accelerator="ort")
res = pip(['I hate you', 'I love you'], batch_size=64, truncation="only_first")
Licensing Information
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Model info
Created: 2023-10-01
Updated: 2023-10-02
View on Hugging Face