ONNX Model Zoo

Deepchecks/parrot_fluency_model_onnx

By Deepchecks · ↓ 8K · ♥ 0 · Updated 2023-10-02

What's in this repo

This page lists the files in Deepchecks/parrot_fluency_model_onnx, including model_optimized.onnx.

  • 1 ONNX models (.onnx files)
  • 9 files, including 5 .json, 1 .md, 1 .onnx, 1 .txt
  • Repository size ~220 MB
  • Last updated 2023-10-02

ONNX files

File Size Download
model_optimized.onnx 219 MB Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

This model represents an ONNX-optimized version of the original parrot_fluency_model model. It has been specifically tailored for GPUs and may exhibit variations in performance when run on CPUs.

Dependencies

Please install the following dependency before you begin working with the model:

pip install optimum[onnxruntime-gpu]

How to use

from transformers import AutoTokenizer
from optimum.onnxruntime import ORTModelForSequenceClassification
from optimum.pipelines import pipeline

# load tokenizer and model weights
tokenizer = AutoTokenizer.from_pretrained('Deepchecks/parrot_fluency_model_onnx')
model = ORTModelForSequenceClassification.from_pretrained('Deepchecks/parrot_fluency_model_onnx')

# prepare the pipeline and generate inferences
user_inputs = ['Natural language processing is an interdisciplinary subfield of linguistics, computer science, and artificial intelligence.',
               'Pass on what you have learned. Strength, mastery, hmm… but weakness, folly, failure, also. Yes, failure, most of all. The greatest teacher, failure is.',
               'Whispering dreams, forgotten desires, chaotic thoughts, dance with words, meaning elusive, swirling amidst.']
pip = pipeline(task='text-classification', model=model, tokenizer=tokenizer, device=device, accelerator="ort")
res = pip(user_inputs, batch_size=64, truncation="only_first")

Model info

text-classification transformers
transformers onnx bert text-classification fluency en license:apache-2.0 text-embeddings-inference endpoints_compatible region:us
↓ 8K ♥ 0

Created: 2023-10-01

Updated: 2023-10-02

View on Hugging Face

Files (9)

.gitattributes
README.md
config.json
model_optimized.onnx 219 MB ONNX
ort_config.json
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.txt

Related models