Intel/deberta-v3-base-mrpc-int8-dynamic-inc
By Intel · ↓ 7 · ♥ 0 · Updated 2023-06-27
What's in this repo
This page lists the files in Intel/deberta-v3-base-mrpc-int8-dynamic-inc, including model.onnx.
- 1 ONNX models (.onnx files)
- 8 files, including 5 .json, 1 .md, 1 .onnx
- Last updated 2023-06-27
ONNX files
| File | Size | Download |
|---|---|---|
| model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
INT8 deberta-v3-base-mrpc
Post-training Dynamic quantization
ONNX
This is an INT8 ONNX model quantized with Intel® Neural Compressor.
The original fp32 model comes from the fine-tuned model Intel/deberta-v3-base-mrpc.
Test result
| INT8 | FP32 | |
|---|---|---|
| Accuracy (eval-f1) | 0.9239 | 0.9223 |
| Model size (MB) | 350 | 705 |
Load ONNX model:
from optimum.onnxruntime import ORTModelForSequenceClassification
model = ORTModelForSequenceClassification.from_pretrained('Intel/deberta-v3-base-mrpc-int8-dynamic')
Model info
text-classification
transformers
transformers
onnx
deberta-v2
text-classification
text-classfication
int8
Intel® Neural Compressor
neural-compressor
PostTrainingDynamic
dataset:glue
license:mit
text-embeddings-inference
↓ 7
♥ 0
Created: 2023-05-25
Updated: 2023-06-27
View on Hugging FaceFiles (8)
.gitattributes
README.md
added_tokens.json
config.json
model.onnx
ONNX
special_tokens_map.json
tokenizer.json
tokenizer_config.json