z-uo/bert-italian-ner-onnx-quantized-avx512
By z-uo · ↓ 5 · ♥ 1 · Updated 2024-02-18
What's in this repo
This page lists the files in z-uo/bert-italian-ner-onnx-quantized-avx512, including model_quantized.onnx.
- 1 ONNX models (.onnx files)
- 11 files, including 5 .json, 2 .py, 1 .md, 1 .onnx, 1 .txt
- Last updated 2024-02-18
ONNX files
| File | Size | Download |
|---|---|---|
| model_quantized.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
Bert Italian NER ONNX avx512
This model is the onnx version of nickprock/bert-italian-finetuned-ner.
To use you need to intall following libraries:
pip install optimum onnxruntime onnx
And run with the following script:
import time
from transformers import AutoTokenizer, pipeline
from optimum.onnxruntime import ORTModelForTokenClassification
tokenizer = AutoTokenizer.from_pretrained("z-uo/bert-italian-ner-onnx-quantized-avx512")
model = ORTModelForTokenClassification.from_pretrained("z-uo/bert-italian-ner-onnx-quantized-avx512")
nerpipeline = pipeline('ner', model=model, tokenizer=tokenizer)
text = "La sede storica della Olivetti è ad Ivrea"
output = nerpipeline(text)
Model info
token-classification
transformers
transformers
onnx
bert
token-classification
it
base_model:nickprock/bert-italian-finetuned-ner
base_model:quantized:nickprock/bert-italian-finetuned-ner
license:mit
endpoints_compatible
region:us
↓ 5
♥ 1
Created: 2024-02-18
Updated: 2024-02-18
View on Hugging FaceFiles (11)
.gitattributes
README.md
bert_din_quant.py
bert_din_quant_test.py
config.json
model_quantized.onnx
ONNX
ort_config.json
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.txt
Related models
More from z-uo
No other models by this author.