nexuswho/gliner-onnx-small

By nexuswho · ↓ 4 · ♥ 0 · Updated 2025-12-18

What's in this repo

This page lists the files in nexuswho/gliner-onnx-small, including model.onnx, model_quantized.onnx.

2 ONNX models (.onnx files)
11 files, including 5 .json, 2 .onnx, 1 .md, 1 .bin, 1 .model
Last updated 2025-12-18

ONNX files

File	Size	Download
model.onnx	—	Download
model_quantized.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

GLiNER ONNX - Small

Pre-converted ONNX model for GLiNER zero-shot NER.

Model Details

Base Model: urchade/gliner_small-v2.1
Format: ONNX with INT8 quantization
Use Case: Fast CPU inference for entity extraction

Usage

from gliner import GLiNER

model = GLiNER.from_pretrained(
    "nexuswho/gliner-onnx-small",
    load_onnx_model=True,
    onnx_model_file="model_quantized.onnx",
)

entities = model.predict_entities(
    "AWS Lambda integrates with Amazon S3",
    ["cloud service", "storage service"],
)

Files

model_quantized.onnx - INT8 quantized ONNX model (recommended)
model.onnx - Full precision ONNX model
config.json, tokenizer.json, etc. - Model configuration

License

Apache 2.0 (same as base GLiNER model)

Model info

gliner

gliner pytorch onnx ner entity-extraction base_model:urchade/gliner_small-v2.1 base_model:quantized:urchade/gliner_small-v2.1 license:apache-2.0 region:us

↓ 4 ♥ 0

Created: 2025-12-18

Updated: 2025-12-18

View on Hugging Face

Files (11)

.gitattributes

README.md

added_tokens.json

gliner_config.json

model.onnx ONNX

model_quantized.onnx ONNX

pytorch_model.bin

special_tokens_map.json

spm.model

tokenizer.json

tokenizer_config.json

Related models

More from nexuswho

No other models by this author.

More models

No task type declared.