ataleckij/gliner_multi-v2.1_onnx

By ataleckij · ↓ 0 · ♥ 0 · Updated 2026-01-30

What's in this repo

This page lists the files in ataleckij/gliner_multi-v2.1_onnx, including model.onnx, model_fp16.onnx.

2 ONNX models (.onnx files)
12 files, including 6 .json, 2 .onnx, 1 .md, 1 .bin, 1 .model
Last updated 2026-01-30

ONNX files

File	Size	Download
model.onnx	—	Download
model_fp16.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Temp fix for https://github.com/urchade/GLiNER/issues/314

1a. load ONNX FP32 (CPU)

from gliner import GLiNER

model = GLiNER.from_pretrained(
    model_id='ataleckij/gliner_multi-v2.1_onnx'
    map_location='cpu',
    load_tokenizer=True,
    load_onnx_model=True,
    onnx_model_file='model.onnx'
)
model.eval()

1b. load ONNX FP16 (GPU)

from gliner import GLiNER

model = GLiNER.from_pretrained(
    model_id='ataleckij/gliner_multi-v2.1_onnx'
    map_location='gpu',
    load_tokenizer=True,
    load_onnx_model=True,
    onnx_model_file='model_fp16.onnx'
)
model = model.half()
model.eval()

2. Inference

with torch.no_grad():
    preds_batch: list[list[dict]] = model.inference(
        texts,
        entity_types, 
        threshold=threshold, 
        batch_size=batch_size,
        flat_ner=False
    )

Model info

pytorch onnx gliner base_model:onnx-community/gliner_multi-v2.1 base_model:quantized:onnx-community/gliner_multi-v2.1 license:mit region:us

↓ 0 ♥ 0

Created: 2026-01-29

Updated: 2026-01-30

View on Hugging Face

Files (12)

.gitattributes

README.md

added_tokens.json

config.json

gliner_config.json

model.onnx ONNX

model_fp16.onnx ONNX

pytorch_model.bin

special_tokens_map.json

spm.model

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.