georgeguimaraes/lettucedect-onnx
By georgeguimaraes · ↓ 0 · ♥ 0 · Updated 2026-03-03
What's in this repo
This page lists the files in georgeguimaraes/lettucedect-onnx, including model.onnx.
- 1 ONNX models (.onnx files)
- 6 files, including 2 .json, 1 .md, 1 .onnx, 1 .data
- Last updated 2026-03-03
ONNX files
| File | Size | Download |
|---|---|---|
| model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
LettuceDetect ONNX (Base, English)
Pre-exported ONNX files for KRLabsOrg/lettucedect-base-modernbert-en-v1, a ModernBERT-based token classifier that detects hallucinations in RAG answers.
This repo exists so you can use the model without needing Python, torch, or transformers installed. Just download and run with any ONNX Runtime binding.
Files
| File | Size | Description |
|---|---|---|
model.onnx |
~2.8 MB | ONNX model graph |
model.onnx.data |
~598 MB | Model weights (external data) |
tokenizer.json |
~3.6 MB | HuggingFace tokenizer |
tokenizer_config.json |
~350 B | Tokenizer config |
Usage with Arcana (Elixir)
mix arcana.ground.setup
Downloads all files to priv/models/lettucedect/ and configures them for use with Arcana.Agent.ground/2.
How these were exported
from lettucedetect.models.inference import HallucinationDetector
import onnx
detector = HallucinationDetector(
method="transformer",
model_path="KRLabsOrg/lettucedect-base-modernbert-en-v1"
)
# export via torch
import torch
torch.onnx.export(detector.model, ..., "model.onnx", opset_version=14)
See scripts/export_lettuce_onnx.py in the Arcana repo for the full export script.
License
MIT, same as the original model.
Citation
@misc{Kovacs:2025,
title={LettuceDetect: A Hallucination Detection Framework for RAG Applications},
author={Ádám Kovács and Gábor Recski},
year={2025},
eprint={2502.17125},
archivePrefix={arXiv},
primaryClass={cs.CL},
}
Model info
Created: 2026-03-03
Updated: 2026-03-03
View on Hugging FaceFiles (6)
Related models
More from georgeguimaraes
No other models by this author.