pszemraj/nougat-small-onnx
By pszemraj · ↓ 5 · ♥ 2 · Updated 2025-12-29
What's in this repo
This page lists the files in pszemraj/nougat-small-onnx, including decoder_model.onnx, decoder_with_past_model.onnx, encoder_model.onnx.
- 3 ONNX models (.onnx files)
- 12 files, including 6 .json, 3 .onnx, 1 .md, 1 .ipynb
- Last updated 2025-12-29
ONNX files
| File | Size | Download |
|---|---|---|
| decoder_model.onnx | — | Download |
| decoder_with_past_model.onnx | — | Download |
| encoder_model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
nougat-small onnx
https://huggingface.co/facebook/nougat-small but exported to onnx. This is not quantized.
from transformers import NougatProcessor
from optimum.onnxruntime import ORTModelForVision2Seq
model_name = 'pszemraj/nougat-small-onnx'
processor = NougatProcessor.from_pretrained(model_name)
model = ORTModelForVision2Seq.from_pretrained(
model_name,
provider="CPUExecutionProvider", # 'CUDAExecutionProvider' for gpu
use_merged=False,
use_io_binding=True
)
on colab CPU-only (at time of writing) you may get CuPy errors, to solve this uninstall it:
pip uninstall cupy-cuda11x -y
how do da inference?
See here or this basic notebook I uploaded. It seems ONNX brings CPU inference times to 'feasible' - it took ~15 mins for Attention is All You Meme on Colab free CPU runtime.
Model info
Created: 2023-11-22
Updated: 2025-12-29
View on Hugging Face