pszemraj/nougat-small-onnx-quant_avx512_vnni

By pszemraj · ↓ 3 · ♥ 0 · Updated 2025-12-29

What's in this repo

This page lists the files in pszemraj/nougat-small-onnx-quant_avx512_vnni, including decoder_model_quantized.onnx, decoder_with_past_model_quantized.onnx, encoder_model_quantized.onnx.

3 ONNX models (.onnx files)
11 files, including 6 .json, 3 .onnx, 1 .md
Last updated 2025-12-29

ONNX files

File	Size	Download
decoder_model_quantized.onnx	—	Download
decoder_with_past_model_quantized.onnx	—	Download
encoder_model_quantized.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

nougat-small-onnx-quant_avx512_vnni

This was quantized from pszemraj/nougat-small-onnx using the --avx512_vnni flag. You need to have a processor with avx512_vnni instructions for this to work properly.

per_channel is set to True for better accuracy
Usage is the same as: https://huggingface.co/pszemraj/nougat-small-onnx
verify that you have the requirements by checking for results with lscpu | grep avx512_vnni

Model info

image-text-to-text transformers

transformers onnx vision-encoder-decoder image-text-to-text nougat quant avx512_vnni license:apache-2.0 endpoints_compatible region:us

↓ 3 ♥ 0

Created: 2024-02-22

Updated: 2025-12-29

View on Hugging Face

Files (11)

.gitattributes

README.md

config.json

decoder_model_quantized.onnx ONNX

decoder_with_past_model_quantized.onnx ONNX

encoder_model_quantized.onnx ONNX

ort_config.json

preprocessor_config.json

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More image-text-to-text models

Browse all image-text-to-text models