inference4j/flan-t5-base
By inference4j · ↓ 16 · ♥ 0 · Updated 2026-02-28
What's in this repo
This page lists the files in inference4j/flan-t5-base, including decoder_model.onnx, decoder_with_past_model.onnx, encoder_model.onnx.
- 3 ONNX models (.onnx files)
- 7 files, including 3 .onnx, 2 .json, 1 .md
- Last updated 2026-02-28
ONNX files
| File | Size | Download |
|---|---|---|
| decoder_model.onnx | — | Download |
| decoder_with_past_model.onnx | — | Download |
| encoder_model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
Flan-T5 Base — ONNX
ONNX export of Flan-T5 Base (250M parameters) with encoder-decoder architecture and KV cache support.
Converted for use with inference4j, an inference-only AI library for Java.
Original Source
- Repository: google/flan-t5-base
- License: Apache 2.0
Usage with inference4j
// Summarization
try (var gen = FlanT5TextGenerator.flanT5Base().build()) {
System.out.println(gen.summarize("Long article text..."));
}
// Translation
try (var gen = FlanT5TextGenerator.flanT5Base().build()) {
System.out.println(gen.translate("Hello!", Language.EN, Language.FR));
}
Model Details
| Property | Value |
|---|---|
| Architecture | T5 encoder-decoder (250M parameters) |
| Tasks | Summarization, translation, grammar correction, text-to-SQL |
| Tokenizer | SentencePiece (32,128 tokens) |
| Original framework | PyTorch (transformers) |
| Export method | Hugging Face Optimum (encoder-decoder with KV cache) |
License
This model is licensed under the Apache License 2.0. Original model by Google.
Model info
Created: 2026-02-28
Updated: 2026-02-28
View on Hugging Face