inference4j/distilbart-cnn-12-6
By inference4j · ↓ 13 · ♥ 0 · Updated 2026-02-28
What's in this repo
This page lists the files in inference4j/distilbart-cnn-12-6, including decoder_model.onnx, decoder_with_past_model.onnx, encoder_model.onnx.
- 3 ONNX models (.onnx files)
- 8 files, including 3 .onnx, 2 .json, 1 .md, 1 .txt
- Last updated 2026-02-28
ONNX files
| File | Size | Download |
|---|---|---|
| decoder_model.onnx | — | Download |
| decoder_with_past_model.onnx | — | Download |
| encoder_model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
DistilBART CNN 12-6 — ONNX
ONNX export of DistilBART CNN 12-6 (306M parameters) with encoder-decoder architecture and KV cache support.
A distilled version of BART Large CNN, fine-tuned for text summarization on the CNN/DailyMail dataset.
Converted for use with inference4j, an inference-only AI library for Java.
Original Source
- Repository: sshleifer/distilbart-cnn-12-6
- License: Apache 2.0
Usage with inference4j
try (var summarizer = BartSummarizer.distilBartCnn().build()) {
System.out.println(summarizer.summarize("Long article text..."));
}
Model Details
| Property | Value |
|---|---|
| Architecture | BART encoder-decoder (306M parameters, 12 encoder + 6 decoder layers) |
| Task | Text summarization |
| Training data | CNN/DailyMail |
| Tokenizer | BPE (50,265 tokens) |
| Original framework | PyTorch (transformers) |
| Export method | Hugging Face Optimum (encoder-decoder with KV cache) |
License
This model is licensed under the Apache License 2.0. Original model by Sam Shleifer.
Model info
Created: 2026-02-28
Updated: 2026-02-28
View on Hugging Face