onnx-community/ettin-decoder-32m-ONNX
By onnx-community · ↓ 1 · ♥ 0 · Updated 2025-07-20
What's in this repo
This page lists the files in onnx-community/ettin-decoder-32m-ONNX, including model.onnx, model_fp16.onnx, model_q4.onnx and more.
- 4 ONNX models (.onnx files)
- 14 files, including 4 .json, 4 .onnx, 4 .onnx_data, 1 .md
- Last updated 2025-07-20
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/model.onnx | — | Download |
| onnx/model_fp16.onnx | — | Download |
| onnx/model_q4.onnx | — | Download |
| onnx/model_q4f16.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
Transformers.js
If you haven't already, you can install the Transformers.js JavaScript library from NPM using:
npm i @huggingface/transformers
You can then generate text as follows:
import { pipeline, TextStreamer } from "@huggingface/transformers";
// Create a text generation pipeline
const generator = await pipeline(
"text-generation",
"onnx-community/ettin-decoder-32m-ONNX",
{ dtype: "fp32" },
);
// Generate a response
const text = "Q: What is the capital of France?\nA:";
const output = await generator(text, {
max_new_tokens: 128,
streamer: new TextStreamer(generator.tokenizer, { skip_prompt: true, skip_special_tokens: true }),
});
console.log(output[0].generated_text);
Model info
text-generation
transformers.js
transformers.js
onnx
modernbert-decoder
text-generation
en
base_model:jhu-clsp/ettin-decoder-32m
base_model:quantized:jhu-clsp/ettin-decoder-32m
license:mit
region:us
↓ 1
♥ 0
Created: 2025-07-20
Updated: 2025-07-20
View on Hugging FaceFiles (14)
.gitattributes
README.md
config.json
onnx/model.onnx
ONNX
onnx/model.onnx_data
onnx/model_fp16.onnx
ONNX
onnx/model_fp16.onnx_data
onnx/model_q4.onnx
ONNX
onnx/model_q4.onnx_data
onnx/model_q4f16.onnx
ONNX
onnx/model_q4f16.onnx_data
special_tokens_map.json
tokenizer.json
tokenizer_config.json