onnx-community/trlm-135m-ONNX
By onnx-community · ↓ 3 · ♥ 1 · Updated 2025-09-30
What's in this repo
This page lists the files in onnx-community/trlm-135m-ONNX, including model.onnx, model_bnb4.onnx, model_fp16.onnx and more.
- 8 ONNX models (.onnx files)
- 19 files, including 8 .json, 8 .onnx, 1 .md, 1 .txt
- Repository size ~1.6 GB
- Last updated 2025-09-30
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/model.onnx | 514 MB | Download |
| onnx/model_bnb4.onnx | 166 MB | Download |
| onnx/model_fp16.onnx | 257 MB | Download |
| onnx/model_int8.onnx | 129 MB | Download |
| onnx/model_q4.onnx | 172 MB | Download |
| onnx/model_q4f16.onnx | 112 MB | Download |
| onnx/model_quantized.onnx | 129 MB | Download |
| onnx/model_uint8.onnx | 129 MB | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
trlm-135m (ONNX)
This is an ONNX version of Shekswess/trlm-135m. It was automatically converted and uploaded using this space.
Model info
text-generation
transformers.js
transformers.js
onnx
llama
text-generation
conversational
base_model:Shekswess/trlm-135m
base_model:quantized:Shekswess/trlm-135m
region:us
↓ 3
♥ 1
Created: 2025-09-30
Updated: 2025-09-30
View on Hugging FaceFiles (19)
.gitattributes
README.md
added_tokens.json
config.json
generation_config.json
merges.txt
onnx/model.onnx
514 MB
ONNX
onnx/model_bnb4.onnx
166 MB
ONNX
onnx/model_fp16.onnx
257 MB
ONNX
onnx/model_int8.onnx
129 MB
ONNX
onnx/model_q4.onnx
172 MB
ONNX
onnx/model_q4f16.onnx
112 MB
ONNX
onnx/model_quantized.onnx
129 MB
ONNX
onnx/model_uint8.onnx
129 MB
ONNX
quantize_config.json
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.json