tonimartir/gpt-oss-20b-onnx-generic-rtn-cpu
By tonimartir · ↓ 0 · ♥ 0 · Updated 2026-02-09
What's in this repo
This page lists the files in tonimartir/gpt-oss-20b-onnx-generic-rtn-cpu, including model.onnx.
- 1 ONNX models (.onnx files)
- 10 files, including 5 .json, 1 .md, 1 .jinja, 1 .onnx, 1 .data
- Last updated 2026-02-09
ONNX files
| File | Size | Download |
|---|---|---|
| model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
language:
- en license: apache-2.0 tags:
- onnx
- cpu
- rtn
- gpt-oss
- microsoft
- text-generation
- 20b base_model: microsoft/gpt-oss-20b model_creator: Microsoft model_type: gpt pipeline_tag: text-generation
GPT-OSS 20B ONNX (RTN Quantized for CPU)
This model is an optimized version of gpt-oss-20b to enable local inference on CPUs using RTN (Round-to-Nearest) quantization.
Model Summary
- Developed by: Microsoft
- Model Type: ONNX
- License: Apache-2.0
- Optimization: RTN Quantization for efficient CPU memory usage
- Target Hardware: Optimized for local inference on CPUs
Technical Description
This repository contains a conversion of the gpt-oss-20b model specifically tailored for local inference on CPUs. By utilizing the ONNX format and RTN quantization, the model achieves a significant reduction in RAM footprint while maintaining the core capabilities of the base architecture, making it suitable for environments where GPU acceleration is not available.
Base Model Information
For detailed information regarding the architecture, training data, and intended use cases, please refer to the original gpt-oss-20b model on Azure AI Foundry.
Deployment
Compatible with ONNX Runtime (ORT) using the default CPU Execution Provider.
Model info
Created: 2026-02-08
Updated: 2026-02-09
View on Hugging Face