amd/Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid

By amd · ↓ 0 · ♥ 1 · Updated 2025-10-22

What's in this repo

This page lists the files in amd/Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid, including model_jit.onnx.

1 ONNX models (.onnx files)
15 files, including 5 .json, 2 .md, 2 .bin, 1 .jinja, 1 .txt, 1 .onnx
Last updated 2025-10-22

ONNX files

File	Size	Download
Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/model_jit.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

amd/Exaone-3.5-2.4B-instruct-onnx-ryzenai-hybrid

Introduction
This model was prepared using the AMD Quark Quantization tool, followed by necessary post-processing. Model generated using Ryzen AI 1.6.0. Compiled ops for 3K context length support located in dd_plugins. The dd_plugins directory must be one level above the root model directory to be properly found.

Model info

onnx ryzenai-hybrid base_model:deepseek-ai/DeepSeek-R1-Distill-Llama-8B base_model:quantized:deepseek-ai/DeepSeek-R1-Distill-Llama-8B license:mit region:us

↓ 0 ♥ 1

Created: 2025-10-22

Updated: 2025-10-22

View on Hugging Face

Files (15)

.gitattributes

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/README.md

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/chat_template.jinja

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/genai_config.json

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/merges.txt

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/model_jit.bin

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/model_jit.onnx ONNX

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/model_jit.onnx.data

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/model_jit.pb.bin

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/special_tokens_map.json

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/tokenizer.json

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/tokenizer_config.json

Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid/vocab.json

README.md

dd_plugins/Exaone-3.5-2.4B-Instruct-compiled-ops.zip

Related models

More models

No task type declared.