Fhrozen/orpheus-3b-0.1-ft-ONNX

By Fhrozen · ↓ 0 · ♥ 0 · Updated 2025-06-23

What's in this repo

This page lists the files in Fhrozen/orpheus-3b-0.1-ft-ONNX, including model.onnx and more.

3 ONNX models (.onnx files)
23 files, including 12 .json, 3 .jinja, 3 .onnx, 3 .data, 1 .md
Last updated 2025-06-23

ONNX files

File	Size	Download
cpu_int4/model.onnx	—	Download
cuda_bf16/model.onnx	—	Download
cuda_int4/model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

license: apache-2.0 base_model: canopylabs/orpheus-3b-0.1-ft tags:

ONNX
ONNXRuntime

https://huggingface.co/canopylabs/orpheus-3b-0.1-ft with ONNX weights to be compatible with ONNXRuntime-GenAI.

Model info

onnx ONNX ONNXRuntime base_model:canopylabs/orpheus-3b-0.1-ft base_model:quantized:canopylabs/orpheus-3b-0.1-ft license:apache-2.0 region:us

↓ 0 ♥ 0

Created: 2025-06-23

Updated: 2025-06-23

View on Hugging Face

Files (23)

.gitattributes

README.md

cpu_int4/chat_template.jinja

cpu_int4/genai_config.json

cpu_int4/model.onnx ONNX

cpu_int4/model.onnx.data

cpu_int4/special_tokens_map.json

cpu_int4/tokenizer.json

cpu_int4/tokenizer_config.json

cuda_bf16/chat_template.jinja

cuda_bf16/genai_config.json

cuda_bf16/model.onnx ONNX

cuda_bf16/model.onnx.data

cuda_bf16/special_tokens_map.json

cuda_bf16/tokenizer.json

cuda_bf16/tokenizer_config.json

cuda_int4/chat_template.jinja

cuda_int4/genai_config.json

cuda_int4/model.onnx ONNX

cuda_int4/model.onnx.data

cuda_int4/special_tokens_map.json

cuda_int4/tokenizer.json

cuda_int4/tokenizer_config.json

Related models

More models

No task type declared.