ONNX Model Zoo

willopcbeta/Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill-ONNX

By willopcbeta · ↓ 3 · ♥ 0 · Updated 2026-02-07

What's in this repo

This page lists the files in willopcbeta/Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill-ONNX, including model_q4.onnx, model_q4f16.onnx.

  • 2 ONNX models (.onnx files)
  • 20 files, including 7 .json, 2 .onnx, 2 .onnx_data, 2 .onnx_data_1, 2 .onnx_data_2, 1 .md
  • Last updated 2026-02-07

ONNX files

File Size Download
onnx/model_q4.onnx — Download
onnx/model_q4f16.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Export using onnxruntime-genai:

--precision int4 --execution-provider webgpu --extra_options int4 Accuracy.level=4
--precision int4 --execution_provider cpu

Qwen3 4B Instruct 2507 - Gemini 3 Pro Preview (No Reasoning) Distill

Source:TeichAI/Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill
This model was trained on a Gemini 3 Pro Preview dataset with a high reasoning effort.

The reasoning summaries were then formatted out of the dataset and the model was finetuned on the final answers only.

  • 🧬 Datasets:

    • TeichAI/gemini-3-pro-preview-high-reasoning-1000x
  • 🏗 Base Model:

    • unsloth/Qwen3-4B-Instruct-2507
  • ⚡ Use cases:

    • Coding
    • Science
  • ∑ Stats (Dataset)

    • Costs: $ 32.7 (USD)
    • Total tokens (input + output): 2.73 M

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Model info

text-generation transformers.js
transformers.js onnx qwen3 text-generation text-generation-inference unsloth conversational dataset:TeichAI/gemini-3-pro-preview-high-reasoning-1000x base_model:unsloth/Qwen3-4B-Instruct-2507 base_model:quantized:unsloth/Qwen3-4B-Instruct-2507 license:apache-2.0 region:us
↓ 3 ♥ 0

Created: 2026-02-06

Updated: 2026-02-07

View on Hugging Face

Files (20)

.gitattributes
README.md
added_tokens.json
chat_template.jinja
config.json
genai_config.json
merges.txt
onnx/model_q4.onnx ONNX
onnx/model_q4.onnx_data
onnx/model_q4.onnx_data_1
onnx/model_q4.onnx_data_2
onnx/model_q4.onnx_data_3
onnx/model_q4f16.onnx ONNX
onnx/model_q4f16.onnx_data
onnx/model_q4f16.onnx_data_1
onnx/model_q4f16.onnx_data_2
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.json

Related models