ONNX Model Zoo

Prince-1/Osmosis-mcp-4b

By Prince-1 · ↓ 0 · ♥ 1 · Updated 2025-07-11

What's in this repo

This page lists the files in Prince-1/Osmosis-mcp-4b, including model.onnx.

  • 1 ONNX models (.onnx files)
  • 12 files, including 6 .json, 1 .md, 1 .jinja, 1 .txt, 1 .onnx, 1 .data
  • Last updated 2025-07-11

ONNX files

File Size Download
model.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Overview

Osmosis-MCP-4B is based on the Qwen3-4B model, fine-tuned with reinforcement learning to excel at multi step MCP-style tool usage.

We trained Osmosis-MCP-4B using a custom curriculum of multi-turn, tool-reliant prompts that mimic real-world use cases — for example:

"Given the weather in San Francisco, what are the top hiking locations?"

In addition, we provide a list of deterministic MCP like functions and mock server side behavior for the model to call and use.

This requires the model to reason through multiple tool invocations (e.g., weather → location ranker), and choose tools over intuition when applicable.


Training Approach

Our training pipeline leverages:

  • Dr. GRPO for stable and sample-efficient reinforcement learning.
  • Synthetic multi-step MCP interactions with strong tool chaining behavior, generated using our internal data engine.
  • SGLang + VeRL for efficient multi-turn rollout environments, built on top of Qwen3-4B for its function-calling capabilities.

Through this training methodology, we observed a notable behavioral shift: the model prefers invoking tools when appropriate, instead of relying solely on pre-trained intuition — a key milestone for MCP-native agents.


Why This Matters

MCP is fast becoming the open standard for tool-augmented AI agents. However:

  • Most top-performing models (e.g., Claude 3.7 Sonnet, Gemini 2.5 Pro) are closed.
  • Tool sprawl across clients and servers creates complexity.
  • Open models often lack the training to effectively use tools at all.

Osmosis-MCP-4B addresses all three — it’s small, powerful, and practical.


Model info

onnxruntime_genai
onnxruntime_genai onnx mcp qwen3 arxiv:2503.20783 base_model:osmosis-ai/osmosis-mcp-4b base_model:quantized:osmosis-ai/osmosis-mcp-4b license:apache-2.0 region:us
↓ 0 ♥ 1

Created: 2025-07-11

Updated: 2025-07-11

View on Hugging Face

Files (12)

.gitattributes
README.md
added_tokens.json
chat_template.jinja
genai_config.json
merges.txt
model.onnx ONNX
model.onnx.data
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.json

Related models