ONNX Model Zoo

sinequa/Qwen3-Embedding-0.6B-ONNX

By sinequa · ↓ 0 · ♥ 0 · Updated 2025-10-14

What's in this repo

This page lists the files in sinequa/Qwen3-Embedding-0.6B-ONNX, including model.onnx.

  • 1 ONNX models (.onnx files)
  • 6 files, including 2 .json, 1 .md, 1 .onnx, 1 .onnx_data
  • Last updated 2025-10-14

ONNX files

File Size Download
model.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Qwen3-Embedding-0.6B

This model is an ONNX conversion of the original Qwen3-Embedding model tailored for Sinequa usage.

Usage

This model is an Instruct Retriever, it's LLM Based. So you can give instruction at query time that better suits your needs. Only the query prefix should be added.

Packaging

Download this folder and use Package from local in the Sinequa Runnable Model Wizard.

Note: No MRL Cutoff is specified, so the embedding dimension out of this vectorizer will be 1024.

Inference Times

GPU Quantization type Batch size 1 Batch size 32
NVIDIA A10 FP16 31 ms 472 ms
NVIDIA T4 FP16 21 ms 389 ms

GPU Memory Usage

Quantization type Memory
FP16 2300 MiB

Requirements

  • Minimal Sinequa version: 11.12

Example of a payload in the Runnable Model API

{
  "inputs": [
    {
      "text": "What is the capital of China?"
    },
    {
        "text": "Explain Gravity"
    }
  ],
  "options": {
    "context": "query",
    "passagePrefix": "",
    "queryPrefix": "Instruct: Given a web search query, retrieve relevant passages that answer the query\nQuery:"
  }
}

Notice the instruction stating the model is given a "web search query". You could modify it to make it more domain-specific.

Maximum Sequence Length

In this repository, the maximum sequence length of the model has been set to 200 tokens, as Sinequa default. You could extend it up to 1024 following these simple steps:

  1. update the maximum sequence length to 1024 in the sinequa.conf.json file
  2. In the tokenizer.json file, update the property max_length, under truncation to 1024.

Model info

onnx mrl multilingual region:us
↓ 0 ♥ 0

Created: 2025-06-26

Updated: 2025-10-14

View on Hugging Face

Files (6)

.gitattributes
README.md
model.onnx ONNX
model.onnx_data
sinequa.conf.json
tokenizer.json

Related models