sinequa/Qwen3-Embedding-0.6B-ONNX
By sinequa · ↓ 0 · ♥ 0 · Updated 2025-10-14
What's in this repo
This page lists the files in sinequa/Qwen3-Embedding-0.6B-ONNX, including model.onnx.
- 1 ONNX models (.onnx files)
- 6 files, including 2 .json, 1 .md, 1 .onnx, 1 .onnx_data
- Last updated 2025-10-14
ONNX files
| File | Size | Download |
|---|---|---|
| model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
Qwen3-Embedding-0.6B
This model is an ONNX conversion of the original Qwen3-Embedding model tailored for Sinequa usage.
Usage
This model is an Instruct Retriever, it's LLM Based. So you can give instruction at query time that better suits your needs. Only the query prefix should be added.
Packaging
Download this folder and use Package from local in the Sinequa Runnable Model Wizard.
Note: No MRL Cutoff is specified, so the embedding dimension out of this vectorizer will be 1024.
Inference Times
| GPU | Quantization type | Batch size 1 | Batch size 32 |
|---|---|---|---|
| NVIDIA A10 | FP16 | 31 ms | 472 ms |
| NVIDIA T4 | FP16 | 21 ms | 389 ms |
GPU Memory Usage
| Quantization type | Memory |
|---|---|
| FP16 | 2300 MiB |
Requirements
- Minimal Sinequa version: 11.12
Example of a payload in the Runnable Model API
{
"inputs": [
{
"text": "What is the capital of China?"
},
{
"text": "Explain Gravity"
}
],
"options": {
"context": "query",
"passagePrefix": "",
"queryPrefix": "Instruct: Given a web search query, retrieve relevant passages that answer the query\nQuery:"
}
}
Notice the instruction stating the model is given a "web search query". You could modify it to make it more domain-specific.
Maximum Sequence Length
In this repository, the maximum sequence length of the model has been set to 200 tokens, as Sinequa default. You could extend it up to 1024 following these simple steps:
- update the maximum sequence length to 1024 in the sinequa.conf.json file
- In the tokenizer.json file, update the property
max_length, undertruncationto 1024.
Model info
Created: 2025-06-26
Updated: 2025-10-14
View on Hugging FaceFiles (6)
Related models
More from sinequa
No other models by this author.
More models
No task type declared.