shreyask/qmd-query-expansion-1.7B-ONNX-kvcache-fp32

By shreyask · ↓ 13 · ♥ 0 · Updated 2026-03-12

What's in this repo

This page lists the files in shreyask/qmd-query-expansion-1.7B-ONNX-kvcache-fp32, including model.onnx.

1 ONNX models (.onnx files)
12 files, including 6 .json, 1 .md, 1 .jinja, 1 .txt, 1 .onnx, 1 .data
Last updated 2026-03-12

ONNX files

File	Size	Download
onnx/model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

qmd-query-expansion-1.7B ONNX KV Cache FP32

This repo contains a CPU-exported ONNX version of tobil/qmd-query-expansion-1.7B with flattened KV cache inputs and outputs for decoder generation.

What is included:

Root tokenizer and config files
onnx/model.onnx
onnx/model.onnx.data

Status:

KV-cache ONNX export is validated in ONNX Runtime
Variable seq_len and past_len work, including past_len=0
FP32 only
Q4 export is still pending because the current MatMulNBitsQuantizer path does not rewrite this graph yet

Validation summary:

Exported with torch.onnx.export(..., dynamo=True)
Verified with ONNX Runtime for multiple (seq_len, past_len) pairs:
- (2, 8)
- (1, 6)
- (3, 5)
- (1, 0)

Intended use:

This repo is for testing Transformers.js generation with native KV cache support
It is not the final quantized deployment artifact

Model info

text-generation transformers.js

transformers.js onnx qwen3 text-generation conversational region:us

↓ 13 ♥ 0

Created: 2026-03-12

Updated: 2026-03-12

View on Hugging Face

Files (12)

.gitattributes

README.md

added_tokens.json

chat_template.jinja

config.json

merges.txt

onnx/model.onnx ONNX

onnx/model.onnx.data

special_tokens_map.json

tokenizer.json

tokenizer_config.json

vocab.json

Related models

More text-generation models

Browse all text-generation models