geoffsee/octen-embedding-0.6b-onnx-int4

By geoffsee · ↓ 0 · ♥ 0 · Updated 2026-02-26

What's in this repo

This page lists the files in geoffsee/octen-embedding-0.6b-onnx-int4, including model.int4.onnx.

1 ONNX models (.onnx files)
11 files, including 6 .json, 1 .md, 1 .onnx, 1 .data, 1 .txt
Last updated 2026-02-26

ONNX files

File	Size	Download
model.int4.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Octen-Embedding-0.6B ONNX (INT4)

ONNX export of Octen/Octen-Embedding-0.6B for inference with ONNX Runtime. This repo contains only the INT4 variant for smaller downloads. Other variants: fp16, int8, int4.

Base model: Octen/Octen-Embedding-0.6B
Max sequence length: 512
Hidden size: 1024

Files

File	Description
`model.int4.onnx` (+ `.onnx.data`)	INT4 Bnb4 weight-only, ~537 MB
`tokenizer/`	Same as base model

Usage

from huggingface_hub import hf_hub_download
import onnxruntime as ort
from transformers import AutoTokenizer

repo_id = "geoffsee/octen-embedding-0.6b-onnx-int4"
path = hf_hub_download(repo_id=repo_id, filename="model.int4.onnx")
tokenizer = AutoTokenizer.from_pretrained(repo_id)
session = ort.InferenceSession(path, providers=["CPUExecutionProvider"])
# ... encode and run ...

Model info

sentence-transformers

sentence-transformers onnx embeddings Octen license:mit region:us

↓ 0 ♥ 0

Created: 2026-02-26

Updated: 2026-02-26

View on Hugging Face

Files (11)

.gitattributes

README.md

conversion-metadata.json

model.int4.onnx ONNX

model.int4.onnx.data

tokenizer/added_tokens.json

tokenizer/merges.txt

tokenizer/special_tokens_map.json

tokenizer/tokenizer.json

tokenizer/tokenizer_config.json

tokenizer/vocab.json

Related models

More models

No task type declared.