onnx-community/TinyMistral-248M-v2-ONNX

By onnx-community · ↓ 0 · ♥ 1 · Updated 2025-01-01

What's in this repo

This page lists the files in onnx-community/TinyMistral-248M-v2-ONNX, including model.onnx, model_bnb4.onnx, model_fp16.onnx and more.

8 ONNX models (.onnx files)
16 files, including 8 .onnx, 6 .json, 1 .md
Last updated 2025-01-01

ONNX files

File	Size	Download
onnx/model.onnx	—	Download
onnx/model_bnb4.onnx	—	Download
onnx/model_fp16.onnx	—	Download
onnx/model_int8.onnx	—	Download
onnx/model_q4.onnx	—	Download
onnx/model_q4f16.onnx	—	Download
onnx/model_quantized.onnx	—	Download
onnx/model_uint8.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

https://huggingface.co/Locutusque/TinyMistral-248M-v2 with ONNX weights to be compatible with Transformers.js.

Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).

Model info

onnx mistral region:us

↓ 0 ♥ 1

Created: 2025-01-01

Updated: 2025-01-01

View on Hugging Face

Files (16)

.gitattributes

README.md

config.json

generation_config.json

onnx/model.onnx ONNX

onnx/model_bnb4.onnx ONNX

onnx/model_fp16.onnx ONNX

onnx/model_int8.onnx ONNX

onnx/model_q4.onnx ONNX

onnx/model_q4f16.onnx ONNX

onnx/model_quantized.onnx ONNX

onnx/model_uint8.onnx ONNX

quantize_config.json

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.