speakleash/Bielik-11B-v2.2-Instruct-onnx-fp16

By speakleash · ↓ 0 · ♥ 1 · Updated 2024-10-07

What's in this repo

This page lists the files in speakleash/Bielik-11B-v2.2-Instruct-onnx-fp16, including model.onnx.

1 ONNX models (.onnx files)
11 files, including 6 .json, 1 .md, 1 .onnx, 1 .onnx_data, 1 .model
Last updated 2024-10-07

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Bielik-7B-Instruct-v0.1-onnx-fp16

This repo contains Onnx fp16 (CUDA) format model files for SpeakLeash's Bielik-7B-Instruct-v0.1.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Model description:

Developed by: SpeakLeash
Language: Polish
Model type: causal decoder-only
Quant from: Bielik-7B-Instruct-v0.1
Finetuned from: Bielik-7B-v0.1
License: CC BY NC 4.0 (non-commercial use)
Model ref: speakleash:e38140bea0d48f1218540800bbc67e89

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.

Model info

text-generation transformers

transformers onnx mistral text-generation finetuned autoquant gptq conversational pl license:cc-by-nc-4.0 region:us

↓ 0 ♥ 1

Created: 2024-08-28

Updated: 2024-10-07

View on Hugging Face

Files (11)

.gitattributes

README.md

added_tokens.json

config.json

generation_config.json

model.onnx ONNX

model.onnx_data

special_tokens_map.json

tokenizer.json

tokenizer.model

tokenizer_config.json

Related models

More from speakleash

No other models by this author.

More text-generation models

Browse all text-generation models