Guilherme34/Samantha-3b-beta0.1-model-nf4

By Guilherme34 · ↓ 0 · ♥ 0 · Updated 2025-09-04

What's in this repo

This page lists the files in Guilherme34/Samantha-3b-beta0.1-model-nf4.

No .onnx files in this repository
8 files, including 4 .json, 1 .md, 1 .jinja, 1 .safetensors
Last updated 2025-09-04

ONNX files

This repository has no .onnx files. See the full file list on the right for other formats.

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Guilherme34/Samantha-3b-beta0.1-model (Quantized)

Description

This model is a quantized version of the original model Guilherme34/Samantha-3b-beta0.1-model.

It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.

Quantization Details

Quantization Type: int4
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: True
bnb_4bit_compute_dtype: bfloat16
bnb_4bit_quant_storage: uint8

📄 Original Model Information

BETA MODEL, ITS NOT FINISHED

DOES NOT NEED ANY SYSTEM PROMPT, you can leave empty

Model info

feature-extraction transformers

transformers safetensors llama feature-extraction bnb-my-repo llama-3 meta facebook unsloth onnx en base_model:Guilherme34/Samantha-3b-beta0.1-model

↓ 0 ♥ 0

Created: 2025-09-04

Updated: 2025-09-04

View on Hugging Face

Files (8)

.gitattributes

README.md

chat_template.jinja

config.json

model.safetensors

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More feature-extraction models

Browse all feature-extraction models