mku64/SmolLM2-360M-Instruct-Q3-mlx
By mku64 · ↓ 4 · ♥ 0 · Updated 2025-02-28
What's in this repo
This page lists the files in mku64/SmolLM2-360M-Instruct-Q3-mlx.
- No .onnx files in this repository
- 10 files, including 6 .json, 1 .md, 1 .txt, 1 .safetensors
- Last updated 2025-02-28
ONNX files
This repository has no .onnx files. See the full file list on the right for other formats.
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
mku64/SmolLM2-360M-Instruct-Q3-mlx
The Model mku64/SmolLM2-360M-Instruct-Q3-mlx was converted to MLX format from HuggingFaceTB/SmolLM2-360M-Instruct using mlx-lm version 0.21.5.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mku64/SmolLM2-360M-Instruct-Q3-mlx")
prompt="hello"
if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
Model info
text-generation
transformers
transformers
safetensors
llama
text-generation
onnx
transformers.js
mlx
mlx-my-repo
conversational
en
base_model:HuggingFaceTB/SmolLM2-360M-Instruct
base_model:quantized:HuggingFaceTB/SmolLM2-360M-Instruct
↓ 4
♥ 0
Created: 2025-02-28
Updated: 2025-02-28
View on Hugging FaceFiles (10)
.gitattributes
README.md
config.json
merges.txt
model.safetensors
model.safetensors.index.json
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.json