anuragpradhan/SmolLM2-135M-Instruct-mlx-fp16
By anuragpradhan · ↓ 11 · ♥ 0 · Updated 2025-08-30
What's in this repo
This page lists the files in anuragpradhan/SmolLM2-135M-Instruct-mlx-fp16.
- No .onnx files in this repository
- 12 files, including 7 .json, 1 .md, 1 .jinja, 1 .txt, 1 .safetensors
- Last updated 2025-08-30
ONNX files
This repository has no .onnx files. See the full file list on the right for other formats.
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
anuragpradhan/SmolLM2-135M-Instruct-mlx-fp16
The Model anuragpradhan/SmolLM2-135M-Instruct-mlx-fp16 was converted to MLX format from HuggingFaceTB/SmolLM2-135M-Instruct using mlx-lm version 0.26.4.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("anuragpradhan/SmolLM2-135M-Instruct-mlx-fp16")
prompt="hello"
if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
Model info
Created: 2025-08-30
Updated: 2025-08-30
View on Hugging FaceFiles (12)
Related models
More from anuragpradhan
No other models by this author.