eduardoworrel/SmolLM2-135M
By eduardoworrel · ↓ 1 · ♥ 0 · Updated 2024-11-25
What's in this repo
This page lists the files in eduardoworrel/SmolLM2-135M, including model.onnx, model_bnb4.onnx, model_fp16.onnx and more.
- 8 ONNX models (.onnx files)
- 18 files, including 8 .onnx, 7 .json, 1 .md, 1 .txt
- Last updated 2024-11-25
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/model.onnx | — | Download |
| onnx/model_bnb4.onnx | — | Download |
| onnx/model_fp16.onnx | — | Download |
| onnx/model_int8.onnx | — | Download |
| onnx/model_q4.onnx | — | Download |
| onnx/model_q4f16.onnx | — | Download |
| onnx/model_quantized.onnx | — | Download |
| onnx/model_uint8.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
Usage (Transformers.js)
If you haven't already, you can install the Transformers.js JavaScript library from NPM using:
npm i @huggingface/transformers
You can then generate text as follows:
import { pipeline } from '@huggingface/transformers';
// Create a text generation pipeline
const generator = await pipeline('text-generation', 'eduardoworrel/SmolLM2-135M', {
device: 'auto',
});
// Generate a response
const output = await generator("Qual a captial do Brasil?", { max_new_tokens: 128 });
console.log(output[0].generated_text.at(-1).content);
Model info
text-generation
transformers.js
transformers.js
onnx
llama
text-generation
base_model:HuggingFaceTB/SmolLM2-135M
base_model:quantized:HuggingFaceTB/SmolLM2-135M
license:apache-2.0
region:us
↓ 1
♥ 0
Created: 2024-11-25
Updated: 2024-11-25
View on Hugging FaceFiles (18)
.gitattributes
README.md
config.json
generation_config.json
merges.txt
onnx/model.onnx
ONNX
onnx/model_bnb4.onnx
ONNX
onnx/model_fp16.onnx
ONNX
onnx/model_int8.onnx
ONNX
onnx/model_q4.onnx
ONNX
onnx/model_q4f16.onnx
ONNX
onnx/model_quantized.onnx
ONNX
onnx/model_uint8.onnx
ONNX
quantize_config.json
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.json