mgoin/llama2-125m-pruned95-quant-ds
By mgoin · ↓ 1 · ♥ 0 · Updated 2024-01-22
What's in this repo
This page lists the files in mgoin/llama2-125m-pruned95-quant-ds, including model.onnx.
- 1 ONNX models (.onnx files)
- 8 files, including 4 .json, 1 .md, 1 .onnx, 1 .yaml
- Last updated 2024-01-22
ONNX files
| File | Size | Download |
|---|---|---|
| model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
>>> from deepsparse import TextGeneration
>>> model = TextGeneration(model_path="hf:mgoin/llama2-125m-pruned95-quant-ds")
>>> print(model("How to get in a good university?", max_new_tokens=50).generations[0].text)
The students at the University of Michigan are a great source of information about the university. The University of Michigan is a place where students can learn about their academic life and explore the possibilities of their future.
The University of Michigan is a place where students
Model info
text-generation
transformers
transformers
onnx
llama
text-generation
endpoints_compatible
region:us
↓ 1
♥ 0
Created: 2024-01-21
Updated: 2024-01-22
View on Hugging FaceFiles (8)
.gitattributes
README.md
config.json
model.onnx
ONNX
recipe.yaml
special_tokens_map.json
tokenizer.json
tokenizer_config.json