返回模型
说明文档
>>> from deepsparse import TextGeneration
>>> model = TextGeneration(model_path="hf:mgoin/llama2-125m-pruned95-quant-ds")
>>> print(model("How to get in a good university?", max_new_tokens=50).generations[0].text)
The students at the University of Michigan are a great source of information about the university. The University of Michigan is a place where students can learn about their academic life and explore the possibilities of their future.
The University of Michigan is a place where students
mgoin/llama2-125m-pruned95-quant-ds
作者 mgoin
text-generation
transformers
↓ 1
♥ 0
创建时间: 2024-01-21 23:49:18+00:00
更新时间: 2024-01-22 17:26:36+00:00
在 Hugging Face 上查看文件 (8)
.gitattributes
README.md
config.json
model.onnx
ONNX
recipe.yaml
special_tokens_map.json
tokenizer.json
tokenizer_config.json