mgoin/open_llama_3b_v2-ds

By mgoin · ↓ 0 · ♥ 0 · Updated 2023-10-04

What's in this repo

This page lists the files in mgoin/open_llama_3b_v2-ds, including model-orig.onnx, model.onnx.

2 ONNX models (.onnx files)
9 files, including 3 .json, 2 .onnx, 1 .md, 1 .data, 1 .model
Last updated 2023-10-04

ONNX files

File	Size	Download
model-orig.onnx	—	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

open_llama_3b_v2-ds

https://huggingface.co/openlm-research/open_llama_3b_v2

Inference

import deepsparse

model = deepsparse.TextGeneration(model="hf:mgoin/open_llama_3b_v2-ds")
model("Tell me a joke.")

Export

git clone https://huggingface.co/openlm-research/open_llama_3b_v2
sparseml.transformers.export_onnx --model_path ./open_llama_3b_v2 --task text-generation --sequence_length 512

Model info

text-generation transformers

transformers onnx llama text-generation deepsparse endpoints_compatible region:us

↓ 0 ♥ 0

Created: 2023-09-21

Updated: 2023-10-04

View on Hugging Face

Files (9)

.gitattributes

README.md

config.json

model-orig.onnx ONNX

model.data

model.onnx ONNX

special_tokens_map.json

tokenizer.model

tokenizer_config.json

Related models

More text-generation models

Browse all text-generation models