ucalyptus/prem-1B-chat-onnx-q4

By ucalyptus · ↓ 3 · ♥ 1 · Updated 2024-05-13

What's in this repo

This page lists the files in ucalyptus/prem-1B-chat-onnx-q4, including model.onnx, model_q4.onnx.

2 ONNX models (.onnx files)
15 files, including 7 .json, 2 .onnx, 2 .onnx_data, 1 .md, 1 .model
Last updated 2024-05-13

ONNX files

File	Size	Download
onnx/model.onnx	—	Download
onnx/model_q4.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

https://huggingface.co/premai-io/prem-1B-chat with ONNX weights to be compatible with Transformers.js.

Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).

Model info

text-generation transformers.js

transformers.js onnx llama text-generation conversational region:us

↓ 3 ♥ 1

Created: 2024-05-13

Updated: 2024-05-13

View on Hugging Face

Files (15)

.gitattributes

Constant_2004_attr__value

README.md

added_tokens.json

config.json

generation_config.json

onnx/model.onnx ONNX

onnx/model.onnx_data

onnx/model_q4.onnx ONNX

onnx/model_q4.onnx_data

quantize_config.json

special_tokens_map.json

tokenizer.json

tokenizer.model

tokenizer_config.json

Related models

More text-generation models

Browse all text-generation models