ONNX Model Zoo

kazssym/stablelm-3b-4e1t-onnx-float16

By kazssym · ↓ 0 · ♥ 0 · Updated 2024-03-17

What's in this repo

This page lists the files in kazssym/stablelm-3b-4e1t-onnx-float16, including model.onnx.

  • 1 ONNX models (.onnx files)
  • 9 files, including 4 .json, 1 .md, 1 .onnx, 1 .onnx_data
  • Last updated 2024-03-17

ONNX files

File Size Download
model.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Description

This is a float16 ONNX model for our test scripts. It was exported from stabilityai/stablelm-3b-4e1t to ONNX with a modified version of Hugging Face Optimum. It is quite possible to have problems.

Exporting

This model was exported with our test scripts.

The source model requires Transformers 4.38 or later to export.

Model info

text-generation transformers
transformers onnx stablelm text-generation causal-lm license:cc-by-sa-4.0 endpoints_compatible region:us
↓ 0 ♥ 0

Created: 2024-02-24

Updated: 2024-03-17

View on Hugging Face

Files (9)

.gitattributes
.gitignore
README.md
config.json
model.onnx ONNX
model.onnx_data
special_tokens_map.json
tokenizer.json
tokenizer_config.json

Related models