ONNX Model Zoo

kazssym/granite-3b-code-instruct-128k-onnx-float16

By kazssym · ↓ 1 · ♥ 0 · Updated 2025-02-28

What's in this repo

This page lists the files in kazssym/granite-3b-code-instruct-128k-onnx-float16, including model.onnx.

  • 1 ONNX models (.onnx files)
  • 11 files, including 6 .json, 1 .md, 1 .txt, 1 .onnx, 1 .onnx_data
  • Last updated 2025-02-28

ONNX files

File Size Download
onnx/model.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

This model was exported from ibm-granite/granite-3b-code-instruct-128k using Optimum with float16 conversion and the basic optimization by ONNX Runtime.

The repository owner maintains this model for use with Transformers.js, but unfortunately, the external data format is not supported yet.

Model info

onnx llama text-generation conversational license:apache-2.0 region:us
↓ 1 ♥ 0

Created: 2025-02-09

Updated: 2025-02-28

View on Hugging Face

Files (11)

.gitattributes
README.md
config.json
generation_config.json
merges.txt
onnx/model.onnx ONNX
onnx/model.onnx_data
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.json

Related models