kazssym/granite-3b-code-instruct-128k-onnx
By kazssym · ↓ 0 · ♥ 1 · Updated 2025-03-17
What's in this repo
This page lists the files in kazssym/granite-3b-code-instruct-128k-onnx, including model.onnx.
- 1 ONNX models (.onnx files)
- 11 files, including 6 .json, 1 .md, 1 .txt, 1 .onnx, 1 .onnx_data
- Last updated 2025-03-17
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
This model was exported from ibm-granite/granite-3b-code-instruct-128k using Optimum with the basic optimization by ONNX Runtime.
The repository owner maintains this model for use with Transformers.js and DirectML. The required external data format support was implemented in 3.4.0.
Trial
This model is currently being tested as follows:
import { pipeline } from "@huggingface/transformers"
const generator = await pipeline(
"text-generation",
"kazssym/granite-3b-code-instruct-128k-onnx",
{
device: "dml",
use_external_data_format: true,
session_options: {
},
},
)
Model info
Created: 2025-01-19
Updated: 2025-03-17
View on Hugging Face