tomasmcm/teapotai-teapotllm-onnx
By tomasmcm · ↓ 3 · ♥ 1 · Updated 2025-04-09
What's in this repo
This page lists the files in tomasmcm/teapotai-teapotllm-onnx, including decoder_model.onnx, decoder_model_bnb4.onnx, decoder_model_fp16.onnx and more.
- 32 ONNX models (.onnx files)
- 46 files, including 32 .onnx, 7 .json, 2 .js, 1 .md, 1 .model, 1 .lock
- Last updated 2025-04-09
ONNX files
| File | Size | Download |
|---|---|---|
| onnx/decoder_model.onnx | — | Download |
| onnx/decoder_model_bnb4.onnx | — | Download |
| onnx/decoder_model_fp16.onnx | — | Download |
| onnx/decoder_model_int8.onnx | — | Download |
| onnx/decoder_model_merged.onnx | — | Download |
| onnx/decoder_model_merged_bnb4.onnx | — | Download |
| onnx/decoder_model_merged_fp16.onnx | — | Download |
| onnx/decoder_model_merged_int8.onnx | — | Download |
| onnx/decoder_model_merged_q4.onnx | — | Download |
| onnx/decoder_model_merged_q4f16.onnx | — | Download |
Showing 10 of 32 .onnx files — see the full file list on the right.
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
TeapotAI TeapotLLM ONNX
ONNX version of teapotai/teapotllm to use with Transformers.js.
Also includes a JavaScript version of the teapotai python package for interacting with the model using the Transformers.js library.
View the example script index.js.
Check the WebGPU ONNX Playground.
Installation
yarn install
Usage
This library provides a TeapotAI class that helps you interact with language models. Here's a basic example:
import TeapotAI from './TeapotAI.js';
const ai = new TeapotAI({
pipelineOptions: {
dtype: 'q4'
}
});
// Query with context
const response = await ai.query(
"What is the capital?",
"France is a country in Western Europe."
);
Model info
Created: 2025-03-27
Updated: 2025-04-09
View on Hugging Face