llmware/slim-emotions-onnx

By llmware · ↓ 3 · ♥ 1 · Updated 2024-10-31

What's in this repo

This page lists the files in llmware/slim-emotions-onnx, including model.onnx.

1 ONNX models (.onnx files)
10 files, including 5 .json, 1 .md, 1 .onnx, 1 .data, 1 .model
Last updated 2024-10-31

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

slim-emotions-onnx

slim-emotions-onnx is a specialized function calling model that classifies the emotion of a given text context passage, and generates a python dictionary with an "emotions" key and a value of the assessed emotion, e.g., ["surprised"].

This is an ONNX int4 quantized version of slim-emotions, providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

Model Description

Developed by: llmware
Model type: tinyllama
Parameters: 1.1 billion
Model Parent: llmware/slim-emotions
Language(s) (NLP): English
License: Apache 2.0
Uses: Emotions classifier designed for Agent-based multi-step workflows
RAG Benchmark Accuracy Score: NA
Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Model info

transformers

transformers onnx llama green p1 llmware-fx emerald base_model:llmware/slim-emotions base_model:quantized:llmware/slim-emotions license:apache-2.0 region:us

↓ 3 ♥ 1

Created: 2024-06-15

Updated: 2024-10-31

View on Hugging Face

Files (10)

.gitattributes

README.md

config.json

genai_config.json

model.onnx ONNX

model.onnx.data

special_tokens_map.json

tokenizer.json

tokenizer.model

tokenizer_config.json

Related models

More models

No task type declared.