SynthflowAI/whisper-small_voicemail_classification
By SynthflowAI · ↓ 9 · ♥ 0 · Updated 2025-02-19
What's in this repo
This page lists the files in SynthflowAI/whisper-small_voicemail_classification, including classifier.onnx, classifier_int8.onnx.
- 2 ONNX models (.onnx files)
- 13 files, including 6 .csv, 2 .onnx, 1 .md, 1 .pth, 1 .json, 1 .pbtxt
- Last updated 2025-02-19
ONNX files
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
Note: This classifier also contains fine-tuned whisper-small weights in its state dict. It will be properly loaded by my model wrapper.
Result of the classifier Rob's human-annotated dataset (data/voicemail_human_eval.csv):
Results for chunk size 1 seconds:
- Accuracy: 0.8080
- Precision: 0.9353
- Recall: 0.7692
- F1 Score: 0.8442
Results for chunk size 2 seconds:
- Accuracy: 0.8560
- Precision: 0.9650
- Recall: 0.8166
- F1 Score: 0.8846
Results for chunk size 5 seconds:
- Accuracy: 0.8640
- Precision: 0.9856
- Recall: 0.8107
- F1 Score: 0.8896
Results for chunk size 10 seconds:
- Accuracy: 0.8760
- Precision: 1.0000
- Recall: 0.8166
- F1 Score: 0.8990
Results for full audio samples:
- Accuracy: 0.8760
- Precision: 1.0000
- Recall: 0.8166
- F1 Score: 0.8990
Model info
Created: 2025-02-03
Updated: 2025-02-19
View on Hugging FaceFiles (13)
Related models
More from SynthflowAI
No other models by this author.
More models
No task type declared.