shadowavenger9/garbage-text-classifier

By shadowavenger9 · ↓ 4 · ♥ 0 · Updated 2025-01-17

What's in this repo

This page lists the files in shadowavenger9/garbage-text-classifier, including model.onnx.

1 ONNX models (.onnx files)
8 files, including 4 .json, 1 .md, 1 .onnx, 1 .txt
Last updated 2025-01-17

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Model Card for Garbage-Text-Classifier

A simple fine-tuning of the distilbert-base-uncased model for binary text-classification as Garbage/Nonsense or Not-Garbage.

Developed by: shadowavenger9
Model type: text-classifier
Finetuned from model : distilbert-base-uncased

Uses

For determining if the results of Optical-Character-Recognition are "meaningful" and removing garbage sentences.

Training Details

Training Data

Trained and evaluated on a small, hand-labelled dataset of 500 text messages, obtained via OCR on public screenshots of digital chats.

Data sample:

id	text	is_garbage
0	Verizon LTE	True
1	e 33%	True
2	"[AlCapone-t -based Username), 36 ""Come One, Come All."" Online Now"	True
3	Pawg	True
4	Send as Priority	True
5	esterday	True
6	15	True
7	:35	True
8	7:52P PM	True
9	a	True
10	LGE	True
11	55%	True
...
76	"fair bit of money burrgured you're worth it. what's a good time for a date, beautiful?"	False
77	Ummmm	False
78	Who are you	False
79	"Actually I don't wanna know, please never text me again"	False
80	"Wow. I went through all this trouble, and you just reject me? I went through 40 dollars just to get your phone number, you UNGRATEFUL BITCH! I'II still go out with you if you change your mind but don't think for one second that it will be to anywhere nice. In some parts of the world a woman could be stoned to death for talking to a generous, loving man like you just did. Consider yourself on a thin line."	False
81	Can take you out to dinner tonite?	False
82	Ignore me??	False
83	Been 20 minutes and I'm with family. Gosh.	False
84	Well it said your were online...	False
85	And it's 8pm already	False

Training Hyperparameters

10 Epochs at Learn-Rate: 2e^-5 Batch-Size: 16

Evaluation

Testing Data

Metrics

Final Validation Loss: 0.369251 Final Accuracy: 0.883333

Example

Text	Prediction
'WHat's up';	NOT_GARBAGE
'ahsubnsk';	GARBAGE
'Ido work there... ? Who is this?';	NOT_GARBAGE
'4:33 e';	GARBAGE
'Friday';	GARBAGE
'Women hate arrogance';	NOT_GARBAGE
'Hello?';	NOT_GARBAGE
'Britney';	NOT_GARBAGE
'aall AT&T LTE';	GARBAGE
'WASSSUPPp';	GARBAGE
'<> :32am';	GARBAGE

Model info

text-classification transformers

transformers onnx distilbert text-classification text-embeddings-inference endpoints_compatible region:us

↓ 4 ♥ 0

Created: 2025-01-17

Updated: 2025-01-17

View on Hugging Face

Files (8)

.gitattributes

README.md

config.json

model.onnx ONNX

special_tokens_map.json

tokenizer.json

tokenizer_config.json

vocab.txt

Related models

More from shadowavenger9

No other models by this author.

More text-classification models

Browse all text-classification models