返回模型
说明文档
<!-- 此模型卡片已根据 Trainer 可访问的信息自动生成。您可能应该校对并完善它,然后删除此注释。 -->
modelsent_test
此模型是基于 albert/albert-base-v2 在 None 数据集上微调的版本。 它在评估集上取得了以下结果:
- Loss(损失): 0.2379
- Accuracy(准确率): 0.9261
- F1: 0.9261
- Precision(精确率): 0.9261
- Recall(召回率): 0.9261
- Accuracy Label Negative(负面标签准确率): 0.9242
- Accuracy Label Positive(正面标签准确率): 0.9278
模型描述
更多信息待补充
预期用途与限制
更多信息待补充
训练和评估数据
更多信息待补充
训练过程
训练超参数
训练过程中使用了以下超参数:
- learning_rate(学习率): 2e-05
- train_batch_size(训练批次大小): 16
- eval_batch_size(评估批次大小): 16
- seed(随机种子): 42
- gradient_accumulation_steps(梯度累积步数): 2
- total_train_batch_size(总训练批次大小): 32
- optimizer(优化器): 使用 OptimizerNames.ADAMW_TORCH,betas=(0.9,0.999),epsilon=1e-08,optimizer_args=无额外优化器参数
- lr_scheduler_type(学习率调度器类型): linear
- lr_scheduler_warmup_steps(学习率预热步数): 500
- num_epochs(训练轮数): 3
训练结果
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall | Accuracy Label Negative | Accuracy Label Positive |
|---|---|---|---|---|---|---|---|---|---|
| 0.5403 | 0.2442 | 100 | 0.5274 | 0.7611 | 0.7596 | 0.7728 | 0.7611 | 0.8535 | 0.6746 |
| 0.2673 | 0.4884 | 200 | 0.2806 | 0.8980 | 0.8980 | 0.8994 | 0.8980 | 0.9230 | 0.8746 |
| 0.247 | 0.7326 | 300 | 0.2610 | 0.9029 | 0.9024 | 0.9074 | 0.9029 | 0.8434 | 0.9586 |
| 0.2357 | 0.9768 | 400 | 0.2560 | 0.9084 | 0.9084 | 0.9096 | 0.9084 | 0.9318 | 0.8864 |
| 0.2094 | 1.2198 | 500 | 0.3127 | 0.9090 | 0.9089 | 0.9123 | 0.9090 | 0.9508 | 0.8698 |
| 0.1695 | 1.4640 | 600 | 0.2298 | 0.9188 | 0.9187 | 0.9189 | 0.9188 | 0.9053 | 0.9314 |
| 0.2024 | 1.7082 | 700 | 0.2218 | 0.9206 | 0.9206 | 0.9214 | 0.9206 | 0.9394 | 0.9030 |
| 0.1155 | 1.9524 | 800 | 0.2061 | 0.9236 | 0.9236 | 0.9236 | 0.9236 | 0.9192 | 0.9278 |
| 0.1361 | 2.1954 | 900 | 0.2299 | 0.9218 | 0.9218 | 0.9226 | 0.9218 | 0.9407 | 0.9041 |
| 0.1235 | 2.4396 | 1000 | 0.2668 | 0.9212 | 0.9212 | 0.9246 | 0.9212 | 0.9634 | 0.8817 |
| 0.084 | 2.6838 | 1100 | 0.2733 | 0.9218 | 0.9218 | 0.9240 | 0.9218 | 0.9545 | 0.8911 |
| 0.1326 | 2.9280 | 1200 | 0.2395 | 0.9249 | 0.9249 | 0.9249 | 0.9249 | 0.9192 | 0.9302 |
框架版本
- Transformers 4.49.0
- Pytorch 2.5.1+cu124
- Datasets 3.3.2
- Tokenizers 0.21.0
Frenz/modelsent_test
作者 Frenz
text-classification
transformers
↓ 1
♥ 0
创建时间: 2024-06-02 11:31:29+00:00
更新时间: 2025-03-12 19:14:14+00:00
在 Hugging Face 上查看文件 (17)
.gitattributes
README.md
config.json
model.safetensors
runs/Dec19_20-58-22_bd1bb20444ea/events.out.tfevents.1734641916.bd1bb20444ea.1518.0
runs/Jun02_11-18-47_abf2682c2968/events.out.tfevents.1717327130.abf2682c2968.2623.2
runs/Jun02_11-18-47_abf2682c2968/events.out.tfevents.1717327818.abf2682c2968.2623.3
runs/Jun16_10-55-42_e074026fd21f/events.out.tfevents.1718535344.e074026fd21f.458.0
runs/Jun16_10-55-42_e074026fd21f/events.out.tfevents.1718536095.e074026fd21f.458.1
sentiment-int8.onnx
ONNX
special_tokens_map.json
spiece.model
tokenizer.json
tokenizer_config.json
tokenizer_sentiment.pkl
trainer_state.json
training_args.bin