|
--- |
|
language: |
|
- pl |
|
license: mit |
|
tags: |
|
- bert |
|
- sentiment-classification |
|
- clarinpl-embeddings |
|
- LEPISZCZE |
|
datasets: |
|
- clarin-pl/aspectemo |
|
metrics: |
|
- accuracy |
|
- f1 |
|
- precision |
|
- recall |
|
--- |
|
|
|
# LEPISZCZE-aspectemo-allegro__herbert-base-cased-v1 |
|
## Description |
|
Finetuned [allegro/herbert-base-cased](https://huggingface.co/allegro/herbert-base-cased) model on [clarin-pl/aspectemo](https://huggingface.co/datasets/clarin-pl/aspectemo) dataset. |
|
|
|
Trained via [clarin-pl-embeddings](https://github.com/clarin-pl/embeddings) library, included in [LEPISZCZE](https://lepiszcze.ml/tasks/sentimentanalysis/) benchmark. |
|
|
|
## Results on clarin-pl/aspectemo |
|
| | accuracy | f1_macro | f1_micro | f1_weighted | recall_macro | recall_micro | recall_weighted | precision_macro | precision_micro | precision_weighted | |
|
|:------|-----------:|-----------:|-----------:|--------------:|---------------:|---------------:|------------------:|------------------:|------------------:|---------------------:| |
|
| value | 0.952 | 0.368 | 0.585 | 0.586 | 0.371 | 0.566 | 0.566 | 0.392 | 0.606 | 0.617 | |
|
|
|
### Metrics per class |
|
| | precision | recall | f1 | support | |
|
|:----------|------------:|---------:|------:|----------:| |
|
| a_amb | 0.2 | 0.033 | 0.057 | 91 | |
|
| a_minus_m | 0.632 | 0.542 | 0.584 | 1033 | |
|
| a_minus_s | 0.156 | 0.209 | 0.178 | 67 | |
|
| a_plus_m | 0.781 | 0.694 | 0.735 | 1015 | |
|
| a_plus_s | 0.153 | 0.22 | 0.18 | 41 | |
|
| a_zero | 0.431 | 0.529 | 0.475 | 501 | |
|
|
|
## Finetuning hyperparameters |
|
| Hyperparameter Name | Value | |
|
|:------------------------|:---------| |
|
| use_scheduler | True | |
|
| optimizer | AdamW | |
|
| warmup_steps | 25 | |
|
| learning_rate | 0.0005 | |
|
| adam_epsilon | 1e-05 | |
|
| weight_decay | 0 | |
|
| finetune_last_n_layers | 4 | |
|
| classifier_dropout | 0.2 | |
|
| max_seq_length | 512 | |
|
| batch_size | 64 | |
|
| max_epochs | 20 | |
|
| early_stopping_monitor | val/Loss | |
|
| early_stopping_mode | min | |
|
| early_stopping_patience | 3 | |
|
|
|
## Citation (BibTeX) |
|
``` |
|
@article{augustyniak2022way, |
|
title={This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polish}, |
|
author={Augustyniak, Lukasz and Tagowski, Kamil and Sawczyn, Albert and Janiak, Denis and Bartusiak, Roman and Szymczak, Adrian and Janz, Arkadiusz and Szyma{'n}ski, Piotr and W{\k{a}}troba, Marcin and Morzy, Miko{\l}aj and others}, |
|
journal={Advances in Neural Information Processing Systems}, |
|
volume={35}, |
|
pages={21805--21818}, |
|
year={2022} |
|
} |
|
``` |
|
|
|
|
|
|
