Hugging Face's logo

sharkMeow
/
mt5-small-finetuned-b8-10

Text2Text Generation
Transformers
PyTorch
mt5
Generated from Trainer
Inference Endpoints
Model card Files Community
sharkMeow commited on
Commit
5a1fd00
•
1 Parent(s): 44088ac

End of training

Browse files
Files changed (3) hide show
  1. README.md +11 -12
  2. pytorch_model.bin +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -17,12 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [google/mt5-small](https://huggingface.co/google/mt5-small) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 3.7340
21
- - Rouge1: 0.0359
22
- - Rouge2: 0.0077
23
- - Rougel: 0.0357
24
- - Rougelsum: 0.0357
25
- - Gen Len: 10.8384
26
 
27
  ## Model description
28
 
@@ -49,17 +49,16 @@ The following hyperparameters were used during training:
49
  - total_train_batch_size: 16
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - num_epochs: 5
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
58
- | 12.4116 | 1.0 | 1357 | 3.3739 | 0.0033 | 0.0002 | 0.0033 | 0.0033 | 16.3309 |
59
- | 1.7237 | 2.0 | 2714 | 1.4076 | 0.0022 | 0.0 | 0.0021 | 0.0022 | 4.5805 |
60
- | 1.4447 | 3.0 | 4071 | 1.2431 | 0.0031 | 0.0 | 0.0031 | 0.0031 | 4.0912 |
61
- | 1.3493 | 4.0 | 5428 | 1.2140 | 0.0247 | 0.0026 | 0.0248 | 0.0247 | 7.3331 |
62
- | 1.2809 | 5.0 | 6785 | 3.7340 | 0.0359 | 0.0077 | 0.0357 | 0.0357 | 10.8384 |
63
 
64
 
65
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [google/mt5-small](https://huggingface.co/google/mt5-small) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 3.6458
21
+ - Rouge1: 0.1334
22
+ - Rouge2: 0.1033
23
+ - Rougel: 0.1296
24
+ - Rougelsum: 0.1296
25
+ - Gen Len: 15.4277
26
 
27
  ## Model description
28
 
 
49
  - total_train_batch_size: 16
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - num_epochs: 4
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
58
+ | 5.1916 | 1.0 | 1357 | 3.8497 | 0.1095 | 0.086 | 0.1067 | 0.1064 | 12.6442 |
59
+ | 4.5138 | 2.0 | 2714 | 3.7329 | 0.1228 | 0.0959 | 0.1198 | 0.1195 | 14.4008 |
60
+ | 4.3429 | 3.0 | 4071 | 3.6736 | 0.1291 | 0.1 | 0.1255 | 0.1255 | 15.0502 |
61
+ | 4.3195 | 4.0 | 5428 | 3.6458 | 0.1334 | 0.1033 | 0.1296 | 0.1296 | 15.4277 |
 
62
 
63
 
64
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8c24d1e5dfb65190a314dadcd984944c699e407c41a77a0ea4b8ec828120fa36
3
  size 1200772613
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c3e7678e2cb8c9955e822b80fe6027c0ee8c8e7e34a60fc768382cd3ef2d7eb
3
  size 1200772613
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3cd38018acc99fbddede02d3a11766268513e6430bf7056d0b238e1c37ec8b6e
3
  size 4219
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9686daf20076d7707f748fcbd0cf83ffa1342465949fa0597a7dd673c8a9a185
3
  size 4219