Hugging Face's logo

emilstabil
/
mt5-base-finetuned-test_30483_prefix_summarize

Text2Text Generation
Transformers
PyTorch
mt5
Generated from Trainer
Inference Endpoints
Model card Files Community
emilstabil commited on
Commit
90332a6
•
1 Parent(s): ff419f6

End of training

Browse files
Files changed (2) hide show
  1. README.md +22 -22
  2. generation_config.json +4 -0
README.md CHANGED
@@ -6,23 +6,23 @@ tags:
6
  metrics:
7
  - rouge
8
  model-index:
9
- - name: mt5-base-finetuned-test_63829_prefix_summarize
10
  results: []
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
- # mt5-base-finetuned-test_63829_prefix_summarize
17
 
18
  This model is a fine-tuned version of [google/mt5-base](https://huggingface.co/google/mt5-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.3498
21
- - Rouge1: 11.28
22
- - Rouge2: 3.5248
23
- - Rougel: 9.174
24
- - Rougelsum: 10.6313
25
- - Gen Len: 19.0
26
 
27
  ## Model description
28
 
@@ -51,20 +51,20 @@ The following hyperparameters were used during training:
51
 
52
  ### Training results
53
 
54
- | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
- |:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:------:|:---------:|:-------:|
56
- | 7.6624 | 1.25 | 500 | 2.6231 | 7.333 | 2.0471 | 6.2456 | 7.0157 | 14.01 |
57
- | 3.3306 | 2.5 | 1000 | 2.5079 | 10.5135 | 3.0104 | 8.4645 | 9.8798 | 19.0 |
58
- | 3.1123 | 3.75 | 1500 | 2.4512 | 10.5261 | 3.3739 | 8.6176 | 9.8711 | 19.0 |
59
- | 2.9927 | 5.0 | 2000 | 2.4137 | 11.14 | 3.5973 | 9.2204 | 10.407 | 19.0 |
60
- | 2.8765 | 6.25 | 2500 | 2.4050 | 10.9669 | 3.7633 | 9.1517 | 10.283 | 19.0 |
61
- | 2.8211 | 7.5 | 3000 | 2.3828 | 11.6779 | 4.181 | 9.8295 | 10.9657 | 19.0 |
62
- | 2.7589 | 8.75 | 3500 | 2.3756 | 11.6097 | 4.1335 | 9.7619 | 10.8368 | 19.0 |
63
- | 2.722 | 10.0 | 4000 | 2.3627 | 11.8385 | 4.0634 | 9.6721 | 10.9386 | 19.0 |
64
- | 2.6781 | 11.25 | 4500 | 2.3611 | 11.3415 | 3.5812 | 9.1328 | 10.6537 | 19.0 |
65
- | 2.6648 | 12.5 | 5000 | 2.3524 | 11.3808 | 3.6088 | 9.2331 | 10.6316 | 19.0 |
66
- | 2.6404 | 13.75 | 5500 | 2.3521 | 11.3031 | 3.5165 | 9.1629 | 10.6573 | 19.0 |
67
- | 2.6397 | 15.0 | 6000 | 2.3498 | 11.28 | 3.5248 | 9.174 | 10.6313 | 19.0 |
68
 
69
 
70
  ### Framework versions
 
6
  metrics:
7
  - rouge
8
  model-index:
9
+ - name: mt5-base-finetuned-test_30483_prefix_summarize
10
  results: []
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
+ # mt5-base-finetuned-test_30483_prefix_summarize
17
 
18
  This model is a fine-tuned version of [google/mt5-base](https://huggingface.co/google/mt5-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 2.3527
21
+ - Rouge1: 23.6141
22
+ - Rouge2: 7.1791
23
+ - Rougel: 16.0152
24
+ - Rougelsum: 21.8213
25
+ - Gen Len: 69.64
26
 
27
  ## Model description
28
 
 
51
 
52
  ### Training results
53
 
54
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
56
+ | 7.4668 | 1.25 | 500 | 2.6478 | 10.4597 | 4.2457 | 8.7184 | 9.8473 | 18.49 |
57
+ | 3.3231 | 2.5 | 1000 | 2.5146 | 17.7315 | 6.0795 | 13.5384 | 16.6839 | 40.55 |
58
+ | 3.0956 | 3.75 | 1500 | 2.4512 | 20.2871 | 6.4051 | 14.8508 | 18.8768 | 51.35 |
59
+ | 2.9928 | 5.0 | 2000 | 2.4180 | 21.4196 | 6.629 | 15.2607 | 20.1471 | 57.92 |
60
+ | 2.8802 | 6.25 | 2500 | 2.4030 | 21.7949 | 6.7926 | 15.2506 | 20.338 | 61.05 |
61
+ | 2.8243 | 7.5 | 3000 | 2.3856 | 21.7075 | 6.7397 | 15.0044 | 20.1744 | 61.19 |
62
+ | 2.7646 | 8.75 | 3500 | 2.3847 | 22.4137 | 6.7644 | 14.9987 | 20.7797 | 63.81 |
63
+ | 2.7096 | 10.0 | 4000 | 2.3691 | 22.3403 | 6.9812 | 15.5411 | 20.6166 | 62.79 |
64
+ | 2.6758 | 11.25 | 4500 | 2.3612 | 23.6542 | 7.2355 | 15.9979 | 21.9807 | 69.83 |
65
+ | 2.6579 | 12.5 | 5000 | 2.3556 | 23.7473 | 7.5446 | 16.0314 | 21.917 | 69.75 |
66
+ | 2.651 | 13.75 | 5500 | 2.3557 | 23.9711 | 7.5018 | 16.2033 | 22.2811 | 69.29 |
67
+ | 2.639 | 15.0 | 6000 | 2.3527 | 23.6141 | 7.1791 | 16.0152 | 21.8213 | 69.64 |
68
 
69
 
70
  ### Framework versions
generation_config.json CHANGED
@@ -1,6 +1,10 @@
1
  {
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
 
 
 
 
4
  "pad_token_id": 0,
5
  "transformers_version": "4.32.1"
6
  }
 
1
  {
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
+ "length_penalty": 0.6,
5
+ "max_length": 500,
6
+ "no_repeat_ngram_size": 2,
7
+ "num_beams": 15,
8
  "pad_token_id": 0,
9
  "transformers_version": "4.32.1"
10
  }