Hugging Face's logo

CodeIsAbstract
/
denoice-finetuned-xsum

Text2Text Generation
Transformers
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
CodeIsAbstract commited on
Commit
fe17a18
·
verified ·
1 Parent(s): c2d6516

Model save

Browse files
Files changed (3) hide show
  1. README.md +60 -18
  2. model.safetensors +1 -1
  3. tokenizer.json +2 -9
README.md CHANGED
@@ -1,4 +1,6 @@
1
  ---
 
 
2
  tags:
3
  - generated_from_trainer
4
  metrics:
@@ -13,14 +15,14 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # denoice-finetuned-xsum
15
 
16
- This model was trained from scratch on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.6757
19
- - Rouge1: 73.1568
20
- - Rouge2: 56.3431
21
- - Rougel: 73.2739
22
- - Rougelsum: 73.2387
23
- - Gen Len: 16.5471
24
 
25
  ## Model description
26
 
@@ -45,22 +47,62 @@ The following hyperparameters were used during training:
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
- - num_epochs: 10
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
53
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
54
- | No log | 1.0 | 76 | 0.7087 | 72.4084 | 55.2193 | 72.4899 | 72.4272 | 16.5916 |
55
- | No log | 2.0 | 152 | 0.6998 | 72.7389 | 55.4449 | 72.7601 | 72.7258 | 16.5497 |
56
- | No log | 3.0 | 228 | 0.6946 | 72.674 | 55.5275 | 72.7467 | 72.712 | 16.5288 |
57
- | No log | 4.0 | 304 | 0.6888 | 72.7071 | 55.7658 | 72.7673 | 72.7402 | 16.5524 |
58
- | No log | 5.0 | 380 | 0.6829 | 72.8829 | 55.8072 | 72.9415 | 72.9187 | 16.5602 |
59
- | No log | 6.0 | 456 | 0.6801 | 73.067 | 55.9923 | 73.137 | 73.1117 | 16.5681 |
60
- | 0.8082 | 7.0 | 532 | 0.6791 | 73.1192 | 56.0297 | 73.2107 | 73.1619 | 16.5707 |
61
- | 0.8082 | 8.0 | 608 | 0.6768 | 73.0697 | 56.0297 | 73.1433 | 73.1279 | 16.5785 |
62
- | 0.8082 | 9.0 | 684 | 0.6763 | 72.9717 | 55.9654 | 73.0873 | 73.0365 | 16.5576 |
63
- | 0.8082 | 10.0 | 760 | 0.6757 | 73.1568 | 56.3431 | 73.2739 | 73.2387 | 16.5471 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
64
 
65
 
66
  ### Framework versions
 
1
  ---
2
+ license: apache-2.0
3
+ base_model: google/t5-efficient-tiny
4
  tags:
5
  - generated_from_trainer
6
  metrics:
 
15
 
16
  # denoice-finetuned-xsum
17
 
18
+ This model is a fine-tuned version of [google/t5-efficient-tiny](https://huggingface.co/google/t5-efficient-tiny) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.2532
21
+ - Rouge1: 58.505
22
+ - Rouge2: 40.7585
23
+ - Rougel: 58.4653
24
+ - Rougelsum: 58.4037
25
+ - Gen Len: 17.199
26
 
27
  ## Model description
28
 
 
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - num_epochs: 50
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
56
+ | No log | 1.0 | 76 | 3.6488 | 18.0544 | 10.1314 | 17.9969 | 17.9364 | 18.9555 |
57
+ | No log | 2.0 | 152 | 2.8655 | 20.8947 | 12.1663 | 20.8942 | 20.7913 | 17.2592 |
58
+ | No log | 3.0 | 228 | 2.5441 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
59
+ | No log | 4.0 | 304 | 2.1197 | 24.8779 | 13.8464 | 24.8679 | 24.7943 | 16.6361 |
60
+ | No log | 5.0 | 380 | 1.9142 | 32.7885 | 18.308 | 32.7168 | 32.6032 | 16.0026 |
61
+ | No log | 6.0 | 456 | 1.8132 | 42.6762 | 24.9808 | 42.7653 | 42.6814 | 16.4372 |
62
+ | 4.0412 | 7.0 | 532 | 1.7578 | 47.0516 | 28.9154 | 47.0625 | 46.8679 | 16.5497 |
63
+ | 4.0412 | 8.0 | 608 | 1.7036 | 48.5544 | 30.6663 | 48.4878 | 48.2941 | 16.712 |
64
+ | 4.0412 | 9.0 | 684 | 1.6619 | 49.0281 | 30.913 | 48.9624 | 48.8024 | 16.7932 |
65
+ | 4.0412 | 10.0 | 760 | 1.6264 | 50.4718 | 31.3769 | 50.4991 | 50.3001 | 16.8298 |
66
+ | 4.0412 | 11.0 | 836 | 1.5929 | 51.8768 | 32.8966 | 51.8764 | 51.6971 | 16.9241 |
67
+ | 4.0412 | 12.0 | 912 | 1.5674 | 52.805 | 33.7597 | 52.814 | 52.6762 | 17.0393 |
68
+ | 4.0412 | 13.0 | 988 | 1.5385 | 53.3014 | 34.7227 | 53.2522 | 53.1391 | 16.9686 |
69
+ | 2.3621 | 14.0 | 1064 | 1.5161 | 53.4211 | 34.5845 | 53.3523 | 53.2309 | 17.0654 |
70
+ | 2.3621 | 15.0 | 1140 | 1.4950 | 54.0068 | 35.364 | 53.9636 | 53.8528 | 17.0471 |
71
+ | 2.3621 | 16.0 | 1216 | 1.4740 | 54.9014 | 35.7748 | 54.793 | 54.7219 | 17.0681 |
72
+ | 2.3621 | 17.0 | 1292 | 1.4592 | 55.0288 | 36.4521 | 54.8815 | 54.8354 | 17.1466 |
73
+ | 2.3621 | 18.0 | 1368 | 1.4400 | 55.1504 | 36.5607 | 55.0743 | 55.0264 | 17.1178 |
74
+ | 2.3621 | 19.0 | 1444 | 1.4189 | 55.3705 | 36.7609 | 55.2619 | 55.1529 | 17.0942 |
75
+ | 2.0838 | 20.0 | 1520 | 1.4100 | 55.6045 | 36.6921 | 55.4813 | 55.3633 | 17.144 |
76
+ | 2.0838 | 21.0 | 1596 | 1.4001 | 55.716 | 36.8504 | 55.5929 | 55.5 | 17.1754 |
77
+ | 2.0838 | 22.0 | 1672 | 1.3874 | 55.4707 | 36.6502 | 55.3258 | 55.3038 | 17.1728 |
78
+ | 2.0838 | 23.0 | 1748 | 1.3732 | 55.5138 | 36.6722 | 55.4043 | 55.3049 | 17.1649 |
79
+ | 2.0838 | 24.0 | 1824 | 1.3640 | 55.6384 | 37.131 | 55.5682 | 55.5184 | 17.1806 |
80
+ | 2.0838 | 25.0 | 1900 | 1.3516 | 55.9776 | 37.4206 | 55.8968 | 55.8347 | 17.1754 |
81
+ | 2.0838 | 26.0 | 1976 | 1.3466 | 55.9109 | 37.3492 | 55.8212 | 55.7707 | 17.2147 |
82
+ | 1.9303 | 27.0 | 2052 | 1.3335 | 56.1628 | 37.5711 | 56.0569 | 56.037 | 17.1911 |
83
+ | 1.9303 | 28.0 | 2128 | 1.3308 | 56.3832 | 38.1769 | 56.2915 | 56.2485 | 17.2251 |
84
+ | 1.9303 | 29.0 | 2204 | 1.3193 | 56.5538 | 38.0494 | 56.4529 | 56.3879 | 17.199 |
85
+ | 1.9303 | 30.0 | 2280 | 1.3143 | 56.8915 | 38.4523 | 56.8172 | 56.7577 | 17.2251 |
86
+ | 1.9303 | 31.0 | 2356 | 1.3055 | 57.2079 | 38.7956 | 57.1173 | 57.0803 | 17.233 |
87
+ | 1.9303 | 32.0 | 2432 | 1.3016 | 57.2978 | 38.8335 | 57.2228 | 57.1916 | 17.2277 |
88
+ | 1.837 | 33.0 | 2508 | 1.2959 | 57.2382 | 39.3425 | 57.2579 | 57.1906 | 17.2225 |
89
+ | 1.837 | 34.0 | 2584 | 1.2885 | 57.5746 | 39.8412 | 57.5268 | 57.4536 | 17.1937 |
90
+ | 1.837 | 35.0 | 2660 | 1.2848 | 57.5721 | 39.5468 | 57.5542 | 57.4642 | 17.1937 |
91
+ | 1.837 | 36.0 | 2736 | 1.2829 | 57.7334 | 39.6824 | 57.7178 | 57.6337 | 17.1754 |
92
+ | 1.837 | 37.0 | 2812 | 1.2768 | 58.0261 | 40.335 | 58.0649 | 57.9859 | 17.1754 |
93
+ | 1.837 | 38.0 | 2888 | 1.2736 | 57.9739 | 40.2252 | 57.9272 | 57.8891 | 17.2016 |
94
+ | 1.837 | 39.0 | 2964 | 1.2693 | 58.1793 | 40.4482 | 58.1415 | 58.1187 | 17.178 |
95
+ | 1.7809 | 40.0 | 3040 | 1.2671 | 57.9545 | 40.3069 | 57.9214 | 57.9091 | 17.1806 |
96
+ | 1.7809 | 41.0 | 3116 | 1.2651 | 58.0546 | 40.4009 | 58.0387 | 57.9956 | 17.1911 |
97
+ | 1.7809 | 42.0 | 3192 | 1.2616 | 58.1469 | 40.4112 | 58.1098 | 58.0618 | 17.2042 |
98
+ | 1.7809 | 43.0 | 3268 | 1.2616 | 58.2348 | 40.5331 | 58.2115 | 58.1603 | 17.2068 |
99
+ | 1.7809 | 44.0 | 3344 | 1.2584 | 58.3018 | 40.5296 | 58.2795 | 58.2452 | 17.1963 |
100
+ | 1.7809 | 45.0 | 3420 | 1.2564 | 58.2935 | 40.478 | 58.2611 | 58.2192 | 17.1911 |
101
+ | 1.7809 | 46.0 | 3496 | 1.2550 | 58.2928 | 40.4315 | 58.2823 | 58.2234 | 17.1937 |
102
+ | 1.7469 | 47.0 | 3572 | 1.2541 | 58.2963 | 40.4214 | 58.2831 | 58.2164 | 17.1963 |
103
+ | 1.7469 | 48.0 | 3648 | 1.2538 | 58.4422 | 40.6293 | 58.4285 | 58.3755 | 17.1963 |
104
+ | 1.7469 | 49.0 | 3724 | 1.2534 | 58.505 | 40.7585 | 58.4653 | 58.4037 | 17.199 |
105
+ | 1.7469 | 50.0 | 3800 | 1.2532 | 58.505 | 40.7585 | 58.4653 | 58.4037 | 17.199 |
106
 
107
 
108
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c2a3be5d5076621367fc2bc808dd0bcd56a7569d6d60ee3c962db00798a9aa12
3
  size 62293080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a31861ce19557027d774e0326037e831f7a9a3a09062446ca575a8d4bbdcd116
3
  size 62293080
tokenizer.json CHANGED
@@ -1,15 +1,8 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 20,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
  "padding": {
10
- "strategy": {
11
- "Fixed": 20
12
- },
13
  "direction": "Right",
14
  "pad_to_multiple_of": null,
15
  "pad_id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
 
 
 
 
 
4
  "padding": {
5
+ "strategy": "BatchLongest",
 
 
6
  "direction": "Right",
7
  "pad_to_multiple_of": null,
8
  "pad_id": 0,