Hugging Face's logo

jhpassion0621
/
kp-umt5-base

Text2Text Generation
Transformers
TensorBoard
Safetensors
umt5
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
jhpassion0621 commited on
Commit
90b6638
•
1 Parent(s): e45a5e2

End of training

Browse files
Files changed (4) hide show
  1. README.md +2 -45
  2. generation_config.json +1 -0
  3. model.safetensors +1 -1
  4. runs/Feb01_16-12-02_3d9368cb1b31/events.out.tfevents.1706803927.3d9368cb1b31.28085.0 +2 -2
README.md CHANGED
@@ -3,8 +3,6 @@ license: apache-2.0
3
  base_model: google/umt5-base
4
  tags:
5
  - generated_from_trainer
6
- metrics:
7
- - bleu
8
  model-index:
9
  - name: kp-umt5-base
10
  results: []
@@ -16,10 +14,6 @@ should probably proofread and complete it, then remove this comment. -->
16
  # kp-umt5-base
17
 
18
  This model is a fine-tuned version of [google/umt5-base](https://huggingface.co/google/umt5-base) on an unknown dataset.
19
- It achieves the following results on the evaluation set:
20
- - Loss: 1.5488
21
- - Bleu: 9.2954
22
- - Gen Len: 18.0013
23
 
24
  ## Model description
25
 
@@ -44,48 +38,11 @@ The following hyperparameters were used during training:
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
- - num_epochs: 1
 
48
 
49
  ### Training results
50
 
51
- | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
52
- |:-------------:|:-----:|:-----:|:---------------:|:------:|:-------:|
53
- | 4.1202 | 0.03 | 1000 | 2.9777 | 2.8238 | 18.173 |
54
- | 3.5142 | 0.05 | 2000 | 2.5373 | 4.457 | 18.0813 |
55
- | 3.1913 | 0.08 | 3000 | 2.3418 | 5.029 | 18.019 |
56
- | 3.0343 | 0.11 | 4000 | 2.2078 | 5.5467 | 18.163 |
57
- | 2.9 | 0.14 | 5000 | 2.1214 | 5.9178 | 18.14 |
58
- | 2.7425 | 0.16 | 6000 | 2.0479 | 6.1516 | 18.0753 |
59
- | 2.6798 | 0.19 | 7000 | 1.9939 | 6.4309 | 18.1157 |
60
- | 2.6029 | 0.22 | 8000 | 1.9368 | 6.7683 | 18.1533 |
61
- | 2.5378 | 0.24 | 9000 | 1.8959 | 6.9762 | 18.1603 |
62
- | 2.5132 | 0.27 | 10000 | 1.8602 | 7.3219 | 18.2093 |
63
- | 2.4394 | 0.3 | 11000 | 1.8264 | 7.3572 | 18.158 |
64
- | 2.4158 | 0.33 | 12000 | 1.7959 | 7.5914 | 18.1257 |
65
- | 2.3339 | 0.35 | 13000 | 1.7696 | 7.6829 | 18.077 |
66
- | 2.3397 | 0.38 | 14000 | 1.7440 | 7.87 | 18.0993 |
67
- | 2.293 | 0.41 | 15000 | 1.7219 | 8.1915 | 18.1303 |
68
- | 2.2591 | 0.44 | 16000 | 1.7057 | 8.2801 | 18.0963 |
69
- | 2.274 | 0.46 | 17000 | 1.6874 | 8.4263 | 18.0953 |
70
- | 2.2387 | 0.49 | 18000 | 1.6709 | 8.5568 | 18.0837 |
71
- | 2.2176 | 0.52 | 19000 | 1.6527 | 8.6313 | 18.0767 |
72
- | 2.1742 | 0.54 | 20000 | 1.6414 | 8.718 | 18.0613 |
73
- | 2.2095 | 0.57 | 21000 | 1.6260 | 8.8699 | 18.044 |
74
- | 2.1936 | 0.6 | 22000 | 1.6154 | 8.8912 | 18.0573 |
75
- | 2.0923 | 0.63 | 23000 | 1.6119 | 8.9109 | 18.091 |
76
- | 2.1835 | 0.65 | 24000 | 1.6015 | 8.9474 | 18.0533 |
77
- | 2.1374 | 0.68 | 25000 | 1.5962 | 9.0021 | 18.064 |
78
- | 2.1286 | 0.71 | 26000 | 1.5816 | 9.0722 | 18.06 |
79
- | 2.0589 | 0.73 | 27000 | 1.5787 | 9.1697 | 18.0667 |
80
- | 2.0535 | 0.76 | 28000 | 1.5755 | 9.2336 | 18.05 |
81
- | 2.1078 | 0.79 | 29000 | 1.5697 | 9.1774 | 18.0537 |
82
- | 2.05 | 0.82 | 30000 | 1.5635 | 9.2354 | 18.0347 |
83
- | 2.0517 | 0.84 | 31000 | 1.5593 | 9.2574 | 18.0013 |
84
- | 2.0802 | 0.87 | 32000 | 1.5549 | 9.2727 | 18.0113 |
85
- | 2.0137 | 0.9 | 33000 | 1.5540 | 9.2265 | 18.0007 |
86
- | 2.069 | 0.92 | 34000 | 1.5497 | 9.3092 | 18.019 |
87
- | 2.0969 | 0.95 | 35000 | 1.5498 | 9.2936 | 18.0113 |
88
- | 2.0911 | 0.98 | 36000 | 1.5488 | 9.2954 | 18.0013 |
89
 
90
 
91
  ### Framework versions
 
3
  base_model: google/umt5-base
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: kp-umt5-base
8
  results: []
 
14
  # kp-umt5-base
15
 
16
  This model is a fine-tuned version of [google/umt5-base](https://huggingface.co/google/umt5-base) on an unknown dataset.
 
 
 
 
17
 
18
  ## Model description
19
 
 
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - lr_scheduler_warmup_steps: 1000
42
+ - num_epochs: 2
43
 
44
  ### Training results
45
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
46
 
47
 
48
  ### Framework versions
generation_config.json CHANGED
@@ -1,4 +1,5 @@
1
  {
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
 
1
  {
2
+ "_from_model_config": true,
3
  "decoder_start_token_id": 0,
4
  "eos_token_id": 1,
5
  "pad_token_id": 0,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:94444c819ae8e8074387969eff4d57b14e71a972ff1307e8c50d07f50739f0ea
3
  size 2368210808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3b0aa3c3a7b1f592a5eebe20553d64df6282e474783a28e6565f53a667825d5
3
  size 2368210808
runs/Feb01_16-12-02_3d9368cb1b31/events.out.tfevents.1706803927.3d9368cb1b31.28085.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:633832d0c0135f13d9282ed48da9080fde2131679a9ed4625041c0e70c702bbd
3
- size 120923
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b4b1b4f7171a93d211734eb288746df63e1bea0402f320407e97f36c57514d1
3
+ size 122083