gaeunseo commited on
Commit
b201003
·
1 Parent(s): 5f23a14

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -6
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [klue/bert-base](https://huggingface.co/klue/bert-base) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 1.6277
17
 
18
  ## Model description
19
 
@@ -38,20 +38,28 @@ The following hyperparameters were used during training:
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
- - num_epochs: 3.0
42
  - mixed_precision_training: Native AMP
43
 
44
  ### Training results
45
 
46
  | Training Loss | Epoch | Step | Validation Loss |
47
  |:-------------:|:-----:|:----:|:---------------:|
48
- | 3.0188 | 1.0 | 16 | 1.9737 |
49
- | 1.9037 | 2.0 | 32 | 1.8202 |
50
- | 1.7981 | 3.0 | 48 | 1.5981 |
 
 
 
 
 
 
 
51
 
52
 
53
  ### Framework versions
54
 
55
- - Transformers 4.21.3
56
  - Pytorch 1.12.1+cu113
 
57
  - Tokenizers 0.12.1
 
13
 
14
  This model is a fine-tuned version of [klue/bert-base](https://huggingface.co/klue/bert-base) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 1.3297
17
 
18
  ## Model description
19
 
 
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - num_epochs: 10
42
  - mixed_precision_training: Native AMP
43
 
44
  ### Training results
45
 
46
  | Training Loss | Epoch | Step | Validation Loss |
47
  |:-------------:|:-----:|:----:|:---------------:|
48
+ | 2.4206 | 1.0 | 32 | 1.6348 |
49
+ | 1.6784 | 2.0 | 64 | 1.5117 |
50
+ | 1.5398 | 3.0 | 96 | 1.4957 |
51
+ | 1.4563 | 4.0 | 128 | 1.4255 |
52
+ | 1.4111 | 5.0 | 160 | 1.4090 |
53
+ | 1.3917 | 6.0 | 192 | 1.3566 |
54
+ | 1.3816 | 7.0 | 224 | 1.3316 |
55
+ | 1.3514 | 8.0 | 256 | 1.3519 |
56
+ | 1.3412 | 9.0 | 288 | 1.2739 |
57
+ | 1.3334 | 10.0 | 320 | 1.3000 |
58
 
59
 
60
  ### Framework versions
61
 
62
+ - Transformers 4.22.1
63
  - Pytorch 1.12.1+cu113
64
+ - Datasets 2.4.0
65
  - Tokenizers 0.12.1