muhammadravi251001 commited on
Commit
d70f7df
1 Parent(s): be7b2f9

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -23
README.md CHANGED
@@ -16,9 +16,9 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.5296
20
- - Exact Match: 48.5657
21
- - F1: 64.5763
22
 
23
  ## Model description
24
 
@@ -38,10 +38,10 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 1e-05
41
- - train_batch_size: 4
42
- - eval_batch_size: 4
43
  - seed: 42
44
- - gradient_accumulation_steps: 32
45
  - total_train_batch_size: 128
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
@@ -51,27 +51,29 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Exact Match | F1 |
53
  |:-------------:|:-----:|:----:|:---------------:|:-----------:|:-------:|
54
- | 2.0185 | 0.5 | 463 | 1.8556 | 39.4128 | 54.9486 |
55
- | 1.8481 | 1.0 | 926 | 1.6794 | 43.1985 | 58.7955 |
56
- | 1.6413 | 1.5 | 1389 | 1.6081 | 45.2091 | 61.6638 |
57
- | 1.611 | 2.0 | 1852 | 1.5670 | 45.9241 | 62.7351 |
58
- | 1.4929 | 2.5 | 2315 | 1.5571 | 46.5298 | 63.3878 |
59
- | 1.5119 | 3.0 | 2778 | 1.5222 | 47.2785 | 64.2211 |
60
- | 1.3955 | 3.5 | 3241 | 1.5285 | 47.6235 | 64.2546 |
61
- | 1.3643 | 4.0 | 3704 | 1.5133 | 47.9179 | 64.1430 |
62
- | 1.3277 | 4.5 | 4167 | 1.5223 | 47.8927 | 64.3061 |
63
- | 1.3058 | 5.0 | 4630 | 1.5126 | 48.6498 | 64.5757 |
64
- | 1.2847 | 5.5 | 5093 | 1.5154 | 48.4479 | 64.5972 |
65
- | 1.1984 | 6.0 | 5556 | 1.5289 | 48.4815 | 64.4181 |
66
- | 1.1817 | 6.5 | 6019 | 1.5277 | 48.4395 | 64.7923 |
67
- | 1.2203 | 7.0 | 6482 | 1.5134 | 48.5404 | 64.5935 |
68
- | 1.1492 | 7.5 | 6945 | 1.5412 | 48.6330 | 64.6696 |
69
- | 1.1567 | 8.0 | 7408 | 1.5296 | 48.5657 | 64.5763 |
 
 
70
 
71
 
72
  ### Framework versions
73
 
74
- - Transformers 4.27.4
75
  - Pytorch 1.13.1+cu117
76
  - Datasets 2.2.0
77
  - Tokenizers 0.13.2
 
16
 
17
  This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.5061
20
+ - Exact Match: 48.9695
21
+ - F1: 65.3139
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 1e-05
41
+ - train_batch_size: 2
42
+ - eval_batch_size: 2
43
  - seed: 42
44
+ - gradient_accumulation_steps: 64
45
  - total_train_batch_size: 128
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Exact Match | F1 |
53
  |:-------------:|:-----:|:----:|:---------------:|:-----------:|:-------:|
54
+ | 2.0131 | 0.5 | 463 | 1.8398 | 39.7325 | 55.0682 |
55
+ | 1.8343 | 1.0 | 926 | 1.6799 | 42.9545 | 58.8261 |
56
+ | 1.6407 | 1.5 | 1389 | 1.6097 | 45.1502 | 61.1235 |
57
+ | 1.6021 | 2.0 | 1852 | 1.5634 | 46.0167 | 62.5172 |
58
+ | 1.4841 | 2.5 | 2315 | 1.5438 | 46.5971 | 63.4037 |
59
+ | 1.5117 | 3.0 | 2778 | 1.5080 | 47.2028 | 64.1405 |
60
+ | 1.3752 | 3.5 | 3241 | 1.5149 | 47.6487 | 64.3195 |
61
+ | 1.3491 | 4.0 | 3704 | 1.4956 | 47.8927 | 64.4993 |
62
+ | 1.3068 | 4.5 | 4167 | 1.4951 | 48.0861 | 64.7876 |
63
+ | 1.2916 | 5.0 | 4630 | 1.4895 | 48.3722 | 64.9676 |
64
+ | 1.2593 | 5.5 | 5093 | 1.4954 | 48.5909 | 65.1206 |
65
+ | 1.2032 | 6.0 | 5556 | 1.4891 | 48.5236 | 65.0831 |
66
+ | 1.1826 | 6.5 | 6019 | 1.4944 | 48.6077 | 65.0162 |
67
+ | 1.2159 | 7.0 | 6482 | 1.4870 | 48.9526 | 65.1941 |
68
+ | 1.1503 | 7.5 | 6945 | 1.5074 | 48.8180 | 65.3672 |
69
+ | 1.1683 | 8.0 | 7408 | 1.4928 | 48.7760 | 65.2063 |
70
+ | 1.0898 | 8.5 | 7871 | 1.5141 | 48.7844 | 65.0996 |
71
+ | 1.1217 | 9.0 | 8334 | 1.5061 | 48.9695 | 65.3139 |
72
 
73
 
74
  ### Framework versions
75
 
76
+ - Transformers 4.26.1
77
  - Pytorch 1.13.1+cu117
78
  - Datasets 2.2.0
79
  - Tokenizers 0.13.2