SweetZiyi/MLMA_Lab8_Task2

README.md

@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [microsoft/biogpt](https://huggingface.co/microsoft/biogpt) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2658
-- Precision: 0.0656
-- Recall: 0.0323
-- F1: 0.0433
-- Accuracy: 0.9309
+- Loss: 0.1628
+- Precision: 0.5127
+- Recall: 0.5849
+- F1: 0.5464
+- Accuracy: 0.9564
 
 ## Model description
 
@@ -55,9 +55,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| 0.3448        | 1.0   | 679  | 0.2682          | 0.0046    | 0.0013 | 0.0020 | 0.9289   |
-| 0.267         | 2.0   | 1358 | 0.2548          | 0.0347    | 0.0142 | 0.0201 | 0.9309   |
-| 0.2122        | 3.0   | 2037 | 0.2658          | 0.0656    | 0.0323 | 0.0433 | 0.9309   |
+| 0.3056        | 1.0   | 680  | 0.1724          | 0.4135    | 0.5029 | 0.4538 | 0.9478   |
+| 0.1401        | 2.0   | 1360 | 0.1542          | 0.4719    | 0.5521 | 0.5089 | 0.9538   |
+| 0.0738        | 3.0   | 2040 | 0.1628          | 0.5127    | 0.5849 | 0.5464 | 0.9564   |
 
 
 ### Framework versions

config.json

@@ -13,16 +13,16 @@
   "hidden_act": "gelu",
   "hidden_dropout_prob": 0.1,
   "id2label": {
-    "0": "O",
-    "1": "B-Disease",
-    "2": "I-Disease"
+    "0": "LABEL_0",
+    "1": "LABEL_1",
+    "2": "LABEL_2"
   },
   "initializer_range": 0.02,
   "intermediate_size": 4096,
   "label2id": {
-    "B-Disease": 1,
-    "I-Disease": 2,
-    "O": 0
+    "LABEL_0": 0,
+    "LABEL_1": 1,
+    "LABEL_2": 2
   },
   "layer_norm_eps": 1e-12,
   "layer_norm_epsilon": 1e-05,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3e1a11cc368ab17a00ee170e14c8ca913c53ac625ec1d2e36193f31b3e0290a4
+oid sha256:b1e0bba613e6348d2bbc525857ba085b6fe4007fba772774fc45e427f754b8cd
 size 1387087524

runs/Apr12_14-29-26_fb847da3b673/events.out.tfevents.1712932167.fb847da3b673.338.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:762547955c3f8029621fe1ba3cb49a8f92937df42af7708c303be42cbccb9392
+size 5275

runs/Apr12_14-40-22_fb847da3b673/events.out.tfevents.1712932823.fb847da3b673.338.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e29333536c0bb61dc8cadefe70dc1483d0b8853421f163017392d454d182d94b
+size 5747

runs/Apr12_15-09-11_fb847da3b673/events.out.tfevents.1712934552.fb847da3b673.338.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:776b4e97addad3f04dcee8ffc448506ee78d8cbfbc0dfd8259d2cdd8756be2ce
+size 7678

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:10b5be5cd882f897814d72eeaa1fad273bedd0e6efbe898835772e8009f183a8
-size 4856
+oid sha256:676d5cec1518f13ed33d503e0b07e80b0c164ec8f6c49ab2cea923cb5c4ffcea
+size 4920