adhammai commited on
Commit
c6c4300
·
verified ·
1 Parent(s): 33c1383

adhammai/distilbert-base-uncased-lora-text-classification-depression

Browse files
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.9411
22
- - Accuracy: {'accuracy': 0.891}
23
 
24
  ## Model description
25
 
@@ -50,16 +50,16 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:-------------------:|
53
- | No log | 1.0 | 250 | 0.5018 | {'accuracy': 0.857} |
54
- | 0.4415 | 2.0 | 500 | 0.4826 | {'accuracy': 0.878} |
55
- | 0.4415 | 3.0 | 750 | 0.5684 | {'accuracy': 0.884} |
56
- | 0.2044 | 4.0 | 1000 | 0.7824 | {'accuracy': 0.882} |
57
- | 0.2044 | 5.0 | 1250 | 0.8871 | {'accuracy': 0.888} |
58
- | 0.0831 | 6.0 | 1500 | 0.8291 | {'accuracy': 0.889} |
59
- | 0.0831 | 7.0 | 1750 | 0.9144 | {'accuracy': 0.887} |
60
- | 0.0254 | 8.0 | 2000 | 0.9386 | {'accuracy': 0.885} |
61
- | 0.0254 | 9.0 | 2250 | 0.9397 | {'accuracy': 0.898} |
62
- | 0.0093 | 10.0 | 2500 | 0.9411 | {'accuracy': 0.891} |
63
 
64
 
65
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.0000
22
+ - Accuracy: {'accuracy': 1.0}
23
 
24
  ## Model description
25
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:-------------------:|
53
+ | No log | 1.0 | 250 | 0.2543 | {'accuracy': 0.92} |
54
+ | 0.3753 | 2.0 | 500 | 0.1290 | {'accuracy': 0.965} |
55
+ | 0.3753 | 3.0 | 750 | 0.0939 | {'accuracy': 0.965} |
56
+ | 0.1512 | 4.0 | 1000 | 0.0277 | {'accuracy': 0.995} |
57
+ | 0.1512 | 5.0 | 1250 | 0.0014 | {'accuracy': 1.0} |
58
+ | 0.047 | 6.0 | 1500 | 0.0002 | {'accuracy': 1.0} |
59
+ | 0.047 | 7.0 | 1750 | 0.0001 | {'accuracy': 1.0} |
60
+ | 0.0041 | 8.0 | 2000 | 0.0001 | {'accuracy': 1.0} |
61
+ | 0.0041 | 9.0 | 2250 | 0.0000 | {'accuracy': 1.0} |
62
+ | 0.0031 | 10.0 | 2500 | 0.0000 | {'accuracy': 1.0} |
63
 
64
 
65
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:150a3d55e96ab434efcd379076b0440f28789cabfd30abb9e3a6d75e24e1d133
3
  size 2518104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b6eadc37e797dcb2208a488cb1984f9db68484cc2b9535f94f7916d21520c18
3
  size 2518104
runs/Nov21_05-59-32_f78e5d527627/events.out.tfevents.1732168780.f78e5d527627.317.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6d35687c3d77ce2a40cadb63bf964ca8f5cb7ac7384f22f05ef4280b4dfda37
3
+ size 9272
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9fbed1938e58541ed487513cf23beda9b03a721b6aaf4b82168fc4cc0383bade
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb61cac037729cc867c5dcc12c50ead9ec194fcd914ce961bb966064243e443b
3
  size 5368