avidoavid commited on
Commit
26e4c2b
·
1 Parent(s): 3c31104

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -12
README.md CHANGED
@@ -5,7 +5,6 @@ tags:
5
  model-index:
6
  - name: RWKV-1b5-finetuned-overfit
7
  results: []
8
- library_name: peft
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -15,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [RWKV/rwkv-raven-1b5](https://huggingface.co/RWKV/rwkv-raven-1b5) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 73.0113
19
 
20
  ## Model description
21
 
@@ -46,20 +45,18 @@ The following hyperparameters were used during training:
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 1.6836 | 1.0 | 1 | 1.4176 |
50
- | 1.5256 | 2.0 | 2 | 2.0759 |
51
- | 0.7385 | 3.0 | 3 | 10.6531 |
52
- | 0.2917 | 4.0 | 4 | 40.1025 |
53
- | 0.0833 | 5.0 | 5 | 73.3784 |
54
- | 0.0215 | 6.0 | 6 | 76.3718 |
55
- | 0.0107 | 7.0 | 7 | 73.5778 |
56
- | 0.0063 | 8.0 | 8 | 73.0113 |
57
 
58
 
59
  ### Framework versions
60
 
61
- - PEFT 0.4.0
62
- - PEFT 0.4.0
63
  - Transformers 4.31.0
64
  - Pytorch 2.0.1+cu117
65
  - Datasets 2.13.1
 
5
  model-index:
6
  - name: RWKV-1b5-finetuned-overfit
7
  results: []
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
14
 
15
  This model is a fine-tuned version of [RWKV/rwkv-raven-1b5](https://huggingface.co/RWKV/rwkv-raven-1b5) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 67.8669
18
 
19
  ## Model description
20
 
 
45
 
46
  | Training Loss | Epoch | Step | Validation Loss |
47
  |:-------------:|:-----:|:----:|:---------------:|
48
+ | 1.6836 | 1.0 | 1 | 1.4181 |
49
+ | 1.5358 | 2.0 | 2 | 1.4378 |
50
+ | 0.7673 | 3.0 | 3 | 7.2988 |
51
+ | 0.3153 | 4.0 | 4 | 28.9362 |
52
+ | 0.0964 | 5.0 | 5 | 60.8725 |
53
+ | 0.0242 | 6.0 | 6 | 68.6885 |
54
+ | 0.0119 | 7.0 | 7 | 67.8234 |
55
+ | 0.0088 | 8.0 | 8 | 67.8669 |
56
 
57
 
58
  ### Framework versions
59
 
 
 
60
  - Transformers 4.31.0
61
  - Pytorch 2.0.1+cu117
62
  - Datasets 2.13.1