Hugging Face's logo

izh97
/
zephyr-beta-climate-change-assistant

TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
izh97 commited on
Commit
5400bad
·
verified ·
1 Parent(s): 3556077

End of training

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -35,12 +35,12 @@ More information needed
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 0.0002
38
- - train_batch_size: 16
39
  - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: cosine
43
- - training_steps: 728
44
  - mixed_precision_training: Native AMP
45
 
46
  ### Training results
@@ -51,5 +51,5 @@ The following hyperparameters were used during training:
51
 
52
  - Transformers 4.35.2
53
  - Pytorch 2.1.0+cu121
54
- - Datasets 2.16.1
55
  - Tokenizers 0.15.1
 
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 0.0002
38
+ - train_batch_size: 8
39
  - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: cosine
43
+ - training_steps: 1545
44
  - mixed_precision_training: Native AMP
45
 
46
  ### Training results
 
51
 
52
  - Transformers 4.35.2
53
  - Pytorch 2.1.0+cu121
54
+ - Datasets 2.17.0
55
  - Tokenizers 0.15.1