george2704/LLM2

README.md

@@ -35,7 +35,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0002
+- learning_rate: 0.02
 - train_batch_size: 4
 - eval_batch_size: 4
 - seed: 42
@@ -44,7 +44,7 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 2
-- num_epochs: 20
+- num_epochs: 27
 
 ### Training results
 
@@ -68,7 +68,13 @@ The following hyperparameters were used during training:
 | 1.956         | 16.0  | 104  | 2.1056          |
 | 2.2829        | 16.92 | 110  | 2.1056          |
 | 1.9559        | 18.0  | 117  | 2.1056          |
-| 2.1111        | 18.46 | 120  | 2.1056          |
+| 2.2821        | 18.92 | 123  | 2.1056          |
+| 1.9556        | 20.0  | 130  | 2.1056          |
+| 2.2817        | 20.92 | 136  | 2.1056          |
+| 1.9559        | 22.0  | 143  | 2.1056          |
+| 2.2816        | 22.92 | 149  | 2.1056          |
+| 1.9561        | 24.0  | 156  | 2.1056          |
+| 2.1055        | 24.92 | 162  | 2.1056          |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d180ba744d2129f30ab8a5c2f07ba746641d4ac03892dceb82e8b50c70f1e18d
+oid sha256:92273986908c39337ded6e0d61bfd6c2b13a299b52d83f67554b6359cf3d65a6
 size 8397056

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:83b84af81d5dd9e0fd4dda48f94ef490be6047bab7bd5ab0f93cd4ff8855f383
+oid sha256:0c0cba6170622587c4ee832c5b27389c1d2197492b22d33349b102940fe7a722
 size 4856