End of training

README.md

@@ -105,7 +105,7 @@ xformers_attention: true
 
 This model is a fine-tuned version of [heegyu/WizardVicuna-open-llama-3b-v2](https://huggingface.co/heegyu/WizardVicuna-open-llama-3b-v2) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3602
+- Loss: 0.3521
 
 ## Model description
 
@@ -143,8 +143,8 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 13.139        | 0.0118 | 1    | 12.2341         |
-| 0.4112        | 0.2954 | 25   | 0.3536          |
-| 0.4166        | 0.5908 | 50   | 0.3602          |
+| 0.413         | 0.2954 | 25   | 0.3542          |
+| 0.3879        | 0.5908 | 50   | 0.3521          |
 
 
 ### Framework versions

adapter_config.json

@@ -20,13 +20,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
+    "q_proj",
     "down_proj",
+    "k_proj",
+    "gate_proj",
     "v_proj",
     "o_proj",
-    "gate_proj",
-    "up_proj",
-    "q_proj",
-    "k_proj"
+    "up_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8b97bcbd934315a26889b726bf3941ed8bcddbc8e4407c58b82de513baf1dc0f
+oid sha256:b9e3fe297b1b3f31e7e9caa0d729a2192ea185e70f6a422c7744af09489b1fdd
 size 203538938

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aa78fa16cfb28e92e8a7f2547ea4ebe3d921bbd4a60eb0b03f9797c63d10d47f
+oid sha256:3aa9737de406a4a2d98ec1a16f355b324ef0a923a8b26d9035c0f8a18a7ca71e
 size 203456160

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:55d740791941f758082368cfedd2df9898fb71500018e405b89f3f308e0b9018
+oid sha256:5a0d3712789c7a4d25180c5c9c512c419bafb08bc397e6938aa00de0fd6b3acb
 size 6776