End of training

README.md

@@ -95,7 +95,7 @@ xformers_attention: null
 
 This model is a fine-tuned version of [HuggingFaceM4/tiny-random-LlamaForCausalLM](https://huggingface.co/HuggingFaceM4/tiny-random-LlamaForCausalLM) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 10.3767
+- Loss: 10.3766
 
 ## Model description
 
@@ -133,7 +133,7 @@ The following hyperparameters were used during training:
 | 10.3806       | 0.0055 | 1    | 10.3768         |
 | 10.3782       | 0.0164 | 3    | 10.3768         |
 | 10.3829       | 0.0329 | 6    | 10.3768         |
-| 10.383        | 0.0493 | 9    | 10.3767         |
+| 10.3829       | 0.0493 | 9    | 10.3766         |
 
 
 ### Framework versions

adapter_config.json

@@ -21,12 +21,12 @@
   "revision": null,
   "target_modules": [
     "k_proj",
-    "gate_proj",
-    "down_proj",
-    "v_proj",
     "up_proj",
+    "gate_proj",
     "q_proj",
-    "o_proj"
+    "v_proj",
+    "o_proj",
+    "down_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3961f66da47ffb0783514971a636411adc860d519f59e6ffad4a53982444db1d
+oid sha256:0ae2ac27f7c2ea80e5a0d9004f5f3aab38ada81483a3319d4115ba21ccdb31ac
 size 33666

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c20330890176aec2153715f7803e60009e132390f930c1102693f1f5eeb06d6d
+oid sha256:d95098d63373bb83b8f55cc9f33fe4602b0d75bf930545ec1e8aae3b194d886a
 size 27024

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6821faa402816dc870cc3e028c580686f878eb32e4f18e75741a9277f08b1912
+oid sha256:f9e7b71b1ce7772469f28700f63d8a31b72c32cf43950aa8f0fc2a8925ca4941
 size 6776