ebobo
/

d8488ce0-205d-46e6-a1bd-3909c48afbeb

Generated from Trainer

4-bit precision

Model card Files Files and versions Community

ebobo commited on Dec 3, 2024

Commit

e85a9c4

·

verified ·

1 Parent(s): 9ac6848

End of training

Files changed (2) hide show

README.md +4 -4
adapter_model.bin +1 -1

README.md CHANGED Viewed

@@ -104,7 +104,7 @@ xformers_attention: null
 This model is a fine-tuned version of [katuni4ka/tiny-random-falcon-40b](https://huggingface.co/katuni4ka/tiny-random-falcon-40b) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 10.9393
 ## Model description
@@ -139,9 +139,9 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 44.5542       | 0.0017 | 1    | 11.1049         |
-| 44.3937       | 0.0050 | 3    | 11.0901         |
-| 44.2448       | 0.0101 | 6    | 11.0407         |
-| 44.1542       | 0.0151 | 9    | 10.9393         |
 ### Framework versions

 This model is a fine-tuned version of [katuni4ka/tiny-random-falcon-40b](https://huggingface.co/katuni4ka/tiny-random-falcon-40b) on the None dataset.
 It achieves the following results on the evaluation set:
+- Loss: 10.9531
 ## Model description
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 44.5542       | 0.0017 | 1    | 11.1049         |
+| 44.3937       | 0.0050 | 3    | 11.0917         |
+| 44.2604       | 0.0101 | 6    | 11.0471         |
+| 44.1104       | 0.0151 | 9    | 10.9531         |
 ### Framework versions

adapter_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:54e6317dd0a4fddffda93509afe47a32553cfa3f70baced166284ea6d00d75ae
 size 252062

 version https://git-lfs.github.com/spec/v1
+oid sha256:21b908463ab93c041db6bc1cc4a81cb12f92652e8629ce7e2fcdcaa0ad14138d
 size 252062