End of training
Browse files- README.md +16 -16
- adapter_model.bin +1 -1
README.md
CHANGED
@@ -92,7 +92,7 @@ special_tokens:
|
|
92 |
|
93 |
This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T) on the None dataset.
|
94 |
It achieves the following results on the evaluation set:
|
95 |
-
- Loss: 1.
|
96 |
|
97 |
## Model description
|
98 |
|
@@ -127,22 +127,22 @@ The following hyperparameters were used during training:
|
|
127 |
| Training Loss | Epoch | Step | Validation Loss |
|
128 |
|:-------------:|:------:|:----:|:---------------:|
|
129 |
| 1.4615 | 0.08 | 1 | 1.4899 |
|
130 |
-
| 1.
|
131 |
-
| 1.
|
132 |
-
| 1.
|
133 |
-
| 1.
|
134 |
-
| 1.
|
135 |
-
| 1.
|
136 |
-
| 1.
|
137 |
-
| 1.
|
138 |
-
| 1.
|
139 |
-
| 1.1524 | 2.32 | 30 | 1.
|
140 |
| 1.1944 | 2.56 | 33 | 1.2198 |
|
141 |
-
| 1.
|
142 |
-
| 1.
|
143 |
-
| 1.
|
144 |
-
| 1.
|
145 |
-
| 1.
|
146 |
|
147 |
|
148 |
### Framework versions
|
|
|
92 |
|
93 |
This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T) on the None dataset.
|
94 |
It achieves the following results on the evaluation set:
|
95 |
+
- Loss: 1.2124
|
96 |
|
97 |
## Model description
|
98 |
|
|
|
127 |
| Training Loss | Epoch | Step | Validation Loss |
|
128 |
|:-------------:|:------:|:----:|:---------------:|
|
129 |
| 1.4615 | 0.08 | 1 | 1.4899 |
|
130 |
+
| 1.3853 | 0.24 | 3 | 1.4862 |
|
131 |
+
| 1.3665 | 0.48 | 6 | 1.4396 |
|
132 |
+
| 1.2677 | 0.72 | 9 | 1.3393 |
|
133 |
+
| 1.2261 | 0.96 | 12 | 1.2967 |
|
134 |
+
| 1.2513 | 1.16 | 15 | 1.2810 |
|
135 |
+
| 1.2266 | 1.4 | 18 | 1.2557 |
|
136 |
+
| 1.1349 | 1.6400 | 21 | 1.2344 |
|
137 |
+
| 1.2688 | 1.88 | 24 | 1.2275 |
|
138 |
+
| 1.1477 | 2.08 | 27 | 1.2242 |
|
139 |
+
| 1.1524 | 2.32 | 30 | 1.2217 |
|
140 |
| 1.1944 | 2.56 | 33 | 1.2198 |
|
141 |
+
| 1.1123 | 2.8 | 36 | 1.2134 |
|
142 |
+
| 1.1523 | 3.04 | 39 | 1.2126 |
|
143 |
+
| 1.1897 | 3.24 | 42 | 1.2102 |
|
144 |
+
| 1.1006 | 3.48 | 45 | 1.2143 |
|
145 |
+
| 1.1894 | 3.7200 | 48 | 1.2124 |
|
146 |
|
147 |
|
148 |
### Framework versions
|
adapter_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 101036698
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c269c21d37e10c7fe8b593a458592bf99a69b465f96d299da24b00b3e8ee265d
|
3 |
size 101036698
|