Saving weights and log at step 880000
Browse files- README.md +1 -1
- flax_model.msgpack +1 -1
- opt_state.msgpack +1 -1
- pytorch_model.bin +1 -1
- runs/events.out.tfevents.1641055391.t1v-n-f9cfcc28-w-0.112189.0.v2 +2 -2
- training_state.json +1 -1
README.md
CHANGED
@@ -27,7 +27,7 @@ Tokenizer:
|
|
27 |
Training details:
|
28 |
|
29 |
* Training started on step 360K (bs 16) ppl 21 of earlier model trained with Adam optimizer.
|
30 |
-
* Training at step
|
31 |
* Block size: 512
|
32 |
* Optimizer: adafactor
|
33 |
* Learning rate: 3.3e-5
|
|
|
27 |
Training details:
|
28 |
|
29 |
* Training started on step 360K (bs 16) ppl 21 of earlier model trained with Adam optimizer.
|
30 |
+
* Training at step 880K of 2M (38%) ppl 15,3
|
31 |
* Block size: 512
|
32 |
* Optimizer: adafactor
|
33 |
* Learning rate: 3.3e-5
|
flax_model.msgpack
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3096134690
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cfc08d5c4120eff8f546db9675affda9bdaba5b8dfe2e81f9257a499e1b3b53c
|
3 |
size 3096134690
|
opt_state.msgpack
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5611008
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:384b781970c22b5c572a23c3bf0f384c614dd13a0815f125b896de9735228377
|
3 |
size 5611008
|
pytorch_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3134045897
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6c85a006e388f0880cef392c8d434653cc69d3377ac9f44f6fa8ca6ba6bb2799
|
3 |
size 3134045897
|
runs/events.out.tfevents.1641055391.t1v-n-f9cfcc28-w-0.112189.0.v2
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8e01abfe0cb320dd193e448be51c5c1c7473b01caef47ea4246cf07d8b5e9f24
|
3 |
+
size 131559285
|
training_state.json
CHANGED
@@ -1 +1 @@
|
|
1 |
-
{"step":
|
|
|
1 |
+
{"step": 880001}
|