Training in progress, step 7000

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0513c7a1b35399e6652884442e4f940cffb0c3bc1af3aeca10a7e91208aa67e3
+oid sha256:21e00f1fbdf5235912873c9780b97ccf2dd105a60845bacbc673aa73cbb3141e
 size 1262817457

wandb/run-20220129_131141-h6nhqm30/files/output.log

@@ -6884,3 +6884,531 @@ Deleting older checkpoint [checkpoint-4500] due to args.save_total_limit
 Configuration saved in ./checkpoint-6500/config.json
 Model weights saved in ./checkpoint-6500/pytorch_model.bin
 Configuration saved in ./checkpoint-6500/preprocessor_config.json
+Configuration saved in ./preprocessor_config.json
+Deleting older checkpoint [checkpoint-5000] due to args.save_total_limit
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 31%|███████████████████████████████████████████████▊                                                                                                            | 6600/21520 [5:27:24<8:15:18,  1.99s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 31%|████████████████████████████████████████████████▌                                                                                                           | 6700/21520 [5:31:47<8:03:10,  1.96s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 32%|█████████████████████████████████████████████████▎                                                                                                          | 6799/21520 [5:36:08<7:56:35,  1.94s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 32%|██████████████████████████████████████████████████                                                                                                          | 6900/21520 [5:40:33<8:02:43,  1.98s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 33%|██████████████████████████████████████████████████▋                                                                                                         | 6999/21520 [5:44:52<7:54:39,  1.96s/it]
+ 33%|██████████████████████████████████████████████████▋                                                                                                         | 7000/21520 [5:44:54<7:55:25,  1.96s/it]The following columns in the evaluation set  don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length.
+***** Running Evaluation *****
+  Num examples = 1839
+  Batch size = 64
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:54<00:00,  1.80s/it]
+
+Configuration saved in ./checkpoint-7000/config.json
+Model weights saved in ./checkpoint-7000/pytorch_model.bin
+Configuration saved in ./checkpoint-7000/preprocessor_config.json

wandb/run-20220129_131141-h6nhqm30/run-h6nhqm30.wandb

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:34f2bb24662d3fcb0bb0eff6e4d9ec40beceb97465ce839d824e1956703ac4f1
-size 46505748
+oid sha256:5e966d830fccb0b02068e7ae0ce5ee22544c7244d3a83aa7a7fc679a0fdd1ab0
+size 50397433