Training in progress, step 4500

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b18a05fe3e872cd4dda6f2ab42d9fe2011ebfa27c9fd51548851eb83eeedbd84
+oid sha256:555c567d63047da5c9226f4c383755306d075b9c037698e784e3f654f575b531
 size 1262817457

wandb/run-20220129_131141-h6nhqm30/files/output.log

@@ -4233,3 +4233,533 @@ Deleting older checkpoint [checkpoint-2000] due to args.save_total_limit
 Configuration saved in ./checkpoint-4000/config.json
 Model weights saved in ./checkpoint-4000/pytorch_model.bin
 Configuration saved in ./checkpoint-4000/preprocessor_config.json
+Configuration saved in ./preprocessor_config.json
+Deleting older checkpoint [checkpoint-2500] due to args.save_total_limit
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 19%|█████████████████████████████▋                                                                                                                              | 4100/21520 [3:22:57<7:45:28,  1.60s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 20%|██████████████████████████████▍                                                                                                                             | 4199/21520 [3:27:18<7:58:53,  1.66s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 20%|███████████████████████████████▏                                                                                                                            | 4299/21520 [3:31:42<8:00:50,  1.68s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 20%|███████████████████████████████▉                                                                                                                            | 4400/21520 [3:36:10<9:34:20,  2.01s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 21%|████████████████████████████████▌                                                                                                                           | 4500/21520 [3:40:32<9:18:48,  1.97s/it]The following columns in the evaluation set  don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length.
+***** Running Evaluation *****
+  Num examples = 1839
+  Batch size = 64
+{'loss': 1.1671, 'learning_rate': 5.953496503496503e-05, 'epoch': 1.05}
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:56<00:00,  1.81s/it]
+
+Configuration saved in ./checkpoint-4500/config.json
+Model weights saved in ./checkpoint-4500/pytorch_model.bin
+Configuration saved in ./checkpoint-4500/preprocessor_config.json

wandb/run-20220129_131141-h6nhqm30/run-h6nhqm30.wandb

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f9739eb30c365b55a391ae6ef9ae79354e19dafe75345239ba3cc9ab6c8ad81e
-size 27510055
+oid sha256:b91b547c6384170ef589da7269c4676c95497c03a83fe8ae18d858a1ce4be487
+size 31219824