DJQmUKV
feat: add models
01ec1bb
raw
history blame
18 kB
2023-05-07 02:20:31,428 arona-test INFO {'train': {'log_interval': 200, 'seed': 1234, 'epochs': 20000, 'learning_rate': 0.0001, 'betas': [0.8, 0.99], 'eps': 1e-09, 'batch_size': 4, 'fp16_run': True, 'lr_decay': 0.999875, 'segment_size': 12800, 'init_lr_ratio': 1, 'warmup_epochs': 0, 'c_mel': 45, 'c_kl': 1.0}, 'data': {'max_wav_value': 32768.0, 'sampling_rate': 40000, 'filter_length': 2048, 'hop_length': 400, 'win_length': 2048, 'n_mel_channels': 125, 'mel_fmin': 0.0, 'mel_fmax': None, 'training_files': './logs/arona-test/filelist.txt'}, 'model': {'inter_channels': 192, 'hidden_channels': 192, 'filter_channels': 768, 'n_heads': 2, 'n_layers': 6, 'kernel_size': 3, 'p_dropout': 0, 'resblock': '1', 'resblock_kernel_sizes': [3, 7, 11], 'resblock_dilation_sizes': [[1, 3, 5], [1, 3, 5], [1, 3, 5]], 'upsample_rates': [10, 10, 2, 2], 'upsample_initial_channel': 512, 'upsample_kernel_sizes': [16, 16, 4, 4], 'use_spectral_norm': False, 'gin_channels': 256, 'spk_embed_dim': 109}, 'model_dir': './logs/arona-test', 'experiment_dir': './logs/arona-test', 'save_every_epoch': 50, 'name': 'arona-test', 'total_epoch': 200, 'pretrainG': 'pretrained/f0G40k.pth', 'pretrainD': 'pretrained/f0D40k.pth', 'gpus': '0', 'sample_rate': '40k', 'if_f0': 1, 'if_latest': 1, 'if_cache_data_in_gpu': 0}
2023-05-07 02:20:31,429 arona-test WARNING /root/Retrieval-based-Voice-Conversion-WebUI/train is not a git repository, therefore hash value comparison will be ignored.
2023-05-07 02:20:33,052 arona-test INFO loaded pretrained pretrained/f0G40k.pth pretrained/f0D40k.pth
2023-05-07 02:20:39,773 arona-test INFO Train Epoch: 1 [0%]
2023-05-07 02:20:39,773 arona-test INFO [0, 0.0001]
2023-05-07 02:20:39,773 arona-test INFO loss_disc=3.343, loss_gen=1.793, loss_fm=15.342,loss_mel=38.129, loss_kl=5.000
2023-05-07 02:20:46,895 arona-test INFO ====> Epoch: 1
2023-05-07 02:20:52,001 arona-test INFO ====> Epoch: 2
2023-05-07 02:20:56,708 arona-test INFO ====> Epoch: 3
2023-05-07 02:21:01,628 arona-test INFO ====> Epoch: 4
2023-05-07 02:21:06,172 arona-test INFO ====> Epoch: 5
2023-05-07 02:21:10,792 arona-test INFO ====> Epoch: 6
2023-05-07 02:21:15,375 arona-test INFO ====> Epoch: 7
2023-05-07 02:21:20,214 arona-test INFO ====> Epoch: 8
2023-05-07 02:21:24,724 arona-test INFO ====> Epoch: 9
2023-05-07 02:21:29,182 arona-test INFO ====> Epoch: 10
2023-05-07 02:21:33,642 arona-test INFO ====> Epoch: 11
2023-05-07 02:21:38,382 arona-test INFO ====> Epoch: 12
2023-05-07 02:21:40,979 arona-test INFO Train Epoch: 13 [50%]
2023-05-07 02:21:40,980 arona-test INFO [200, 9.98501030820433e-05]
2023-05-07 02:21:40,980 arona-test INFO loss_disc=2.737, loss_gen=4.012, loss_fm=15.965,loss_mel=33.385, loss_kl=1.589
2023-05-07 02:21:43,420 arona-test INFO ====> Epoch: 13
2023-05-07 02:21:48,011 arona-test INFO ====> Epoch: 14
2023-05-07 02:21:52,586 arona-test INFO ====> Epoch: 15
2023-05-07 02:21:57,434 arona-test INFO ====> Epoch: 16
2023-05-07 02:22:02,018 arona-test INFO ====> Epoch: 17
2023-05-07 02:22:06,536 arona-test INFO ====> Epoch: 18
2023-05-07 02:22:11,104 arona-test INFO ====> Epoch: 19
2023-05-07 02:22:15,678 arona-test INFO ====> Epoch: 20
2023-05-07 02:22:20,197 arona-test INFO ====> Epoch: 21
2023-05-07 02:22:24,665 arona-test INFO ====> Epoch: 22
2023-05-07 02:22:29,215 arona-test INFO ====> Epoch: 23
2023-05-07 02:22:33,789 arona-test INFO ====> Epoch: 24
2023-05-07 02:22:38,384 arona-test INFO ====> Epoch: 25
2023-05-07 02:22:38,765 arona-test INFO Train Epoch: 26 [0%]
2023-05-07 02:22:38,765 arona-test INFO [400, 9.968796830108985e-05]
2023-05-07 02:22:38,765 arona-test INFO loss_disc=2.857, loss_gen=3.282, loss_fm=15.372,loss_mel=26.253, loss_kl=1.317
2023-05-07 02:22:43,519 arona-test INFO ====> Epoch: 26
2023-05-07 02:22:48,184 arona-test INFO ====> Epoch: 27
2023-05-07 02:22:52,694 arona-test INFO ====> Epoch: 28
2023-05-07 02:22:57,128 arona-test INFO ====> Epoch: 29
2023-05-07 02:23:01,579 arona-test INFO ====> Epoch: 30
2023-05-07 02:23:06,086 arona-test INFO ====> Epoch: 31
2023-05-07 02:23:10,614 arona-test INFO ====> Epoch: 32
2023-05-07 02:23:15,122 arona-test INFO ====> Epoch: 33
2023-05-07 02:23:19,563 arona-test INFO ====> Epoch: 34
2023-05-07 02:23:24,114 arona-test INFO ====> Epoch: 35
2023-05-07 02:23:28,553 arona-test INFO ====> Epoch: 36
2023-05-07 02:23:33,294 arona-test INFO ====> Epoch: 37
2023-05-07 02:23:35,931 arona-test INFO Train Epoch: 38 [50%]
2023-05-07 02:23:35,931 arona-test INFO [600, 9.953853910903285e-05]
2023-05-07 02:23:35,932 arona-test INFO loss_disc=2.671, loss_gen=4.091, loss_fm=20.070,loss_mel=28.230, loss_kl=1.540
2023-05-07 02:23:38,330 arona-test INFO ====> Epoch: 38
2023-05-07 02:23:42,966 arona-test INFO ====> Epoch: 39
2023-05-07 02:23:47,495 arona-test INFO ====> Epoch: 40
2023-05-07 02:23:52,087 arona-test INFO ====> Epoch: 41
2023-05-07 02:23:56,783 arona-test INFO ====> Epoch: 42
2023-05-07 02:24:01,365 arona-test INFO ====> Epoch: 43
2023-05-07 02:24:05,981 arona-test INFO ====> Epoch: 44
2023-05-07 02:24:10,625 arona-test INFO ====> Epoch: 45
2023-05-07 02:24:15,174 arona-test INFO ====> Epoch: 46
2023-05-07 02:24:19,802 arona-test INFO ====> Epoch: 47
2023-05-07 02:24:24,304 arona-test INFO ====> Epoch: 48
2023-05-07 02:24:28,775 arona-test INFO ====> Epoch: 49
2023-05-07 02:24:33,606 arona-test INFO Saving model and optimizer state at epoch 50 to ./logs/arona-test/G_2333333.pth
2023-05-07 02:24:34,228 arona-test INFO Saving model and optimizer state at epoch 50 to ./logs/arona-test/D_2333333.pth
2023-05-07 02:24:34,951 arona-test INFO ====> Epoch: 50
2023-05-07 02:24:35,354 arona-test INFO Train Epoch: 51 [0%]
2023-05-07 02:24:35,355 arona-test INFO [800, 9.937691023999092e-05]
2023-05-07 02:24:35,355 arona-test INFO loss_disc=2.753, loss_gen=3.116, loss_fm=11.374,loss_mel=24.848, loss_kl=1.527
2023-05-07 02:24:40,048 arona-test INFO ====> Epoch: 51
2023-05-07 02:24:44,531 arona-test INFO ====> Epoch: 52
2023-05-07 02:24:49,169 arona-test INFO ====> Epoch: 53
2023-05-07 02:24:53,789 arona-test INFO ====> Epoch: 54
2023-05-07 02:24:58,426 arona-test INFO ====> Epoch: 55
2023-05-07 02:25:03,001 arona-test INFO ====> Epoch: 56
2023-05-07 02:25:07,587 arona-test INFO ====> Epoch: 57
2023-05-07 02:25:12,201 arona-test INFO ====> Epoch: 58
2023-05-07 02:25:16,818 arona-test INFO ====> Epoch: 59
2023-05-07 02:25:21,437 arona-test INFO ====> Epoch: 60
2023-05-07 02:25:25,951 arona-test INFO ====> Epoch: 61
2023-05-07 02:25:30,568 arona-test INFO ====> Epoch: 62
2023-05-07 02:25:33,202 arona-test INFO Train Epoch: 63 [50%]
2023-05-07 02:25:33,203 arona-test INFO [1000, 9.922794731438052e-05]
2023-05-07 02:25:33,203 arona-test INFO loss_disc=2.050, loss_gen=3.784, loss_fm=18.286,loss_mel=27.481, loss_kl=1.662
2023-05-07 02:25:35,569 arona-test INFO ====> Epoch: 63
2023-05-07 02:25:40,151 arona-test INFO ====> Epoch: 64
2023-05-07 02:25:44,605 arona-test INFO ====> Epoch: 65
2023-05-07 02:25:49,101 arona-test INFO ====> Epoch: 66
2023-05-07 02:25:53,558 arona-test INFO ====> Epoch: 67
2023-05-07 02:25:58,228 arona-test INFO ====> Epoch: 68
2023-05-07 02:26:02,953 arona-test INFO ====> Epoch: 69
2023-05-07 02:26:07,618 arona-test INFO ====> Epoch: 70
2023-05-07 02:26:12,468 arona-test INFO ====> Epoch: 71
2023-05-07 02:26:17,218 arona-test INFO ====> Epoch: 72
2023-05-07 02:26:21,961 arona-test INFO ====> Epoch: 73
2023-05-07 02:26:26,968 arona-test INFO ====> Epoch: 74
2023-05-07 02:26:31,743 arona-test INFO ====> Epoch: 75
2023-05-07 02:26:32,131 arona-test INFO Train Epoch: 76 [0%]
2023-05-07 02:26:32,132 arona-test INFO [1200, 9.906682277864462e-05]
2023-05-07 02:26:32,132 arona-test INFO loss_disc=2.828, loss_gen=3.167, loss_fm=15.442,loss_mel=18.576, loss_kl=0.646
2023-05-07 02:26:36,942 arona-test INFO ====> Epoch: 76
2023-05-07 02:26:41,798 arona-test INFO ====> Epoch: 77
2023-05-07 02:26:46,691 arona-test INFO ====> Epoch: 78
2023-05-07 02:26:51,588 arona-test INFO ====> Epoch: 79
2023-05-07 02:26:56,422 arona-test INFO ====> Epoch: 80
2023-05-07 02:27:01,177 arona-test INFO ====> Epoch: 81
2023-05-07 02:27:05,895 arona-test INFO ====> Epoch: 82
2023-05-07 02:27:10,784 arona-test INFO ====> Epoch: 83
2023-05-07 02:27:15,485 arona-test INFO ====> Epoch: 84
2023-05-07 02:27:20,144 arona-test INFO ====> Epoch: 85
2023-05-07 02:27:24,835 arona-test INFO ====> Epoch: 86
2023-05-07 02:27:29,499 arona-test INFO ====> Epoch: 87
2023-05-07 02:27:32,173 arona-test INFO Train Epoch: 88 [50%]
2023-05-07 02:27:32,174 arona-test INFO [1400, 9.891832466458178e-05]
2023-05-07 02:27:32,175 arona-test INFO loss_disc=2.501, loss_gen=3.244, loss_fm=13.325,loss_mel=24.152, loss_kl=0.492
2023-05-07 02:27:34,542 arona-test INFO ====> Epoch: 88
2023-05-07 02:27:39,269 arona-test INFO ====> Epoch: 89
2023-05-07 02:27:43,941 arona-test INFO ====> Epoch: 90
2023-05-07 02:27:48,625 arona-test INFO ====> Epoch: 91
2023-05-07 02:27:53,387 arona-test INFO ====> Epoch: 92
2023-05-07 02:27:58,303 arona-test INFO ====> Epoch: 93
2023-05-07 02:28:03,150 arona-test INFO ====> Epoch: 94
2023-05-07 02:28:07,914 arona-test INFO ====> Epoch: 95
2023-05-07 02:28:12,645 arona-test INFO ====> Epoch: 96
2023-05-07 02:28:17,400 arona-test INFO ====> Epoch: 97
2023-05-07 02:28:22,205 arona-test INFO ====> Epoch: 98
2023-05-07 02:28:26,977 arona-test INFO ====> Epoch: 99
2023-05-07 02:28:31,693 arona-test INFO Saving model and optimizer state at epoch 100 to ./logs/arona-test/G_2333333.pth
2023-05-07 02:28:33,326 arona-test INFO Saving model and optimizer state at epoch 100 to ./logs/arona-test/D_2333333.pth
2023-05-07 02:28:35,720 arona-test INFO ====> Epoch: 100
2023-05-07 02:28:36,126 arona-test INFO Train Epoch: 101 [0%]
2023-05-07 02:28:36,127 arona-test INFO [1600, 9.875770288847208e-05]
2023-05-07 02:28:36,127 arona-test INFO loss_disc=2.800, loss_gen=3.014, loss_fm=11.194,loss_mel=18.688, loss_kl=0.939
2023-05-07 02:28:40,726 arona-test INFO ====> Epoch: 101
2023-05-07 02:28:45,425 arona-test INFO ====> Epoch: 102
2023-05-07 02:28:50,200 arona-test INFO ====> Epoch: 103
2023-05-07 02:28:54,878 arona-test INFO ====> Epoch: 104
2023-05-07 02:28:59,559 arona-test INFO ====> Epoch: 105
2023-05-07 02:29:04,301 arona-test INFO ====> Epoch: 106
2023-05-07 02:29:09,046 arona-test INFO ====> Epoch: 107
2023-05-07 02:29:13,692 arona-test INFO ====> Epoch: 108
2023-05-07 02:29:18,477 arona-test INFO ====> Epoch: 109
2023-05-07 02:29:23,229 arona-test INFO ====> Epoch: 110
2023-05-07 02:29:27,981 arona-test INFO ====> Epoch: 111
2023-05-07 02:29:32,785 arona-test INFO ====> Epoch: 112
2023-05-07 02:29:35,527 arona-test INFO Train Epoch: 113 [50%]
2023-05-07 02:29:35,528 arona-test INFO [1800, 9.86096681355974e-05]
2023-05-07 02:29:35,528 arona-test INFO loss_disc=2.639, loss_gen=3.090, loss_fm=11.058,loss_mel=24.834, loss_kl=0.852
2023-05-07 02:29:37,985 arona-test INFO ====> Epoch: 113
2023-05-07 02:29:42,751 arona-test INFO ====> Epoch: 114
2023-05-07 02:29:47,660 arona-test INFO ====> Epoch: 115
2023-05-07 02:29:52,414 arona-test INFO ====> Epoch: 116
2023-05-07 02:29:57,103 arona-test INFO ====> Epoch: 117
2023-05-07 02:30:01,862 arona-test INFO ====> Epoch: 118
2023-05-07 02:30:06,737 arona-test INFO ====> Epoch: 119
2023-05-07 02:30:11,452 arona-test INFO ====> Epoch: 120
2023-05-07 02:30:16,265 arona-test INFO ====> Epoch: 121
2023-05-07 02:30:20,982 arona-test INFO ====> Epoch: 122
2023-05-07 02:30:25,699 arona-test INFO ====> Epoch: 123
2023-05-07 02:30:30,412 arona-test INFO ====> Epoch: 124
2023-05-07 02:30:35,218 arona-test INFO ====> Epoch: 125
2023-05-07 02:30:35,611 arona-test INFO Train Epoch: 126 [0%]
2023-05-07 02:30:35,612 arona-test INFO [2000, 9.84495475503445e-05]
2023-05-07 02:30:35,612 arona-test INFO loss_disc=2.620, loss_gen=3.181, loss_fm=14.522,loss_mel=24.561, loss_kl=0.689
2023-05-07 02:30:40,453 arona-test INFO ====> Epoch: 126
2023-05-07 02:30:45,190 arona-test INFO ====> Epoch: 127
2023-05-07 02:30:49,969 arona-test INFO ====> Epoch: 128
2023-05-07 02:30:54,730 arona-test INFO ====> Epoch: 129
2023-05-07 02:30:59,476 arona-test INFO ====> Epoch: 130
2023-05-07 02:31:04,159 arona-test INFO ====> Epoch: 131
2023-05-07 02:31:08,971 arona-test INFO ====> Epoch: 132
2023-05-07 02:31:13,736 arona-test INFO ====> Epoch: 133
2023-05-07 02:31:18,636 arona-test INFO ====> Epoch: 134
2023-05-07 02:31:23,409 arona-test INFO ====> Epoch: 135
2023-05-07 02:31:28,135 arona-test INFO ====> Epoch: 136
2023-05-07 02:31:32,914 arona-test INFO ====> Epoch: 137
2023-05-07 02:31:35,686 arona-test INFO Train Epoch: 138 [50%]
2023-05-07 02:31:35,686 arona-test INFO [2200, 9.830197471282419e-05]
2023-05-07 02:31:35,687 arona-test INFO loss_disc=2.432, loss_gen=3.424, loss_fm=16.094,loss_mel=25.562, loss_kl=0.564
2023-05-07 02:31:38,304 arona-test INFO ====> Epoch: 138
2023-05-07 02:31:43,046 arona-test INFO ====> Epoch: 139
2023-05-07 02:31:47,732 arona-test INFO ====> Epoch: 140
2023-05-07 02:31:52,512 arona-test INFO ====> Epoch: 141
2023-05-07 02:31:57,260 arona-test INFO ====> Epoch: 142
2023-05-07 02:32:02,092 arona-test INFO ====> Epoch: 143
2023-05-07 02:32:06,932 arona-test INFO ====> Epoch: 144
2023-05-07 02:32:11,729 arona-test INFO ====> Epoch: 145
2023-05-07 02:32:16,558 arona-test INFO ====> Epoch: 146
2023-05-07 02:32:21,264 arona-test INFO ====> Epoch: 147
2023-05-07 02:32:25,950 arona-test INFO ====> Epoch: 148
2023-05-07 02:32:30,585 arona-test INFO ====> Epoch: 149
2023-05-07 02:32:35,103 arona-test INFO Saving model and optimizer state at epoch 150 to ./logs/arona-test/G_2333333.pth
2023-05-07 02:32:36,754 arona-test INFO Saving model and optimizer state at epoch 150 to ./logs/arona-test/D_2333333.pth
2023-05-07 02:32:39,229 arona-test INFO ====> Epoch: 150
2023-05-07 02:32:39,625 arona-test INFO Train Epoch: 151 [0%]
2023-05-07 02:32:39,626 arona-test INFO [2400, 9.814235375455375e-05]
2023-05-07 02:32:39,626 arona-test INFO loss_disc=2.480, loss_gen=3.195, loss_fm=11.992,loss_mel=24.585, loss_kl=1.084
2023-05-07 02:32:44,231 arona-test INFO ====> Epoch: 151
2023-05-07 02:32:48,855 arona-test INFO ====> Epoch: 152
2023-05-07 02:32:53,448 arona-test INFO ====> Epoch: 153
2023-05-07 02:32:58,053 arona-test INFO ====> Epoch: 154
2023-05-07 02:33:02,669 arona-test INFO ====> Epoch: 155
2023-05-07 02:33:07,297 arona-test INFO ====> Epoch: 156
2023-05-07 02:33:11,787 arona-test INFO ====> Epoch: 157
2023-05-07 02:33:16,587 arona-test INFO ====> Epoch: 158
2023-05-07 02:33:21,117 arona-test INFO ====> Epoch: 159
2023-05-07 02:33:25,838 arona-test INFO ====> Epoch: 160
2023-05-07 02:33:30,581 arona-test INFO ====> Epoch: 161
2023-05-07 02:33:35,238 arona-test INFO ====> Epoch: 162
2023-05-07 02:33:37,886 arona-test INFO Train Epoch: 163 [50%]
2023-05-07 02:33:37,887 arona-test INFO [2600, 9.79952413910655e-05]
2023-05-07 02:33:37,887 arona-test INFO loss_disc=2.815, loss_gen=4.082, loss_fm=20.359,loss_mel=27.421, loss_kl=1.050
2023-05-07 02:33:40,316 arona-test INFO ====> Epoch: 163
2023-05-07 02:33:44,906 arona-test INFO ====> Epoch: 164
2023-05-07 02:33:49,630 arona-test INFO ====> Epoch: 165
2023-05-07 02:33:54,162 arona-test INFO ====> Epoch: 166
2023-05-07 02:33:58,702 arona-test INFO ====> Epoch: 167
2023-05-07 02:34:03,349 arona-test INFO ====> Epoch: 168
2023-05-07 02:34:07,846 arona-test INFO ====> Epoch: 169
2023-05-07 02:34:12,399 arona-test INFO ====> Epoch: 170
2023-05-07 02:34:17,016 arona-test INFO ====> Epoch: 171
2023-05-07 02:34:21,669 arona-test INFO ====> Epoch: 172
2023-05-07 02:34:26,168 arona-test INFO ====> Epoch: 173
2023-05-07 02:34:30,844 arona-test INFO ====> Epoch: 174
2023-05-07 02:34:35,380 arona-test INFO ====> Epoch: 175
2023-05-07 02:34:35,762 arona-test INFO Train Epoch: 176 [0%]
2023-05-07 02:34:35,763 arona-test INFO [2800, 9.783611850078301e-05]
2023-05-07 02:34:35,763 arona-test INFO loss_disc=2.348, loss_gen=3.735, loss_fm=14.839,loss_mel=23.537, loss_kl=0.085
2023-05-07 02:34:40,270 arona-test INFO ====> Epoch: 176
2023-05-07 02:34:44,963 arona-test INFO ====> Epoch: 177
2023-05-07 02:34:49,535 arona-test INFO ====> Epoch: 178
2023-05-07 02:34:54,104 arona-test INFO ====> Epoch: 179
2023-05-07 02:34:58,852 arona-test INFO ====> Epoch: 180
2023-05-07 02:35:03,251 arona-test INFO ====> Epoch: 181
2023-05-07 02:35:07,877 arona-test INFO ====> Epoch: 182
2023-05-07 02:35:12,677 arona-test INFO ====> Epoch: 183
2023-05-07 02:35:17,170 arona-test INFO ====> Epoch: 184
2023-05-07 02:35:21,720 arona-test INFO ====> Epoch: 185
2023-05-07 02:35:26,188 arona-test INFO ====> Epoch: 186
2023-05-07 02:35:30,683 arona-test INFO ====> Epoch: 187
2023-05-07 02:35:33,222 arona-test INFO Train Epoch: 188 [50%]
2023-05-07 02:35:33,223 arona-test INFO [3000, 9.768946517450186e-05]
2023-05-07 02:35:33,223 arona-test INFO loss_disc=2.292, loss_gen=3.556, loss_fm=17.174,loss_mel=23.981, loss_kl=0.975
2023-05-07 02:35:35,517 arona-test INFO ====> Epoch: 188
2023-05-07 02:35:39,940 arona-test INFO ====> Epoch: 189
2023-05-07 02:35:44,521 arona-test INFO ====> Epoch: 190
2023-05-07 02:35:49,150 arona-test INFO ====> Epoch: 191
2023-05-07 02:35:53,820 arona-test INFO ====> Epoch: 192
2023-05-07 02:35:58,285 arona-test INFO ====> Epoch: 193
2023-05-07 02:36:03,027 arona-test INFO ====> Epoch: 194
2023-05-07 02:36:07,575 arona-test INFO ====> Epoch: 195
2023-05-07 02:36:12,034 arona-test INFO ====> Epoch: 196
2023-05-07 02:36:16,493 arona-test INFO ====> Epoch: 197
2023-05-07 02:36:20,940 arona-test INFO ====> Epoch: 198
2023-05-07 02:36:25,493 arona-test INFO ====> Epoch: 199
2023-05-07 02:36:30,055 arona-test INFO Saving model and optimizer state at epoch 200 to ./logs/arona-test/G_2333333.pth
2023-05-07 02:36:31,720 arona-test INFO Saving model and optimizer state at epoch 200 to ./logs/arona-test/D_2333333.pth
2023-05-07 02:36:34,092 arona-test INFO ====> Epoch: 200
2023-05-07 02:36:34,092 arona-test INFO Training is done. The program is closed.
2023-05-07 02:36:34,190 arona-test INFO saving final ckpt:Success.