Spaces:
Runtime error
Runtime error
File size: 10,832 Bytes
01ec1bb |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 |
2023-05-02 00:41:55,744 momoi-test-dio INFO {'train': {'log_interval': 200, 'seed': 1234, 'epochs': 20000, 'learning_rate': 0.0001, 'betas': [0.8, 0.99], 'eps': 1e-09, 'batch_size': 4, 'fp16_run': True, 'lr_decay': 0.999875, 'segment_size': 12800, 'init_lr_ratio': 1, 'warmup_epochs': 0, 'c_mel': 45, 'c_kl': 1.0}, 'data': {'max_wav_value': 32768.0, 'sampling_rate': 40000, 'filter_length': 2048, 'hop_length': 400, 'win_length': 2048, 'n_mel_channels': 125, 'mel_fmin': 0.0, 'mel_fmax': None, 'training_files': './logs/momoi-test-dio/filelist.txt'}, 'model': {'inter_channels': 192, 'hidden_channels': 192, 'filter_channels': 768, 'n_heads': 2, 'n_layers': 6, 'kernel_size': 3, 'p_dropout': 0, 'resblock': '1', 'resblock_kernel_sizes': [3, 7, 11], 'resblock_dilation_sizes': [[1, 3, 5], [1, 3, 5], [1, 3, 5]], 'upsample_rates': [10, 10, 2, 2], 'upsample_initial_channel': 512, 'upsample_kernel_sizes': [16, 16, 4, 4], 'use_spectral_norm': False, 'gin_channels': 256, 'spk_embed_dim': 109}, 'model_dir': './logs/momoi-test-dio', 'experiment_dir': './logs/momoi-test-dio', 'save_every_epoch': 50, 'name': 'momoi-test-dio', 'total_epoch': 100, 'pretrainG': 'pretrained/f0G40k.pth', 'pretrainD': 'pretrained/f0D40k.pth', 'gpus': '0', 'sample_rate': '40k', 'if_f0': 1, 'if_latest': 0, 'if_cache_data_in_gpu': 0}
2023-05-02 00:41:55,744 momoi-test-dio WARNING /root/Retrieval-based-Voice-Conversion-WebUI/train is not a git repository, therefore hash value comparison will be ignored.
2023-05-02 00:41:58,198 momoi-test-dio INFO loaded pretrained pretrained/f0G40k.pth pretrained/f0D40k.pth
2023-05-02 00:42:06,580 momoi-test-dio INFO Train Epoch: 1 [0%]
2023-05-02 00:42:06,580 momoi-test-dio INFO [0, 0.0001]
2023-05-02 00:42:06,580 momoi-test-dio INFO loss_disc=3.384, loss_gen=1.652, loss_fm=19.095,loss_mel=40.827, loss_kl=5.000
2023-05-02 00:42:16,663 momoi-test-dio INFO ====> Epoch: 1
2023-05-02 00:42:23,252 momoi-test-dio INFO ====> Epoch: 2
2023-05-02 00:42:28,579 momoi-test-dio INFO ====> Epoch: 3
2023-05-02 00:42:33,958 momoi-test-dio INFO ====> Epoch: 4
2023-05-02 00:42:39,204 momoi-test-dio INFO ====> Epoch: 5
2023-05-02 00:42:44,510 momoi-test-dio INFO ====> Epoch: 6
2023-05-02 00:42:49,778 momoi-test-dio INFO ====> Epoch: 7
2023-05-02 00:42:55,155 momoi-test-dio INFO ====> Epoch: 8
2023-05-02 00:43:00,512 momoi-test-dio INFO ====> Epoch: 9
2023-05-02 00:43:05,786 momoi-test-dio INFO ====> Epoch: 10
2023-05-02 00:43:06,184 momoi-test-dio INFO Train Epoch: 11 [0%]
2023-05-02 00:43:06,185 momoi-test-dio INFO [200, 9.987507028906759e-05]
2023-05-02 00:43:06,185 momoi-test-dio INFO loss_disc=2.857, loss_gen=3.663, loss_fm=17.976,loss_mel=30.621, loss_kl=1.750
2023-05-02 00:43:11,581 momoi-test-dio INFO ====> Epoch: 11
2023-05-02 00:43:17,198 momoi-test-dio INFO ====> Epoch: 12
2023-05-02 00:43:22,568 momoi-test-dio INFO ====> Epoch: 13
2023-05-02 00:43:27,837 momoi-test-dio INFO ====> Epoch: 14
2023-05-02 00:43:33,108 momoi-test-dio INFO ====> Epoch: 15
2023-05-02 00:43:38,493 momoi-test-dio INFO ====> Epoch: 16
2023-05-02 00:43:43,822 momoi-test-dio INFO ====> Epoch: 17
2023-05-02 00:43:48,963 momoi-test-dio INFO ====> Epoch: 18
2023-05-02 00:43:54,181 momoi-test-dio INFO ====> Epoch: 19
2023-05-02 00:43:59,372 momoi-test-dio INFO ====> Epoch: 20
2023-05-02 00:43:59,793 momoi-test-dio INFO Train Epoch: 21 [0%]
2023-05-02 00:43:59,793 momoi-test-dio INFO [400, 9.975029665246193e-05]
2023-05-02 00:43:59,793 momoi-test-dio INFO loss_disc=2.622, loss_gen=3.344, loss_fm=17.900,loss_mel=28.412, loss_kl=1.350
2023-05-02 00:44:05,278 momoi-test-dio INFO ====> Epoch: 21
2023-05-02 00:44:10,408 momoi-test-dio INFO ====> Epoch: 22
2023-05-02 00:44:15,262 momoi-test-dio INFO ====> Epoch: 23
2023-05-02 00:44:19,950 momoi-test-dio INFO ====> Epoch: 24
2023-05-02 00:44:24,517 momoi-test-dio INFO ====> Epoch: 25
2023-05-02 00:44:29,355 momoi-test-dio INFO ====> Epoch: 26
2023-05-02 00:44:34,360 momoi-test-dio INFO ====> Epoch: 27
2023-05-02 00:44:39,240 momoi-test-dio INFO ====> Epoch: 28
2023-05-02 00:44:44,465 momoi-test-dio INFO ====> Epoch: 29
2023-05-02 00:44:49,660 momoi-test-dio INFO ====> Epoch: 30
2023-05-02 00:44:50,095 momoi-test-dio INFO Train Epoch: 31 [0%]
2023-05-02 00:44:50,096 momoi-test-dio INFO [600, 9.962567889519979e-05]
2023-05-02 00:44:50,096 momoi-test-dio INFO loss_disc=2.635, loss_gen=3.650, loss_fm=17.341,loss_mel=29.182, loss_kl=1.773
2023-05-02 00:44:55,573 momoi-test-dio INFO ====> Epoch: 31
2023-05-02 00:45:00,783 momoi-test-dio INFO ====> Epoch: 32
2023-05-02 00:45:05,963 momoi-test-dio INFO ====> Epoch: 33
2023-05-02 00:45:11,278 momoi-test-dio INFO ====> Epoch: 34
2023-05-02 00:45:16,547 momoi-test-dio INFO ====> Epoch: 35
2023-05-02 00:45:21,724 momoi-test-dio INFO ====> Epoch: 36
2023-05-02 00:45:26,929 momoi-test-dio INFO ====> Epoch: 37
2023-05-02 00:45:32,076 momoi-test-dio INFO ====> Epoch: 38
2023-05-02 00:45:37,326 momoi-test-dio INFO ====> Epoch: 39
2023-05-02 00:45:42,569 momoi-test-dio INFO ====> Epoch: 40
2023-05-02 00:45:42,993 momoi-test-dio INFO Train Epoch: 41 [0%]
2023-05-02 00:45:42,994 momoi-test-dio INFO [800, 9.950121682254156e-05]
2023-05-02 00:45:42,994 momoi-test-dio INFO loss_disc=2.837, loss_gen=2.963, loss_fm=13.174,loss_mel=25.433, loss_kl=1.296
2023-05-02 00:45:48,552 momoi-test-dio INFO ====> Epoch: 41
2023-05-02 00:45:53,787 momoi-test-dio INFO ====> Epoch: 42
2023-05-02 00:45:59,009 momoi-test-dio INFO ====> Epoch: 43
2023-05-02 00:46:04,214 momoi-test-dio INFO ====> Epoch: 44
2023-05-02 00:46:09,421 momoi-test-dio INFO ====> Epoch: 45
2023-05-02 00:46:14,593 momoi-test-dio INFO ====> Epoch: 46
2023-05-02 00:46:19,691 momoi-test-dio INFO ====> Epoch: 47
2023-05-02 00:46:24,988 momoi-test-dio INFO ====> Epoch: 48
2023-05-02 00:46:30,192 momoi-test-dio INFO ====> Epoch: 49
2023-05-02 00:46:35,390 momoi-test-dio INFO Saving model and optimizer state at epoch 50 to ./logs/momoi-test-dio/G_1000.pth
2023-05-02 00:46:36,039 momoi-test-dio INFO Saving model and optimizer state at epoch 50 to ./logs/momoi-test-dio/D_1000.pth
2023-05-02 00:46:36,807 momoi-test-dio INFO ====> Epoch: 50
2023-05-02 00:46:37,366 momoi-test-dio INFO Train Epoch: 51 [0%]
2023-05-02 00:46:37,367 momoi-test-dio INFO [1000, 9.937691023999092e-05]
2023-05-02 00:46:37,367 momoi-test-dio INFO loss_disc=2.162, loss_gen=3.435, loss_fm=17.340,loss_mel=25.240, loss_kl=1.846
2023-05-02 00:46:42,622 momoi-test-dio INFO ====> Epoch: 51
2023-05-02 00:46:47,914 momoi-test-dio INFO ====> Epoch: 52
2023-05-02 00:46:53,047 momoi-test-dio INFO ====> Epoch: 53
2023-05-02 00:46:58,212 momoi-test-dio INFO ====> Epoch: 54
2023-05-02 00:47:03,462 momoi-test-dio INFO ====> Epoch: 55
2023-05-02 00:47:08,729 momoi-test-dio INFO ====> Epoch: 56
2023-05-02 00:47:13,990 momoi-test-dio INFO ====> Epoch: 57
2023-05-02 00:47:19,139 momoi-test-dio INFO ====> Epoch: 58
2023-05-02 00:47:24,389 momoi-test-dio INFO ====> Epoch: 59
2023-05-02 00:47:29,718 momoi-test-dio INFO ====> Epoch: 60
2023-05-02 00:47:30,139 momoi-test-dio INFO Train Epoch: 61 [0%]
2023-05-02 00:47:30,139 momoi-test-dio INFO [1200, 9.92527589532945e-05]
2023-05-02 00:47:30,140 momoi-test-dio INFO loss_disc=2.531, loss_gen=3.307, loss_fm=19.033,loss_mel=29.324, loss_kl=0.911
2023-05-02 00:47:35,446 momoi-test-dio INFO ====> Epoch: 61
2023-05-02 00:47:40,701 momoi-test-dio INFO ====> Epoch: 62
2023-05-02 00:47:45,879 momoi-test-dio INFO ====> Epoch: 63
2023-05-02 00:47:51,061 momoi-test-dio INFO ====> Epoch: 64
2023-05-02 00:47:56,178 momoi-test-dio INFO ====> Epoch: 65
2023-05-02 00:48:01,320 momoi-test-dio INFO ====> Epoch: 66
2023-05-02 00:48:06,452 momoi-test-dio INFO ====> Epoch: 67
2023-05-02 00:48:11,486 momoi-test-dio INFO ====> Epoch: 68
2023-05-02 00:48:16,762 momoi-test-dio INFO ====> Epoch: 69
2023-05-02 00:48:21,862 momoi-test-dio INFO ====> Epoch: 70
2023-05-02 00:48:22,279 momoi-test-dio INFO Train Epoch: 71 [0%]
2023-05-02 00:48:22,279 momoi-test-dio INFO [1400, 9.912876276844171e-05]
2023-05-02 00:48:22,280 momoi-test-dio INFO loss_disc=2.475, loss_gen=3.269, loss_fm=14.836,loss_mel=24.537, loss_kl=1.053
2023-05-02 00:48:27,531 momoi-test-dio INFO ====> Epoch: 71
2023-05-02 00:48:32,757 momoi-test-dio INFO ====> Epoch: 72
2023-05-02 00:48:38,013 momoi-test-dio INFO ====> Epoch: 73
2023-05-02 00:48:42,944 momoi-test-dio INFO ====> Epoch: 74
2023-05-02 00:48:47,681 momoi-test-dio INFO ====> Epoch: 75
2023-05-02 00:48:52,144 momoi-test-dio INFO ====> Epoch: 76
2023-05-02 00:48:56,958 momoi-test-dio INFO ====> Epoch: 77
2023-05-02 00:49:01,484 momoi-test-dio INFO ====> Epoch: 78
2023-05-02 00:49:06,188 momoi-test-dio INFO ====> Epoch: 79
2023-05-02 00:49:10,961 momoi-test-dio INFO ====> Epoch: 80
2023-05-02 00:49:11,334 momoi-test-dio INFO Train Epoch: 81 [0%]
2023-05-02 00:49:11,335 momoi-test-dio INFO [1600, 9.900492149166423e-05]
2023-05-02 00:49:11,335 momoi-test-dio INFO loss_disc=2.582, loss_gen=3.221, loss_fm=14.158,loss_mel=25.971, loss_kl=0.623
2023-05-02 00:49:16,648 momoi-test-dio INFO ====> Epoch: 81
2023-05-02 00:49:21,901 momoi-test-dio INFO ====> Epoch: 82
2023-05-02 00:49:27,152 momoi-test-dio INFO ====> Epoch: 83
2023-05-02 00:49:32,406 momoi-test-dio INFO ====> Epoch: 84
2023-05-02 00:49:37,622 momoi-test-dio INFO ====> Epoch: 85
2023-05-02 00:49:42,723 momoi-test-dio INFO ====> Epoch: 86
2023-05-02 00:49:48,009 momoi-test-dio INFO ====> Epoch: 87
2023-05-02 00:49:53,259 momoi-test-dio INFO ====> Epoch: 88
2023-05-02 00:49:58,447 momoi-test-dio INFO ====> Epoch: 89
2023-05-02 00:50:03,662 momoi-test-dio INFO ====> Epoch: 90
2023-05-02 00:50:04,098 momoi-test-dio INFO Train Epoch: 91 [0%]
2023-05-02 00:50:04,098 momoi-test-dio INFO [1800, 9.888123492943583e-05]
2023-05-02 00:50:04,098 momoi-test-dio INFO loss_disc=2.413, loss_gen=3.635, loss_fm=15.296,loss_mel=24.656, loss_kl=0.920
2023-05-02 00:50:09,520 momoi-test-dio INFO ====> Epoch: 91
2023-05-02 00:50:14,720 momoi-test-dio INFO ====> Epoch: 92
2023-05-02 00:50:19,935 momoi-test-dio INFO ====> Epoch: 93
2023-05-02 00:50:25,188 momoi-test-dio INFO ====> Epoch: 94
2023-05-02 00:50:30,531 momoi-test-dio INFO ====> Epoch: 95
2023-05-02 00:50:35,687 momoi-test-dio INFO ====> Epoch: 96
2023-05-02 00:50:40,825 momoi-test-dio INFO ====> Epoch: 97
2023-05-02 00:50:46,122 momoi-test-dio INFO ====> Epoch: 98
2023-05-02 00:50:51,347 momoi-test-dio INFO ====> Epoch: 99
2023-05-02 00:50:56,617 momoi-test-dio INFO Saving model and optimizer state at epoch 100 to ./logs/momoi-test-dio/G_2000.pth
2023-05-02 00:50:57,310 momoi-test-dio INFO Saving model and optimizer state at epoch 100 to ./logs/momoi-test-dio/D_2000.pth
2023-05-02 00:50:58,096 momoi-test-dio INFO ====> Epoch: 100
2023-05-02 00:50:58,096 momoi-test-dio INFO Training is done. The program is closed.
2023-05-02 00:50:58,209 momoi-test-dio INFO saving final ckpt:Success.
|