csukuangfj commited on
Commit
26d87f8
1 Parent(s): 74a8357

Add decoding logs.

Browse files
Files changed (25) hide show
  1. log/beam_search/errs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt +0 -0
  2. log/beam_search/errs-test-other-beam_4-epoch-42-avg-11-beam-4.txt +0 -0
  3. log/beam_search/log-decode-epoch-42-avg-11-beam-4-2022-03-12-10-40-40 +233 -0
  4. log/beam_search/recogs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt +0 -0
  5. log/beam_search/recogs-test-other-beam_4-epoch-42-avg-11-beam-4.txt +0 -0
  6. log/errs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt +0 -0
  7. log/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt +0 -0
  8. log/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt +0 -0
  9. log/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt +0 -0
  10. log/errs-test-other-beam_4-epoch-42-avg-11-beam-4.txt +0 -0
  11. log/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt +0 -0
  12. log/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt +0 -0
  13. log/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt +0 -0
  14. log/log-decode-epoch-42-avg-11-beam-4-2022-03-12-10-30-00 +233 -0
  15. log/log-decode-epoch-42-avg-11-context-2-max-sym-per-frame-1-2022-03-12-10-50-03 +29 -0
  16. log/log-decode-epoch-42-avg-11-context-2-max-sym-per-frame-2-2022-03-12-10-56-46 +29 -0
  17. log/log-decode-epoch-42-avg-11-context-2-max-sym-per-frame-3-2022-03-11-18-36-33 +29 -0
  18. log/recogs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt +0 -0
  19. log/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt +0 -0
  20. log/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt +0 -0
  21. log/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt +0 -0
  22. log/recogs-test-other-beam_4-epoch-42-avg-11-beam-4.txt +0 -0
  23. log/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt +0 -0
  24. log/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt +0 -0
  25. log/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt +0 -0
log/beam_search/errs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/beam_search/errs-test-other-beam_4-epoch-42-avg-11-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/beam_search/log-decode-epoch-42-avg-11-beam-4-2022-03-12-10-40-40 ADDED
@@ -0,0 +1,233 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-03-12 10:40:40,428 INFO [decode.py:425] Decoding started
2
+ 2022-03-12 10:40:40,428 INFO [decode.py:431] Device: cuda:0
3
+ 2022-03-12 10:40:40,430 INFO [decode.py:440] {'feature_dim': 80, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'embedding_dim': 512, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '5ee082ea55f50e8bd42203ba266945ea5a236ab8', 'k2-git-date': 'Sun Feb 27 09:00:48 2022', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-beam-search-for-pruned-rnnt', 'icefall-git-sha1': 'ad62981-dirty', 'icefall-git-date': 'Fri Mar 4 15:38:23 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-pruned-rnnt', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-rnnt-ali/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-rnnt-ali/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 42, 'avg': 11, 'exp_dir': PosixPath('pruned_transducer_stateless/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless/exp/beam_search'), 'suffix': 'epoch-42-avg-11-beam-4', 'blank_id': 0, 'vocab_size': 500}
4
+ 2022-03-12 10:40:40,431 INFO [decode.py:442] About to create model
5
+ 2022-03-12 10:40:40,914 INFO [decode.py:453] averaging ['pruned_transducer_stateless/exp/epoch-32.pt', 'pruned_transducer_stateless/exp/epoch-33.pt', 'pruned_transducer_stateless/exp/epoch-34.pt', 'pruned_transducer_stateless/exp/epoch-35.pt', 'pruned_transducer_stateless/exp/epoch-36.pt', 'pruned_transducer_stateless/exp/epoch-37.pt', 'pruned_transducer_stateless/exp/epoch-38.pt', 'pruned_transducer_stateless/exp/epoch-39.pt', 'pruned_transducer_stateless/exp/epoch-40.pt', 'pruned_transducer_stateless/exp/epoch-41.pt', 'pruned_transducer_stateless/exp/epoch-42.pt']
6
+ 2022-03-12 10:40:52,342 INFO [decode.py:462] Number of model parameters: 84514780
7
+ 2022-03-12 10:40:52,342 INFO [asr_datamodule.py:379] About to get test-clean cuts
8
+ 2022-03-12 10:40:52,454 INFO [asr_datamodule.py:384] About to get test-other cuts
9
+ 2022-03-12 10:41:03,367 INFO [decode.py:350] batch 0/?, cuts processed until now is 20
10
+ 2022-03-12 10:41:24,590 INFO [decode.py:350] batch 2/?, cuts processed until now is 64
11
+ 2022-03-12 10:41:45,132 INFO [decode.py:350] batch 4/?, cuts processed until now is 81
12
+ 2022-03-12 10:42:06,513 INFO [decode.py:350] batch 6/?, cuts processed until now is 121
13
+ 2022-03-12 10:42:26,567 INFO [decode.py:350] batch 8/?, cuts processed until now is 133
14
+ 2022-03-12 10:42:47,206 INFO [decode.py:350] batch 10/?, cuts processed until now is 168
15
+ 2022-03-12 10:43:06,536 INFO [decode.py:350] batch 12/?, cuts processed until now is 202
16
+ 2022-03-12 10:43:29,980 INFO [decode.py:350] batch 14/?, cuts processed until now is 217
17
+ 2022-03-12 10:43:51,658 INFO [decode.py:350] batch 16/?, cuts processed until now is 241
18
+ 2022-03-12 10:44:13,013 INFO [decode.py:350] batch 18/?, cuts processed until now is 267
19
+ 2022-03-12 10:44:35,845 INFO [decode.py:350] batch 20/?, cuts processed until now is 281
20
+ 2022-03-12 10:44:56,572 INFO [decode.py:350] batch 22/?, cuts processed until now is 325
21
+ 2022-03-12 10:45:18,421 INFO [decode.py:350] batch 24/?, cuts processed until now is 349
22
+ 2022-03-12 10:45:39,797 INFO [decode.py:350] batch 26/?, cuts processed until now is 366
23
+ 2022-03-12 10:46:00,953 INFO [decode.py:350] batch 28/?, cuts processed until now is 389
24
+ 2022-03-12 10:46:22,165 INFO [decode.py:350] batch 30/?, cuts processed until now is 410
25
+ 2022-03-12 10:46:43,154 INFO [decode.py:350] batch 32/?, cuts processed until now is 442
26
+ 2022-03-12 10:47:04,674 INFO [decode.py:350] batch 34/?, cuts processed until now is 474
27
+ 2022-03-12 10:47:25,802 INFO [decode.py:350] batch 36/?, cuts processed until now is 498
28
+ 2022-03-12 10:47:47,413 INFO [decode.py:350] batch 38/?, cuts processed until now is 514
29
+ 2022-03-12 10:48:09,264 INFO [decode.py:350] batch 40/?, cuts processed until now is 524
30
+ 2022-03-12 10:48:29,500 INFO [decode.py:350] batch 42/?, cuts processed until now is 564
31
+ 2022-03-12 10:48:50,368 INFO [decode.py:350] batch 44/?, cuts processed until now is 621
32
+ 2022-03-12 10:49:11,101 INFO [decode.py:350] batch 46/?, cuts processed until now is 633
33
+ 2022-03-12 10:49:31,375 INFO [decode.py:350] batch 48/?, cuts processed until now is 648
34
+ 2022-03-12 10:49:53,209 INFO [decode.py:350] batch 50/?, cuts processed until now is 662
35
+ 2022-03-12 10:50:15,998 INFO [decode.py:350] batch 52/?, cuts processed until now is 680
36
+ 2022-03-12 10:52:16,096 INFO [decode.py:350] batch 54/?, cuts processed until now is 708
37
+ 2022-03-12 10:54:08,450 INFO [decode.py:350] batch 56/?, cuts processed until now is 736
38
+ 2022-03-12 10:55:44,247 INFO [decode.py:350] batch 58/?, cuts processed until now is 752
39
+ 2022-03-12 10:56:05,601 INFO [decode.py:350] batch 60/?, cuts processed until now is 819
40
+ 2022-03-12 10:56:27,497 INFO [decode.py:350] batch 62/?, cuts processed until now is 843
41
+ 2022-03-12 10:56:49,914 INFO [decode.py:350] batch 64/?, cuts processed until now is 850
42
+ 2022-03-12 10:57:12,609 INFO [decode.py:350] batch 66/?, cuts processed until now is 880
43
+ 2022-03-12 10:57:34,044 INFO [decode.py:350] batch 68/?, cuts processed until now is 932
44
+ 2022-03-12 10:58:13,955 INFO [decode.py:350] batch 70/?, cuts processed until now is 957
45
+ 2022-03-12 11:00:17,601 INFO [decode.py:350] batch 72/?, cuts processed until now is 996
46
+ 2022-03-12 11:02:19,361 INFO [decode.py:350] batch 74/?, cuts processed until now is 1064
47
+ 2022-03-12 11:04:01,653 INFO [decode.py:350] batch 76/?, cuts processed until now is 1077
48
+ 2022-03-12 11:04:22,808 INFO [decode.py:350] batch 78/?, cuts processed until now is 1114
49
+ 2022-03-12 11:04:44,531 INFO [decode.py:350] batch 80/?, cuts processed until now is 1141
50
+ 2022-03-12 11:05:05,316 INFO [decode.py:350] batch 82/?, cuts processed until now is 1172
51
+ 2022-03-12 11:05:26,123 INFO [decode.py:350] batch 84/?, cuts processed until now is 1180
52
+ 2022-03-12 11:05:46,560 INFO [decode.py:350] batch 86/?, cuts processed until now is 1199
53
+ 2022-03-12 11:06:06,948 INFO [decode.py:350] batch 88/?, cuts processed until now is 1228
54
+ 2022-03-12 11:06:28,268 INFO [decode.py:350] batch 90/?, cuts processed until now is 1245
55
+ 2022-03-12 11:06:48,649 INFO [decode.py:350] batch 92/?, cuts processed until now is 1267
56
+ 2022-03-12 11:07:08,847 INFO [decode.py:350] batch 94/?, cuts processed until now is 1333
57
+ 2022-03-12 11:07:29,264 INFO [decode.py:350] batch 96/?, cuts processed until now is 1363
58
+ 2022-03-12 11:07:40,842 INFO [decode.py:350] batch 98/?, cuts processed until now is 1378
59
+ 2022-03-12 11:08:02,257 INFO [decode.py:350] batch 100/?, cuts processed until now is 1406
60
+ 2022-03-12 11:08:22,825 INFO [decode.py:350] batch 102/?, cuts processed until now is 1420
61
+ 2022-03-12 11:08:43,545 INFO [decode.py:350] batch 104/?, cuts processed until now is 1445
62
+ 2022-03-12 11:09:04,983 INFO [decode.py:350] batch 106/?, cuts processed until now is 1468
63
+ 2022-03-12 11:09:26,480 INFO [decode.py:350] batch 108/?, cuts processed until now is 1494
64
+ 2022-03-12 11:09:47,325 INFO [decode.py:350] batch 110/?, cuts processed until now is 1547
65
+ 2022-03-12 11:10:09,030 INFO [decode.py:350] batch 112/?, cuts processed until now is 1582
66
+ 2022-03-12 11:10:29,899 INFO [decode.py:350] batch 114/?, cuts processed until now is 1615
67
+ 2022-03-12 11:10:51,929 INFO [decode.py:350] batch 116/?, cuts processed until now is 1636
68
+ 2022-03-12 11:11:12,310 INFO [decode.py:350] batch 118/?, cuts processed until now is 1655
69
+ 2022-03-12 11:11:33,652 INFO [decode.py:350] batch 120/?, cuts processed until now is 1696
70
+ 2022-03-12 11:11:54,376 INFO [decode.py:350] batch 122/?, cuts processed until now is 1722
71
+ 2022-03-12 11:12:15,345 INFO [decode.py:350] batch 124/?, cuts processed until now is 1734
72
+ 2022-03-12 11:12:37,226 INFO [decode.py:350] batch 126/?, cuts processed until now is 1755
73
+ 2022-03-12 11:12:58,264 INFO [decode.py:350] batch 128/?, cuts processed until now is 1781
74
+ 2022-03-12 11:13:18,863 INFO [decode.py:350] batch 130/?, cuts processed until now is 1844
75
+ 2022-03-12 11:13:39,313 INFO [decode.py:350] batch 132/?, cuts processed until now is 1886
76
+ 2022-03-12 11:13:59,008 INFO [decode.py:350] batch 134/?, cuts processed until now is 1903
77
+ 2022-03-12 11:14:19,353 INFO [decode.py:350] batch 136/?, cuts processed until now is 1932
78
+ 2022-03-12 11:14:41,400 INFO [decode.py:350] batch 138/?, cuts processed until now is 1951
79
+ 2022-03-12 11:15:00,425 INFO [decode.py:350] batch 140/?, cuts processed until now is 1959
80
+ 2022-03-12 11:15:21,258 INFO [decode.py:350] batch 142/?, cuts processed until now is 2007
81
+ 2022-03-12 11:15:41,733 INFO [decode.py:350] batch 144/?, cuts processed until now is 2035
82
+ 2022-03-12 11:16:01,860 INFO [decode.py:350] batch 146/?, cuts processed until now is 2083
83
+ 2022-03-12 11:16:20,096 INFO [decode.py:350] batch 148/?, cuts processed until now is 2130
84
+ 2022-03-12 11:16:41,530 INFO [decode.py:350] batch 150/?, cuts processed until now is 2139
85
+ 2022-03-12 11:17:02,711 INFO [decode.py:350] batch 152/?, cuts processed until now is 2171
86
+ 2022-03-12 11:17:24,718 INFO [decode.py:350] batch 154/?, cuts processed until now is 2192
87
+ 2022-03-12 11:17:47,575 INFO [decode.py:350] batch 156/?, cuts processed until now is 2208
88
+ 2022-03-12 11:18:09,330 INFO [decode.py:350] batch 158/?, cuts processed until now is 2230
89
+ 2022-03-12 11:18:30,573 INFO [decode.py:350] batch 160/?, cuts processed until now is 2258
90
+ 2022-03-12 11:18:52,627 INFO [decode.py:350] batch 162/?, cuts processed until now is 2274
91
+ 2022-03-12 11:19:14,060 INFO [decode.py:350] batch 164/?, cuts processed until now is 2296
92
+ 2022-03-12 11:19:35,046 INFO [decode.py:350] batch 166/?, cuts processed until now is 2327
93
+ 2022-03-12 11:19:55,707 INFO [decode.py:350] batch 168/?, cuts processed until now is 2351
94
+ 2022-03-12 11:20:16,849 INFO [decode.py:350] batch 170/?, cuts processed until now is 2364
95
+ 2022-03-12 11:20:38,166 INFO [decode.py:350] batch 172/?, cuts processed until now is 2374
96
+ 2022-03-12 11:20:59,568 INFO [decode.py:350] batch 174/?, cuts processed until now is 2399
97
+ 2022-03-12 11:21:20,962 INFO [decode.py:350] batch 176/?, cuts processed until now is 2418
98
+ 2022-03-12 11:21:33,896 INFO [decode.py:350] batch 178/?, cuts processed until now is 2427
99
+ 2022-03-12 11:21:53,998 INFO [decode.py:350] batch 180/?, cuts processed until now is 2440
100
+ 2022-03-12 11:22:14,879 INFO [decode.py:350] batch 182/?, cuts processed until now is 2456
101
+ 2022-03-12 11:22:34,889 INFO [decode.py:350] batch 184/?, cuts processed until now is 2466
102
+ 2022-03-12 11:22:54,782 INFO [decode.py:350] batch 186/?, cuts processed until now is 2479
103
+ 2022-03-12 11:23:07,520 INFO [decode.py:350] batch 188/?, cuts processed until now is 2492
104
+ 2022-03-12 11:23:22,175 INFO [decode.py:350] batch 190/?, cuts processed until now is 2502
105
+ 2022-03-12 11:23:44,752 INFO [decode.py:350] batch 192/?, cuts processed until now is 2520
106
+ 2022-03-12 11:23:56,842 INFO [decode.py:350] batch 194/?, cuts processed until now is 2527
107
+ 2022-03-12 11:24:20,385 INFO [decode.py:350] batch 196/?, cuts processed until now is 2539
108
+ 2022-03-12 11:24:42,999 INFO [decode.py:350] batch 198/?, cuts processed until now is 2551
109
+ 2022-03-12 11:25:05,655 INFO [decode.py:350] batch 200/?, cuts processed until now is 2563
110
+ 2022-03-12 11:25:26,606 INFO [decode.py:350] batch 202/?, cuts processed until now is 2575
111
+ 2022-03-12 11:25:47,266 INFO [decode.py:350] batch 204/?, cuts processed until now is 2587
112
+ 2022-03-12 11:26:08,251 INFO [decode.py:350] batch 206/?, cuts processed until now is 2599
113
+ 2022-03-12 11:26:28,851 INFO [decode.py:350] batch 208/?, cuts processed until now is 2611
114
+ 2022-03-12 11:26:43,975 INFO [decode.py:350] batch 210/?, cuts processed until now is 2620
115
+ 2022-03-12 11:26:44,050 INFO [decode.py:367] The transcripts are stored in pruned_transducer_stateless/exp/beam_search/recogs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt
116
+ 2022-03-12 11:26:44,122 INFO [utils.py:406] [test-clean-beam_4] %WER 2.57% [1352 / 52576, 148 ins, 96 del, 1108 sub ]
117
+ 2022-03-12 11:26:44,290 INFO [decode.py:380] Wrote detailed error stats to pruned_transducer_stateless/exp/beam_search/errs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt
118
+ 2022-03-12 11:26:44,290 INFO [decode.py:397]
119
+ For test-clean, WER of different settings are:
120
+ beam_4 2.57 best for test-clean
121
+
122
+ 2022-03-12 11:26:54,972 INFO [decode.py:350] batch 0/?, cuts processed until now is 23
123
+ 2022-03-12 11:27:16,195 INFO [decode.py:350] batch 2/?, cuts processed until now is 71
124
+ 2022-03-12 11:27:38,170 INFO [decode.py:350] batch 4/?, cuts processed until now is 92
125
+ 2022-03-12 11:27:58,108 INFO [decode.py:350] batch 6/?, cuts processed until now is 134
126
+ 2022-03-12 11:28:20,849 INFO [decode.py:350] batch 8/?, cuts processed until now is 150
127
+ 2022-03-12 11:28:41,760 INFO [decode.py:350] batch 10/?, cuts processed until now is 190
128
+ 2022-03-12 11:29:00,884 INFO [decode.py:350] batch 12/?, cuts processed until now is 225
129
+ 2022-03-12 11:29:19,854 INFO [decode.py:350] batch 14/?, cuts processed until now is 240
130
+ 2022-03-12 11:29:41,220 INFO [decode.py:350] batch 16/?, cuts processed until now is 266
131
+ 2022-03-12 11:30:02,363 INFO [decode.py:350] batch 18/?, cuts processed until now is 296
132
+ 2022-03-12 11:30:24,441 INFO [decode.py:350] batch 20/?, cuts processed until now is 312
133
+ 2022-03-12 11:30:45,878 INFO [decode.py:350] batch 22/?, cuts processed until now is 360
134
+ 2022-03-12 11:31:06,952 INFO [decode.py:350] batch 24/?, cuts processed until now is 387
135
+ 2022-03-12 11:31:28,751 INFO [decode.py:350] batch 26/?, cuts processed until now is 406
136
+ 2022-03-12 11:31:49,615 INFO [decode.py:350] batch 28/?, cuts processed until now is 433
137
+ 2022-03-12 11:32:10,472 INFO [decode.py:350] batch 30/?, cuts processed until now is 457
138
+ 2022-03-12 11:32:31,274 INFO [decode.py:350] batch 32/?, cuts processed until now is 494
139
+ 2022-03-12 11:32:51,036 INFO [decode.py:350] batch 34/?, cuts processed until now is 540
140
+ 2022-03-12 11:33:11,445 INFO [decode.py:350] batch 36/?, cuts processed until now is 568
141
+ 2022-03-12 11:33:32,062 INFO [decode.py:350] batch 38/?, cuts processed until now is 587
142
+ 2022-03-12 11:33:53,106 INFO [decode.py:350] batch 40/?, cuts processed until now is 598
143
+ 2022-03-12 11:34:13,641 INFO [decode.py:350] batch 42/?, cuts processed until now is 640
144
+ 2022-03-12 11:34:34,043 INFO [decode.py:350] batch 44/?, cuts processed until now is 700
145
+ 2022-03-12 11:34:56,934 INFO [decode.py:350] batch 46/?, cuts processed until now is 715
146
+ 2022-03-12 11:35:18,342 INFO [decode.py:350] batch 48/?, cuts processed until now is 733
147
+ 2022-03-12 11:35:38,477 INFO [decode.py:350] batch 50/?, cuts processed until now is 749
148
+ 2022-03-12 11:35:59,900 INFO [decode.py:350] batch 52/?, cuts processed until now is 769
149
+ 2022-03-12 11:36:21,607 INFO [decode.py:350] batch 54/?, cuts processed until now is 801
150
+ 2022-03-12 11:36:42,295 INFO [decode.py:350] batch 56/?, cuts processed until now is 833
151
+ 2022-03-12 11:37:04,285 INFO [decode.py:350] batch 58/?, cuts processed until now is 853
152
+ 2022-03-12 11:37:24,515 INFO [decode.py:350] batch 60/?, cuts processed until now is 922
153
+ 2022-03-12 11:37:45,713 INFO [decode.py:350] batch 62/?, cuts processed until now is 950
154
+ 2022-03-12 11:38:05,940 INFO [decode.py:350] batch 64/?, cuts processed until now is 958
155
+ 2022-03-12 11:38:26,842 INFO [decode.py:350] batch 66/?, cuts processed until now is 992
156
+ 2022-03-12 11:38:47,610 INFO [decode.py:350] batch 68/?, cuts processed until now is 1046
157
+ 2022-03-12 11:39:07,817 INFO [decode.py:350] batch 70/?, cuts processed until now is 1074
158
+ 2022-03-12 11:39:28,864 INFO [decode.py:350] batch 72/?, cuts processed until now is 1119
159
+ 2022-03-12 11:39:49,104 INFO [decode.py:350] batch 74/?, cuts processed until now is 1188
160
+ 2022-03-12 11:40:08,976 INFO [decode.py:350] batch 76/?, cuts processed until now is 1203
161
+ 2022-03-12 11:40:31,042 INFO [decode.py:350] batch 78/?, cuts processed until now is 1243
162
+ 2022-03-12 11:40:52,023 INFO [decode.py:350] batch 80/?, cuts processed until now is 1274
163
+ 2022-03-12 11:41:12,438 INFO [decode.py:350] batch 82/?, cuts processed until now is 1310
164
+ 2022-03-12 11:41:34,603 INFO [decode.py:350] batch 84/?, cuts processed until now is 1320
165
+ 2022-03-12 11:41:55,527 INFO [decode.py:350] batch 86/?, cuts processed until now is 1343
166
+ 2022-03-12 11:42:16,343 INFO [decode.py:350] batch 88/?, cuts processed until now is 1377
167
+ 2022-03-12 11:42:36,855 INFO [decode.py:350] batch 90/?, cuts processed until now is 1422
168
+ 2022-03-12 11:42:57,891 INFO [decode.py:350] batch 92/?, cuts processed until now is 1448
169
+ 2022-03-12 11:43:17,981 INFO [decode.py:350] batch 94/?, cuts processed until now is 1514
170
+ 2022-03-12 11:43:39,115 INFO [decode.py:350] batch 96/?, cuts processed until now is 1547
171
+ 2022-03-12 11:43:55,583 INFO [decode.py:350] batch 98/?, cuts processed until now is 1594
172
+ 2022-03-12 11:44:16,346 INFO [decode.py:350] batch 100/?, cuts processed until now is 1614
173
+ 2022-03-12 11:44:38,224 INFO [decode.py:350] batch 102/?, cuts processed until now is 1631
174
+ 2022-03-12 11:44:59,387 INFO [decode.py:350] batch 104/?, cuts processed until now is 1660
175
+ 2022-03-12 11:45:20,489 INFO [decode.py:350] batch 106/?, cuts processed until now is 1686
176
+ 2022-03-12 11:45:41,687 INFO [decode.py:350] batch 108/?, cuts processed until now is 1716
177
+ 2022-03-12 11:46:02,391 INFO [decode.py:350] batch 110/?, cuts processed until now is 1774
178
+ 2022-03-12 11:46:23,077 INFO [decode.py:350] batch 112/?, cuts processed until now is 1812
179
+ 2022-03-12 11:46:44,114 INFO [decode.py:350] batch 114/?, cuts processed until now is 1849
180
+ 2022-03-12 11:47:04,529 INFO [decode.py:350] batch 116/?, cuts processed until now is 1872
181
+ 2022-03-12 11:47:25,747 INFO [decode.py:350] batch 118/?, cuts processed until now is 1894
182
+ 2022-03-12 11:47:47,161 INFO [decode.py:350] batch 120/?, cuts processed until now is 1938
183
+ 2022-03-12 11:48:08,431 INFO [decode.py:350] batch 122/?, cuts processed until now is 1968
184
+ 2022-03-12 11:48:29,146 INFO [decode.py:350] batch 124/?, cuts processed until now is 1982
185
+ 2022-03-12 11:48:50,911 INFO [decode.py:350] batch 126/?, cuts processed until now is 2007
186
+ 2022-03-12 11:49:11,791 INFO [decode.py:350] batch 128/?, cuts processed until now is 2037
187
+ 2022-03-12 11:49:32,080 INFO [decode.py:350] batch 130/?, cuts processed until now is 2105
188
+ 2022-03-12 11:49:52,952 INFO [decode.py:350] batch 132/?, cuts processed until now is 2152
189
+ 2022-03-12 11:50:13,781 INFO [decode.py:350] batch 134/?, cuts processed until now is 2172
190
+ 2022-03-12 11:50:34,792 INFO [decode.py:350] batch 136/?, cuts processed until now is 2206
191
+ 2022-03-12 11:50:56,870 INFO [decode.py:350] batch 138/?, cuts processed until now is 2228
192
+ 2022-03-12 11:51:17,397 INFO [decode.py:350] batch 140/?, cuts processed until now is 2238
193
+ 2022-03-12 11:51:37,832 INFO [decode.py:350] batch 142/?, cuts processed until now is 2290
194
+ 2022-03-12 11:51:58,088 INFO [decode.py:350] batch 144/?, cuts processed until now is 2321
195
+ 2022-03-12 11:52:12,763 INFO [decode.py:350] batch 146/?, cuts processed until now is 2353
196
+ 2022-03-12 11:52:32,891 INFO [decode.py:350] batch 148/?, cuts processed until now is 2410
197
+ 2022-03-12 11:52:52,410 INFO [decode.py:350] batch 150/?, cuts processed until now is 2420
198
+ 2022-03-12 11:53:13,471 INFO [decode.py:350] batch 152/?, cuts processed until now is 2456
199
+ 2022-03-12 11:53:33,642 INFO [decode.py:350] batch 154/?, cuts processed until now is 2479
200
+ 2022-03-12 11:53:53,848 INFO [decode.py:350] batch 156/?, cuts processed until now is 2496
201
+ 2022-03-12 11:54:06,923 INFO [decode.py:350] batch 158/?, cuts processed until now is 2513
202
+ 2022-03-12 11:54:28,841 INFO [decode.py:350] batch 160/?, cuts processed until now is 2531
203
+ 2022-03-12 11:54:49,589 INFO [decode.py:350] batch 162/?, cuts processed until now is 2555
204
+ 2022-03-12 11:55:10,974 INFO [decode.py:350] batch 164/?, cuts processed until now is 2587
205
+ 2022-03-12 11:55:31,494 INFO [decode.py:350] batch 166/?, cuts processed until now is 2621
206
+ 2022-03-12 11:55:53,283 INFO [decode.py:350] batch 168/?, cuts processed until now is 2650
207
+ 2022-03-12 11:56:06,760 INFO [decode.py:350] batch 170/?, cuts processed until now is 2661
208
+ 2022-03-12 11:56:28,910 INFO [decode.py:350] batch 172/?, cuts processed until now is 2673
209
+ 2022-03-12 11:56:50,212 INFO [decode.py:350] batch 174/?, cuts processed until now is 2698
210
+ 2022-03-12 11:57:12,133 INFO [decode.py:350] batch 176/?, cuts processed until now is 2721
211
+ 2022-03-12 11:57:33,733 INFO [decode.py:350] batch 178/?, cuts processed until now is 2737
212
+ 2022-03-12 11:57:48,955 INFO [decode.py:350] batch 180/?, cuts processed until now is 2758
213
+ 2022-03-12 11:58:10,384 INFO [decode.py:350] batch 182/?, cuts processed until now is 2770
214
+ 2022-03-12 11:58:31,137 INFO [decode.py:350] batch 184/?, cuts processed until now is 2786
215
+ 2022-03-12 11:58:51,057 INFO [decode.py:350] batch 186/?, cuts processed until now is 2805
216
+ 2022-03-12 11:59:11,045 INFO [decode.py:350] batch 188/?, cuts processed until now is 2817
217
+ 2022-03-12 11:59:22,444 INFO [decode.py:350] batch 190/?, cuts processed until now is 2825
218
+ 2022-03-12 11:59:40,563 INFO [decode.py:350] batch 192/?, cuts processed until now is 2843
219
+ 2022-03-12 12:00:03,480 INFO [decode.py:350] batch 194/?, cuts processed until now is 2857
220
+ 2022-03-12 12:00:25,593 INFO [decode.py:350] batch 196/?, cuts processed until now is 2871
221
+ 2022-03-12 12:00:47,356 INFO [decode.py:350] batch 198/?, cuts processed until now is 2885
222
+ 2022-03-12 12:01:08,797 INFO [decode.py:350] batch 200/?, cuts processed until now is 2899
223
+ 2022-03-12 12:01:29,826 INFO [decode.py:350] batch 202/?, cuts processed until now is 2913
224
+ 2022-03-12 12:01:50,130 INFO [decode.py:350] batch 204/?, cuts processed until now is 2927
225
+ 2022-03-12 12:02:07,524 INFO [decode.py:350] batch 206/?, cuts processed until now is 2939
226
+ 2022-03-12 12:02:07,603 INFO [decode.py:367] The transcripts are stored in pruned_transducer_stateless/exp/beam_search/recogs-test-other-beam_4-epoch-42-avg-11-beam-4.txt
227
+ 2022-03-12 12:02:07,674 INFO [utils.py:406] [test-other-beam_4] %WER 6.27% [3282 / 52343, 340 ins, 284 del, 2658 sub ]
228
+ 2022-03-12 12:02:07,845 INFO [decode.py:380] Wrote detailed error stats to pruned_transducer_stateless/exp/beam_search/errs-test-other-beam_4-epoch-42-avg-11-beam-4.txt
229
+ 2022-03-12 12:02:07,846 INFO [decode.py:397]
230
+ For test-other, WER of different settings are:
231
+ beam_4 6.27 best for test-other
232
+
233
+ 2022-03-12 12:02:07,846 INFO [decode.py:489] Done!
log/beam_search/recogs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/beam_search/recogs-test-other-beam_4-epoch-42-avg-11-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-other-beam_4-epoch-42-avg-11-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/log-decode-epoch-42-avg-11-beam-4-2022-03-12-10-30-00 ADDED
@@ -0,0 +1,233 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-03-12 10:30:00,617 INFO [decode.py:425] Decoding started
2
+ 2022-03-12 10:30:00,618 INFO [decode.py:431] Device: cuda:0
3
+ 2022-03-12 10:30:00,620 INFO [decode.py:440] {'feature_dim': 80, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'embedding_dim': 512, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '5ee082ea55f50e8bd42203ba266945ea5a236ab8', 'k2-git-date': 'Sun Feb 27 09:00:48 2022', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'master', 'icefall-git-sha1': 'ad62981-dirty', 'icefall-git-date': 'Fri Mar 4 15:38:23 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-pruned-rnnt', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-rnnt-ali/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-rnnt-ali/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 42, 'avg': 11, 'exp_dir': PosixPath('pruned_transducer_stateless/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'modified_beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless/exp/modified_beam_search'), 'suffix': 'epoch-42-avg-11-beam-4', 'blank_id': 0, 'vocab_size': 500}
4
+ 2022-03-12 10:30:00,620 INFO [decode.py:442] About to create model
5
+ 2022-03-12 10:30:01,108 INFO [decode.py:453] averaging ['pruned_transducer_stateless/exp/epoch-32.pt', 'pruned_transducer_stateless/exp/epoch-33.pt', 'pruned_transducer_stateless/exp/epoch-34.pt', 'pruned_transducer_stateless/exp/epoch-35.pt', 'pruned_transducer_stateless/exp/epoch-36.pt', 'pruned_transducer_stateless/exp/epoch-37.pt', 'pruned_transducer_stateless/exp/epoch-38.pt', 'pruned_transducer_stateless/exp/epoch-39.pt', 'pruned_transducer_stateless/exp/epoch-40.pt', 'pruned_transducer_stateless/exp/epoch-41.pt', 'pruned_transducer_stateless/exp/epoch-42.pt']
6
+ 2022-03-12 10:31:05,568 INFO [decode.py:462] Number of model parameters: 84514780
7
+ 2022-03-12 10:31:05,568 INFO [asr_datamodule.py:379] About to get test-clean cuts
8
+ 2022-03-12 10:31:05,674 INFO [asr_datamodule.py:384] About to get test-other cuts
9
+ 2022-03-12 10:31:07,304 INFO [decode.py:350] batch 0/?, cuts processed until now is 20
10
+ 2022-03-12 10:31:09,999 INFO [decode.py:350] batch 2/?, cuts processed until now is 64
11
+ 2022-03-12 10:31:12,557 INFO [decode.py:350] batch 4/?, cuts processed until now is 81
12
+ 2022-03-12 10:31:15,273 INFO [decode.py:350] batch 6/?, cuts processed until now is 121
13
+ 2022-03-12 10:31:17,751 INFO [decode.py:350] batch 8/?, cuts processed until now is 133
14
+ 2022-03-12 10:31:20,345 INFO [decode.py:350] batch 10/?, cuts processed until now is 168
15
+ 2022-03-12 10:31:22,776 INFO [decode.py:350] batch 12/?, cuts processed until now is 202
16
+ 2022-03-12 10:31:25,630 INFO [decode.py:350] batch 14/?, cuts processed until now is 217
17
+ 2022-03-12 10:31:28,361 INFO [decode.py:350] batch 16/?, cuts processed until now is 241
18
+ 2022-03-12 10:31:31,053 INFO [decode.py:350] batch 18/?, cuts processed until now is 267
19
+ 2022-03-12 10:31:33,895 INFO [decode.py:350] batch 20/?, cuts processed until now is 281
20
+ 2022-03-12 10:31:36,556 INFO [decode.py:350] batch 22/?, cuts processed until now is 325
21
+ 2022-03-12 10:31:39,266 INFO [decode.py:350] batch 24/?, cuts processed until now is 349
22
+ 2022-03-12 10:31:42,002 INFO [decode.py:350] batch 26/?, cuts processed until now is 366
23
+ 2022-03-12 10:31:44,658 INFO [decode.py:350] batch 28/?, cuts processed until now is 389
24
+ 2022-03-12 10:31:47,343 INFO [decode.py:350] batch 30/?, cuts processed until now is 410
25
+ 2022-03-12 10:31:49,978 INFO [decode.py:350] batch 32/?, cuts processed until now is 442
26
+ 2022-03-12 10:31:52,706 INFO [decode.py:350] batch 34/?, cuts processed until now is 474
27
+ 2022-03-12 10:31:55,376 INFO [decode.py:350] batch 36/?, cuts processed until now is 498
28
+ 2022-03-12 10:31:58,068 INFO [decode.py:350] batch 38/?, cuts processed until now is 514
29
+ 2022-03-12 10:32:00,767 INFO [decode.py:350] batch 40/?, cuts processed until now is 524
30
+ 2022-03-12 10:32:03,375 INFO [decode.py:350] batch 42/?, cuts processed until now is 564
31
+ 2022-03-12 10:32:06,063 INFO [decode.py:350] batch 44/?, cuts processed until now is 621
32
+ 2022-03-12 10:32:08,650 INFO [decode.py:350] batch 46/?, cuts processed until now is 633
33
+ 2022-03-12 10:32:11,191 INFO [decode.py:350] batch 48/?, cuts processed until now is 648
34
+ 2022-03-12 10:32:13,816 INFO [decode.py:350] batch 50/?, cuts processed until now is 662
35
+ 2022-03-12 10:32:16,366 INFO [decode.py:350] batch 52/?, cuts processed until now is 680
36
+ 2022-03-12 10:32:19,001 INFO [decode.py:350] batch 54/?, cuts processed until now is 708
37
+ 2022-03-12 10:32:21,489 INFO [decode.py:350] batch 56/?, cuts processed until now is 736
38
+ 2022-03-12 10:32:24,073 INFO [decode.py:350] batch 58/?, cuts processed until now is 752
39
+ 2022-03-12 10:32:26,740 INFO [decode.py:350] batch 60/?, cuts processed until now is 819
40
+ 2022-03-12 10:32:29,371 INFO [decode.py:350] batch 62/?, cuts processed until now is 843
41
+ 2022-03-12 10:32:31,988 INFO [decode.py:350] batch 64/?, cuts processed until now is 850
42
+ 2022-03-12 10:32:34,644 INFO [decode.py:350] batch 66/?, cuts processed until now is 880
43
+ 2022-03-12 10:32:37,252 INFO [decode.py:350] batch 68/?, cuts processed until now is 932
44
+ 2022-03-12 10:32:40,042 INFO [decode.py:350] batch 70/?, cuts processed until now is 957
45
+ 2022-03-12 10:32:42,698 INFO [decode.py:350] batch 72/?, cuts processed until now is 996
46
+ 2022-03-12 10:32:45,387 INFO [decode.py:350] batch 74/?, cuts processed until now is 1064
47
+ 2022-03-12 10:32:48,040 INFO [decode.py:350] batch 76/?, cuts processed until now is 1077
48
+ 2022-03-12 10:32:50,715 INFO [decode.py:350] batch 78/?, cuts processed until now is 1114
49
+ 2022-03-12 10:32:53,371 INFO [decode.py:350] batch 80/?, cuts processed until now is 1141
50
+ 2022-03-12 10:32:55,971 INFO [decode.py:350] batch 82/?, cuts processed until now is 1172
51
+ 2022-03-12 10:32:58,656 INFO [decode.py:350] batch 84/?, cuts processed until now is 1180
52
+ 2022-03-12 10:33:01,267 INFO [decode.py:350] batch 86/?, cuts processed until now is 1199
53
+ 2022-03-12 10:33:03,862 INFO [decode.py:350] batch 88/?, cuts processed until now is 1228
54
+ 2022-03-12 10:33:06,534 INFO [decode.py:350] batch 90/?, cuts processed until now is 1245
55
+ 2022-03-12 10:33:09,131 INFO [decode.py:350] batch 92/?, cuts processed until now is 1267
56
+ 2022-03-12 10:33:11,799 INFO [decode.py:350] batch 94/?, cuts processed until now is 1333
57
+ 2022-03-12 10:33:14,401 INFO [decode.py:350] batch 96/?, cuts processed until now is 1363
58
+ 2022-03-12 10:33:15,898 INFO [decode.py:350] batch 98/?, cuts processed until now is 1378
59
+ 2022-03-12 10:33:18,584 INFO [decode.py:350] batch 100/?, cuts processed until now is 1406
60
+ 2022-03-12 10:33:21,186 INFO [decode.py:350] batch 102/?, cuts processed until now is 1420
61
+ 2022-03-12 10:33:23,830 INFO [decode.py:350] batch 104/?, cuts processed until now is 1445
62
+ 2022-03-12 10:33:26,541 INFO [decode.py:350] batch 106/?, cuts processed until now is 1468
63
+ 2022-03-12 10:33:29,314 INFO [decode.py:350] batch 108/?, cuts processed until now is 1494
64
+ 2022-03-12 10:33:32,034 INFO [decode.py:350] batch 110/?, cuts processed until now is 1547
65
+ 2022-03-12 10:33:34,782 INFO [decode.py:350] batch 112/?, cuts processed until now is 1582
66
+ 2022-03-12 10:33:37,434 INFO [decode.py:350] batch 114/?, cuts processed until now is 1615
67
+ 2022-03-12 10:33:40,191 INFO [decode.py:350] batch 116/?, cuts processed until now is 1636
68
+ 2022-03-12 10:33:42,738 INFO [decode.py:350] batch 118/?, cuts processed until now is 1655
69
+ 2022-03-12 10:33:45,453 INFO [decode.py:350] batch 120/?, cuts processed until now is 1696
70
+ 2022-03-12 10:33:48,093 INFO [decode.py:350] batch 122/?, cuts processed until now is 1722
71
+ 2022-03-12 10:33:50,699 INFO [decode.py:350] batch 124/?, cuts processed until now is 1734
72
+ 2022-03-12 10:33:53,407 INFO [decode.py:350] batch 126/?, cuts processed until now is 1755
73
+ 2022-03-12 10:33:56,061 INFO [decode.py:350] batch 128/?, cuts processed until now is 1781
74
+ 2022-03-12 10:33:58,718 INFO [decode.py:350] batch 130/?, cuts processed until now is 1844
75
+ 2022-03-12 10:34:01,372 INFO [decode.py:350] batch 132/?, cuts processed until now is 1886
76
+ 2022-03-12 10:34:03,892 INFO [decode.py:350] batch 134/?, cuts processed until now is 1903
77
+ 2022-03-12 10:34:06,488 INFO [decode.py:350] batch 136/?, cuts processed until now is 1932
78
+ 2022-03-12 10:34:09,236 INFO [decode.py:350] batch 138/?, cuts processed until now is 1951
79
+ 2022-03-12 10:34:11,636 INFO [decode.py:350] batch 140/?, cuts processed until now is 1959
80
+ 2022-03-12 10:34:14,292 INFO [decode.py:350] batch 142/?, cuts processed until now is 2007
81
+ 2022-03-12 10:34:16,847 INFO [decode.py:350] batch 144/?, cuts processed until now is 2035
82
+ 2022-03-12 10:34:19,432 INFO [decode.py:350] batch 146/?, cuts processed until now is 2083
83
+ 2022-03-12 10:34:21,887 INFO [decode.py:350] batch 148/?, cuts processed until now is 2130
84
+ 2022-03-12 10:34:24,536 INFO [decode.py:350] batch 150/?, cuts processed until now is 2139
85
+ 2022-03-12 10:34:27,230 INFO [decode.py:350] batch 152/?, cuts processed until now is 2171
86
+ 2022-03-12 10:34:30,015 INFO [decode.py:350] batch 154/?, cuts processed until now is 2192
87
+ 2022-03-12 10:34:32,861 INFO [decode.py:350] batch 156/?, cuts processed until now is 2208
88
+ 2022-03-12 10:34:35,620 INFO [decode.py:350] batch 158/?, cuts processed until now is 2230
89
+ 2022-03-12 10:34:38,338 INFO [decode.py:350] batch 160/?, cuts processed until now is 2258
90
+ 2022-03-12 10:34:41,123 INFO [decode.py:350] batch 162/?, cuts processed until now is 2274
91
+ 2022-03-12 10:34:43,841 INFO [decode.py:350] batch 164/?, cuts processed until now is 2296
92
+ 2022-03-12 10:34:46,550 INFO [decode.py:350] batch 166/?, cuts processed until now is 2327
93
+ 2022-03-12 10:34:49,185 INFO [decode.py:350] batch 168/?, cuts processed until now is 2351
94
+ 2022-03-12 10:34:51,840 INFO [decode.py:350] batch 170/?, cuts processed until now is 2364
95
+ 2022-03-12 10:34:54,516 INFO [decode.py:350] batch 172/?, cuts processed until now is 2374
96
+ 2022-03-12 10:34:57,176 INFO [decode.py:350] batch 174/?, cuts processed until now is 2399
97
+ 2022-03-12 10:34:59,842 INFO [decode.py:350] batch 176/?, cuts processed until now is 2418
98
+ 2022-03-12 10:35:01,466 INFO [decode.py:350] batch 178/?, cuts processed until now is 2427
99
+ 2022-03-12 10:35:04,016 INFO [decode.py:350] batch 180/?, cuts processed until now is 2440
100
+ 2022-03-12 10:35:06,622 INFO [decode.py:350] batch 182/?, cuts processed until now is 2456
101
+ 2022-03-12 10:35:09,103 INFO [decode.py:350] batch 184/?, cuts processed until now is 2466
102
+ 2022-03-12 10:35:11,598 INFO [decode.py:350] batch 186/?, cuts processed until now is 2479
103
+ 2022-03-12 10:35:13,211 INFO [decode.py:350] batch 188/?, cuts processed until now is 2492
104
+ 2022-03-12 10:35:15,029 INFO [decode.py:350] batch 190/?, cuts processed until now is 2502
105
+ 2022-03-12 10:35:17,827 INFO [decode.py:350] batch 192/?, cuts processed until now is 2520
106
+ 2022-03-12 10:35:19,358 INFO [decode.py:350] batch 194/?, cuts processed until now is 2527
107
+ 2022-03-12 10:35:22,221 INFO [decode.py:350] batch 196/?, cuts processed until now is 2539
108
+ 2022-03-12 10:35:25,019 INFO [decode.py:350] batch 198/?, cuts processed until now is 2551
109
+ 2022-03-12 10:35:27,811 INFO [decode.py:350] batch 200/?, cuts processed until now is 2563
110
+ 2022-03-12 10:35:30,485 INFO [decode.py:350] batch 202/?, cuts processed until now is 2575
111
+ 2022-03-12 10:35:33,081 INFO [decode.py:350] batch 204/?, cuts processed until now is 2587
112
+ 2022-03-12 10:35:35,665 INFO [decode.py:350] batch 206/?, cuts processed until now is 2599
113
+ 2022-03-12 10:35:38,217 INFO [decode.py:350] batch 208/?, cuts processed until now is 2611
114
+ 2022-03-12 10:35:40,107 INFO [decode.py:350] batch 210/?, cuts processed until now is 2620
115
+ 2022-03-12 10:35:40,177 INFO [decode.py:367] The transcripts are stored in pruned_transducer_stateless/exp/modified_beam_search/recogs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt
116
+ 2022-03-12 10:35:40,245 INFO [utils.py:406] [test-clean-beam_4] %WER 2.56% [1347 / 52576, 147 ins, 94 del, 1106 sub ]
117
+ 2022-03-12 10:35:40,410 INFO [decode.py:380] Wrote detailed error stats to pruned_transducer_stateless/exp/modified_beam_search/errs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt
118
+ 2022-03-12 10:35:40,411 INFO [decode.py:397]
119
+ For test-clean, WER of different settings are:
120
+ beam_4 2.56 best for test-clean
121
+
122
+ 2022-03-12 10:35:41,914 INFO [decode.py:350] batch 0/?, cuts processed until now is 23
123
+ 2022-03-12 10:35:44,619 INFO [decode.py:350] batch 2/?, cuts processed until now is 71
124
+ 2022-03-12 10:35:47,392 INFO [decode.py:350] batch 4/?, cuts processed until now is 92
125
+ 2022-03-12 10:35:49,999 INFO [decode.py:350] batch 6/?, cuts processed until now is 134
126
+ 2022-03-12 10:35:52,776 INFO [decode.py:350] batch 8/?, cuts processed until now is 150
127
+ 2022-03-12 10:35:55,455 INFO [decode.py:350] batch 10/?, cuts processed until now is 190
128
+ 2022-03-12 10:35:57,864 INFO [decode.py:350] batch 12/?, cuts processed until now is 225
129
+ 2022-03-12 10:36:00,236 INFO [decode.py:350] batch 14/?, cuts processed until now is 240
130
+ 2022-03-12 10:36:02,881 INFO [decode.py:350] batch 16/?, cuts processed until now is 266
131
+ 2022-03-12 10:36:05,602 INFO [decode.py:350] batch 18/?, cuts processed until now is 296
132
+ 2022-03-12 10:36:08,319 INFO [decode.py:350] batch 20/?, cuts processed until now is 312
133
+ 2022-03-12 10:36:11,037 INFO [decode.py:350] batch 22/?, cuts processed until now is 360
134
+ 2022-03-12 10:36:13,680 INFO [decode.py:350] batch 24/?, cuts processed until now is 387
135
+ 2022-03-12 10:36:16,473 INFO [decode.py:350] batch 26/?, cuts processed until now is 406
136
+ 2022-03-12 10:36:19,178 INFO [decode.py:350] batch 28/?, cuts processed until now is 433
137
+ 2022-03-12 10:36:21,814 INFO [decode.py:350] batch 30/?, cuts processed until now is 457
138
+ 2022-03-12 10:36:24,515 INFO [decode.py:350] batch 32/?, cuts processed until now is 494
139
+ 2022-03-12 10:36:27,176 INFO [decode.py:350] batch 34/?, cuts processed until now is 540
140
+ 2022-03-12 10:36:29,854 INFO [decode.py:350] batch 36/?, cuts processed until now is 568
141
+ 2022-03-12 10:36:32,532 INFO [decode.py:350] batch 38/?, cuts processed until now is 587
142
+ 2022-03-12 10:36:35,192 INFO [decode.py:350] batch 40/?, cuts processed until now is 598
143
+ 2022-03-12 10:36:37,787 INFO [decode.py:350] batch 42/?, cuts processed until now is 640
144
+ 2022-03-12 10:36:40,445 INFO [decode.py:350] batch 44/?, cuts processed until now is 700
145
+ 2022-03-12 10:36:43,270 INFO [decode.py:350] batch 46/?, cuts processed until now is 715
146
+ 2022-03-12 10:36:45,989 INFO [decode.py:350] batch 48/?, cuts processed until now is 733
147
+ 2022-03-12 10:36:48,512 INFO [decode.py:350] batch 50/?, cuts processed until now is 749
148
+ 2022-03-12 10:36:51,172 INFO [decode.py:350] batch 52/?, cuts processed until now is 769
149
+ 2022-03-12 10:36:53,899 INFO [decode.py:350] batch 54/?, cuts processed until now is 801
150
+ 2022-03-12 10:36:56,528 INFO [decode.py:350] batch 56/?, cuts processed until now is 833
151
+ 2022-03-12 10:36:59,242 INFO [decode.py:350] batch 58/?, cuts processed until now is 853
152
+ 2022-03-12 10:37:01,896 INFO [decode.py:350] batch 60/?, cuts processed until now is 922
153
+ 2022-03-12 10:37:04,587 INFO [decode.py:350] batch 62/?, cuts processed until now is 950
154
+ 2022-03-12 10:37:07,098 INFO [decode.py:350] batch 64/?, cuts processed until now is 958
155
+ 2022-03-12 10:37:09,763 INFO [decode.py:350] batch 66/?, cuts processed until now is 992
156
+ 2022-03-12 10:37:12,431 INFO [decode.py:350] batch 68/?, cuts processed until now is 1046
157
+ 2022-03-12 10:37:14,997 INFO [decode.py:350] batch 70/?, cuts processed until now is 1074
158
+ 2022-03-12 10:37:17,707 INFO [decode.py:350] batch 72/?, cuts processed until now is 1119
159
+ 2022-03-12 10:37:20,377 INFO [decode.py:350] batch 74/?, cuts processed until now is 1188
160
+ 2022-03-12 10:37:22,879 INFO [decode.py:350] batch 76/?, cuts processed until now is 1203
161
+ 2022-03-12 10:37:25,750 INFO [decode.py:350] batch 78/?, cuts processed until now is 1243
162
+ 2022-03-12 10:37:28,480 INFO [decode.py:350] batch 80/?, cuts processed until now is 1274
163
+ 2022-03-12 10:37:31,128 INFO [decode.py:350] batch 82/?, cuts processed until now is 1310
164
+ 2022-03-12 10:37:33,922 INFO [decode.py:350] batch 84/?, cuts processed until now is 1320
165
+ 2022-03-12 10:37:36,608 INFO [decode.py:350] batch 86/?, cuts processed until now is 1343
166
+ 2022-03-12 10:37:39,294 INFO [decode.py:350] batch 88/?, cuts processed until now is 1377
167
+ 2022-03-12 10:37:41,977 INFO [decode.py:350] batch 90/?, cuts processed until now is 1422
168
+ 2022-03-12 10:37:44,672 INFO [decode.py:350] batch 92/?, cuts processed until now is 1448
169
+ 2022-03-12 10:37:47,357 INFO [decode.py:350] batch 94/?, cuts processed until now is 1514
170
+ 2022-03-12 10:37:50,046 INFO [decode.py:350] batch 96/?, cuts processed until now is 1547
171
+ 2022-03-12 10:37:52,201 INFO [decode.py:350] batch 98/?, cuts processed until now is 1594
172
+ 2022-03-12 10:37:54,808 INFO [decode.py:350] batch 100/?, cuts processed until now is 1614
173
+ 2022-03-12 10:37:57,561 INFO [decode.py:350] batch 102/?, cuts processed until now is 1631
174
+ 2022-03-12 10:38:00,255 INFO [decode.py:350] batch 104/?, cuts processed until now is 1660
175
+ 2022-03-12 10:38:02,929 INFO [decode.py:350] batch 106/?, cuts processed until now is 1686
176
+ 2022-03-12 10:38:05,592 INFO [decode.py:350] batch 108/?, cuts processed until now is 1716
177
+ 2022-03-12 10:38:08,308 INFO [decode.py:350] batch 110/?, cuts processed until now is 1774
178
+ 2022-03-12 10:38:10,984 INFO [decode.py:350] batch 112/?, cuts processed until now is 1812
179
+ 2022-03-12 10:38:13,699 INFO [decode.py:350] batch 114/?, cuts processed until now is 1849
180
+ 2022-03-12 10:38:16,280 INFO [decode.py:350] batch 116/?, cuts processed until now is 1872
181
+ 2022-03-12 10:38:18,933 INFO [decode.py:350] batch 118/?, cuts processed until now is 1894
182
+ 2022-03-12 10:38:21,658 INFO [decode.py:350] batch 120/?, cuts processed until now is 1938
183
+ 2022-03-12 10:38:24,364 INFO [decode.py:350] batch 122/?, cuts processed until now is 1968
184
+ 2022-03-12 10:38:27,049 INFO [decode.py:350] batch 124/?, cuts processed until now is 1982
185
+ 2022-03-12 10:38:29,798 INFO [decode.py:350] batch 126/?, cuts processed until now is 2007
186
+ 2022-03-12 10:38:32,492 INFO [decode.py:350] batch 128/?, cuts processed until now is 2037
187
+ 2022-03-12 10:38:35,185 INFO [decode.py:350] batch 130/?, cuts processed until now is 2105
188
+ 2022-03-12 10:38:37,860 INFO [decode.py:350] batch 132/?, cuts processed until now is 2152
189
+ 2022-03-12 10:38:40,479 INFO [decode.py:350] batch 134/?, cuts processed until now is 2172
190
+ 2022-03-12 10:38:43,171 INFO [decode.py:350] batch 136/?, cuts processed until now is 2206
191
+ 2022-03-12 10:38:45,889 INFO [decode.py:350] batch 138/?, cuts processed until now is 2228
192
+ 2022-03-12 10:38:48,438 INFO [decode.py:350] batch 140/?, cuts processed until now is 2238
193
+ 2022-03-12 10:38:51,098 INFO [decode.py:350] batch 142/?, cuts processed until now is 2290
194
+ 2022-03-12 10:38:53,686 INFO [decode.py:350] batch 144/?, cuts processed until now is 2321
195
+ 2022-03-12 10:38:55,595 INFO [decode.py:350] batch 146/?, cuts processed until now is 2353
196
+ 2022-03-12 10:38:58,263 INFO [decode.py:350] batch 148/?, cuts processed until now is 2410
197
+ 2022-03-12 10:39:00,714 INFO [decode.py:350] batch 150/?, cuts processed until now is 2420
198
+ 2022-03-12 10:39:03,395 INFO [decode.py:350] batch 152/?, cuts processed until now is 2456
199
+ 2022-03-12 10:39:05,919 INFO [decode.py:350] batch 154/?, cuts processed until now is 2479
200
+ 2022-03-12 10:39:08,477 INFO [decode.py:350] batch 156/?, cuts processed until now is 2496
201
+ 2022-03-12 10:39:10,151 INFO [decode.py:350] batch 158/?, cuts processed until now is 2513
202
+ 2022-03-12 10:39:12,895 INFO [decode.py:350] batch 160/?, cuts processed until now is 2531
203
+ 2022-03-12 10:39:15,488 INFO [decode.py:350] batch 162/?, cuts processed until now is 2555
204
+ 2022-03-12 10:39:18,177 INFO [decode.py:350] batch 164/?, cuts processed until now is 2587
205
+ 2022-03-12 10:39:20,766 INFO [decode.py:350] batch 166/?, cuts processed until now is 2621
206
+ 2022-03-12 10:39:23,468 INFO [decode.py:350] batch 168/?, cuts processed until now is 2650
207
+ 2022-03-12 10:39:25,192 INFO [decode.py:350] batch 170/?, cuts processed until now is 2661
208
+ 2022-03-12 10:39:27,946 INFO [decode.py:350] batch 172/?, cuts processed until now is 2673
209
+ 2022-03-12 10:39:30,669 INFO [decode.py:350] batch 174/?, cuts processed until now is 2698
210
+ 2022-03-12 10:39:33,397 INFO [decode.py:350] batch 176/?, cuts processed until now is 2721
211
+ 2022-03-12 10:39:36,081 INFO [decode.py:350] batch 178/?, cuts processed until now is 2737
212
+ 2022-03-12 10:39:38,022 INFO [decode.py:350] batch 180/?, cuts processed until now is 2758
213
+ 2022-03-12 10:39:40,679 INFO [decode.py:350] batch 182/?, cuts processed until now is 2770
214
+ 2022-03-12 10:39:43,284 INFO [decode.py:350] batch 184/?, cuts processed until now is 2786
215
+ 2022-03-12 10:39:45,808 INFO [decode.py:350] batch 186/?, cuts processed until now is 2805
216
+ 2022-03-12 10:39:48,348 INFO [decode.py:350] batch 188/?, cuts processed until now is 2817
217
+ 2022-03-12 10:39:49,783 INFO [decode.py:350] batch 190/?, cuts processed until now is 2825
218
+ 2022-03-12 10:39:52,078 INFO [decode.py:350] batch 192/?, cuts processed until now is 2843
219
+ 2022-03-12 10:39:54,939 INFO [decode.py:350] batch 194/?, cuts processed until now is 2857
220
+ 2022-03-12 10:39:57,738 INFO [decode.py:350] batch 196/?, cuts processed until now is 2871
221
+ 2022-03-12 10:40:00,481 INFO [decode.py:350] batch 198/?, cuts processed until now is 2885
222
+ 2022-03-12 10:40:03,163 INFO [decode.py:350] batch 200/?, cuts processed until now is 2899
223
+ 2022-03-12 10:40:05,796 INFO [decode.py:350] batch 202/?, cuts processed until now is 2913
224
+ 2022-03-12 10:40:08,403 INFO [decode.py:350] batch 204/?, cuts processed until now is 2927
225
+ 2022-03-12 10:40:10,658 INFO [decode.py:350] batch 206/?, cuts processed until now is 2939
226
+ 2022-03-12 10:40:10,729 INFO [decode.py:367] The transcripts are stored in pruned_transducer_stateless/exp/modified_beam_search/recogs-test-other-beam_4-epoch-42-avg-11-beam-4.txt
227
+ 2022-03-12 10:40:10,806 INFO [utils.py:406] [test-other-beam_4] %WER 6.27% [3282 / 52343, 333 ins, 289 del, 2660 sub ]
228
+ 2022-03-12 10:40:11,006 INFO [decode.py:380] Wrote detailed error stats to pruned_transducer_stateless/exp/modified_beam_search/errs-test-other-beam_4-epoch-42-avg-11-beam-4.txt
229
+ 2022-03-12 10:40:11,007 INFO [decode.py:397]
230
+ For test-other, WER of different settings are:
231
+ beam_4 6.27 best for test-other
232
+
233
+ 2022-03-12 10:40:11,007 INFO [decode.py:489] Done!
log/log-decode-epoch-42-avg-11-context-2-max-sym-per-frame-1-2022-03-12-10-50-03 ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-03-12 10:50:03,877 INFO [decode.py:425] Decoding started
2
+ 2022-03-12 10:50:03,877 INFO [decode.py:431] Device: cuda:0
3
+ 2022-03-12 10:50:03,879 INFO [decode.py:440] {'feature_dim': 80, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'embedding_dim': 512, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '5ee082ea55f50e8bd42203ba266945ea5a236ab8', 'k2-git-date': 'Sun Feb 27 09:00:48 2022', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-beam-search-for-pruned-rnnt', 'icefall-git-sha1': 'bd033de-clean', 'icefall-git-date': 'Sat Mar 12 10:42:25 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-pruned-rnnt', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-rnnt-ali/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-rnnt-ali/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 42, 'avg': 11, 'exp_dir': PosixPath('pruned_transducer_stateless/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 1, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless/exp/greedy_search'), 'suffix': 'epoch-42-avg-11-context-2-max-sym-per-frame-1', 'blank_id': 0, 'vocab_size': 500}
4
+ 2022-03-12 10:50:03,879 INFO [decode.py:442] About to create model
5
+ 2022-03-12 10:50:04,362 INFO [decode.py:453] averaging ['pruned_transducer_stateless/exp/epoch-32.pt', 'pruned_transducer_stateless/exp/epoch-33.pt', 'pruned_transducer_stateless/exp/epoch-34.pt', 'pruned_transducer_stateless/exp/epoch-35.pt', 'pruned_transducer_stateless/exp/epoch-36.pt', 'pruned_transducer_stateless/exp/epoch-37.pt', 'pruned_transducer_stateless/exp/epoch-38.pt', 'pruned_transducer_stateless/exp/epoch-39.pt', 'pruned_transducer_stateless/exp/epoch-40.pt', 'pruned_transducer_stateless/exp/epoch-41.pt', 'pruned_transducer_stateless/exp/epoch-42.pt']
6
+ 2022-03-12 10:50:16,152 INFO [decode.py:462] Number of model parameters: 84514780
7
+ 2022-03-12 10:50:16,152 INFO [asr_datamodule.py:379] About to get test-clean cuts
8
+ 2022-03-12 10:50:16,254 INFO [asr_datamodule.py:384] About to get test-other cuts
9
+ 2022-03-12 10:50:17,332 INFO [decode.py:350] batch 0/?, cuts processed until now is 20
10
+ 2022-03-12 10:51:34,592 INFO [decode.py:350] batch 100/?, cuts processed until now is 1406
11
+ 2022-03-12 10:52:50,773 INFO [decode.py:350] batch 200/?, cuts processed until now is 2563
12
+ 2022-03-12 10:52:57,884 INFO [decode.py:367] The transcripts are stored in pruned_transducer_stateless/exp/greedy_search/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt
13
+ 2022-03-12 10:52:57,952 INFO [utils.py:406] [test-clean-greedy_search] %WER 2.62% [1380 / 52576, 147 ins, 117 del, 1116 sub ]
14
+ 2022-03-12 10:52:58,118 INFO [decode.py:380] Wrote detailed error stats to pruned_transducer_stateless/exp/greedy_search/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt
15
+ 2022-03-12 10:52:58,119 INFO [decode.py:397]
16
+ For test-clean, WER of different settings are:
17
+ greedy_search 2.62 best for test-clean
18
+
19
+ 2022-03-12 10:52:59,060 INFO [decode.py:350] batch 0/?, cuts processed until now is 23
20
+ 2022-03-12 10:54:17,250 INFO [decode.py:350] batch 100/?, cuts processed until now is 1614
21
+ 2022-03-12 10:55:33,934 INFO [decode.py:350] batch 200/?, cuts processed until now is 2899
22
+ 2022-03-12 10:55:38,381 INFO [decode.py:367] The transcripts are stored in pruned_transducer_stateless/exp/greedy_search/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt
23
+ 2022-03-12 10:55:38,454 INFO [utils.py:406] [test-other-greedy_search] %WER 6.37% [3333 / 52343, 324 ins, 330 del, 2679 sub ]
24
+ 2022-03-12 10:55:38,628 INFO [decode.py:380] Wrote detailed error stats to pruned_transducer_stateless/exp/greedy_search/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt
25
+ 2022-03-12 10:55:38,629 INFO [decode.py:397]
26
+ For test-other, WER of different settings are:
27
+ greedy_search 6.37 best for test-other
28
+
29
+ 2022-03-12 10:55:38,629 INFO [decode.py:489] Done!
log/log-decode-epoch-42-avg-11-context-2-max-sym-per-frame-2-2022-03-12-10-56-46 ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-03-12 10:56:46,784 INFO [decode.py:425] Decoding started
2
+ 2022-03-12 10:56:46,784 INFO [decode.py:431] Device: cuda:0
3
+ 2022-03-12 10:56:46,786 INFO [decode.py:440] {'feature_dim': 80, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'embedding_dim': 512, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '5ee082ea55f50e8bd42203ba266945ea5a236ab8', 'k2-git-date': 'Sun Feb 27 09:00:48 2022', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-beam-search-for-pruned-rnnt', 'icefall-git-sha1': 'bd033de-clean', 'icefall-git-date': 'Sat Mar 12 10:42:25 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-pruned-rnnt', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-rnnt-ali/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-rnnt-ali/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 42, 'avg': 11, 'exp_dir': PosixPath('pruned_transducer_stateless/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 2, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless/exp/greedy_search'), 'suffix': 'epoch-42-avg-11-context-2-max-sym-per-frame-2', 'blank_id': 0, 'vocab_size': 500}
4
+ 2022-03-12 10:56:46,786 INFO [decode.py:442] About to create model
5
+ 2022-03-12 10:56:47,289 INFO [decode.py:453] averaging ['pruned_transducer_stateless/exp/epoch-32.pt', 'pruned_transducer_stateless/exp/epoch-33.pt', 'pruned_transducer_stateless/exp/epoch-34.pt', 'pruned_transducer_stateless/exp/epoch-35.pt', 'pruned_transducer_stateless/exp/epoch-36.pt', 'pruned_transducer_stateless/exp/epoch-37.pt', 'pruned_transducer_stateless/exp/epoch-38.pt', 'pruned_transducer_stateless/exp/epoch-39.pt', 'pruned_transducer_stateless/exp/epoch-40.pt', 'pruned_transducer_stateless/exp/epoch-41.pt', 'pruned_transducer_stateless/exp/epoch-42.pt']
6
+ 2022-03-12 10:57:53,821 INFO [decode.py:462] Number of model parameters: 84514780
7
+ 2022-03-12 10:57:53,822 INFO [asr_datamodule.py:379] About to get test-clean cuts
8
+ 2022-03-12 10:57:53,952 INFO [asr_datamodule.py:384] About to get test-other cuts
9
+ 2022-03-12 10:57:55,219 INFO [decode.py:350] batch 0/?, cuts processed until now is 20
10
+ 2022-03-12 10:59:24,003 INFO [decode.py:350] batch 100/?, cuts processed until now is 1406
11
+ 2022-03-12 11:00:51,007 INFO [decode.py:350] batch 200/?, cuts processed until now is 2563
12
+ 2022-03-12 11:00:59,257 INFO [decode.py:367] The transcripts are stored in pruned_transducer_stateless/exp/greedy_search/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt
13
+ 2022-03-12 11:00:59,331 INFO [utils.py:406] [test-clean-greedy_search] %WER 2.62% [1380 / 52576, 147 ins, 115 del, 1118 sub ]
14
+ 2022-03-12 11:00:59,498 INFO [decode.py:380] Wrote detailed error stats to pruned_transducer_stateless/exp/greedy_search/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt
15
+ 2022-03-12 11:00:59,499 INFO [decode.py:397]
16
+ For test-clean, WER of different settings are:
17
+ greedy_search 2.62 best for test-clean
18
+
19
+ 2022-03-12 11:01:00,615 INFO [decode.py:350] batch 0/?, cuts processed until now is 23
20
+ 2022-03-12 11:02:28,395 INFO [decode.py:350] batch 100/?, cuts processed until now is 1614
21
+ 2022-03-12 11:03:52,897 INFO [decode.py:350] batch 200/?, cuts processed until now is 2899
22
+ 2022-03-12 11:03:57,774 INFO [decode.py:367] The transcripts are stored in pruned_transducer_stateless/exp/greedy_search/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt
23
+ 2022-03-12 11:03:57,863 INFO [utils.py:406] [test-other-greedy_search] %WER 6.37% [3334 / 52343, 326 ins, 326 del, 2682 sub ]
24
+ 2022-03-12 11:03:58,039 INFO [decode.py:380] Wrote detailed error stats to pruned_transducer_stateless/exp/greedy_search/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt
25
+ 2022-03-12 11:03:58,040 INFO [decode.py:397]
26
+ For test-other, WER of different settings are:
27
+ greedy_search 6.37 best for test-other
28
+
29
+ 2022-03-12 11:03:58,040 INFO [decode.py:489] Done!
log/log-decode-epoch-42-avg-11-context-2-max-sym-per-frame-3-2022-03-11-18-36-33 ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-03-11 18:36:33,290 INFO [decode.py:405] Decoding started
2
+ 2022-03-11 18:36:33,290 INFO [decode.py:411] Device: cuda:0
3
+ 2022-03-11 18:36:33,292 INFO [decode.py:420] {'feature_dim': 80, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'embedding_dim': 512, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '5ee082ea55f50e8bd42203ba266945ea5a236ab8', 'k2-git-date': 'Sun Feb 27 09:00:48 2022', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'master', 'icefall-git-sha1': 'ad62981-clean', 'icefall-git-date': 'Fri Mar 4 15:38:23 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-pruned-rnnt', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-rnnt-ali/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-rnnt-ali/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 42, 'avg': 11, 'exp_dir': PosixPath('pruned_transducer_stateless/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless/exp/greedy_search'), 'suffix': 'epoch-42-avg-11-context-2-max-sym-per-frame-3', 'blank_id': 0, 'vocab_size': 500}
4
+ 2022-03-11 18:36:33,292 INFO [decode.py:422] About to create model
5
+ 2022-03-11 18:36:33,827 INFO [decode.py:433] averaging ['pruned_transducer_stateless/exp/epoch-32.pt', 'pruned_transducer_stateless/exp/epoch-33.pt', 'pruned_transducer_stateless/exp/epoch-34.pt', 'pruned_transducer_stateless/exp/epoch-35.pt', 'pruned_transducer_stateless/exp/epoch-36.pt', 'pruned_transducer_stateless/exp/epoch-37.pt', 'pruned_transducer_stateless/exp/epoch-38.pt', 'pruned_transducer_stateless/exp/epoch-39.pt', 'pruned_transducer_stateless/exp/epoch-40.pt', 'pruned_transducer_stateless/exp/epoch-41.pt', 'pruned_transducer_stateless/exp/epoch-42.pt']
6
+ 2022-03-11 18:36:48,445 INFO [decode.py:442] Number of model parameters: 84514780
7
+ 2022-03-11 18:36:48,445 INFO [asr_datamodule.py:379] About to get test-clean cuts
8
+ 2022-03-11 18:36:48,545 INFO [asr_datamodule.py:384] About to get test-other cuts
9
+ 2022-03-11 18:36:50,037 INFO [decode.py:334] batch 0/?, cuts processed until now is 20
10
+ 2022-03-11 18:38:27,402 INFO [decode.py:334] batch 100/?, cuts processed until now is 1406
11
+ 2022-03-11 18:40:10,870 INFO [decode.py:334] batch 200/?, cuts processed until now is 2563
12
+ 2022-03-11 18:40:20,541 INFO [decode.py:351] The transcripts are stored in pruned_transducer_stateless/exp/greedy_search/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt
13
+ 2022-03-11 18:40:20,607 INFO [utils.py:406] [test-clean-greedy_search] %WER 2.62% [1380 / 52576, 147 ins, 115 del, 1118 sub ]
14
+ 2022-03-11 18:40:20,807 INFO [decode.py:364] Wrote detailed error stats to pruned_transducer_stateless/exp/greedy_search/errs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt
15
+ 2022-03-11 18:40:20,808 INFO [decode.py:381]
16
+ For test-clean, WER of different settings are:
17
+ greedy_search 2.62 best for test-clean
18
+
19
+ 2022-03-11 18:40:22,118 INFO [decode.py:334] batch 0/?, cuts processed until now is 23
20
+ 2022-03-11 18:42:07,004 INFO [decode.py:334] batch 100/?, cuts processed until now is 1614
21
+ 2022-03-11 18:43:49,356 INFO [decode.py:334] batch 200/?, cuts processed until now is 2899
22
+ 2022-03-11 18:43:55,246 INFO [decode.py:351] The transcripts are stored in pruned_transducer_stateless/exp/greedy_search/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt
23
+ 2022-03-11 18:43:55,319 INFO [utils.py:406] [test-other-greedy_search] %WER 6.37% [3334 / 52343, 326 ins, 326 del, 2682 sub ]
24
+ 2022-03-11 18:43:55,499 INFO [decode.py:364] Wrote detailed error stats to pruned_transducer_stateless/exp/greedy_search/errs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt
25
+ 2022-03-11 18:43:55,502 INFO [decode.py:381]
26
+ For test-other, WER of different settings are:
27
+ greedy_search 6.37 best for test-other
28
+
29
+ 2022-03-11 18:43:55,502 INFO [decode.py:469] Done!
log/recogs-test-clean-beam_4-epoch-42-avg-11-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-clean-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-other-beam_4-epoch-42-avg-11-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-2.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-other-greedy_search-epoch-42-avg-11-context-2-max-sym-per-frame-3.txt ADDED
The diff for this file is too large to render. See raw diff