df: /root/.triton/autotune: No such file or directory [INFO|tokenization_utils_base.py:2159] 2025-01-05 11:08:24,607 >> loading file tokenizer.json [INFO|tokenization_utils_base.py:2159] 2025-01-05 11:08:24,607 >> loading file added_tokens.json [INFO|tokenization_utils_base.py:2159] 2025-01-05 11:08:24,607 >> loading file special_tokens_map.json [INFO|tokenization_utils_base.py:2159] 2025-01-05 11:08:24,607 >> loading file tokenizer_config.json [WARNING|logging.py:313] 2025-01-05 11:08:24,971 >> Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. Converting format of dataset: 0%| | 0/2932 [00:00> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/config.json [INFO|configuration_utils.py:800] 2025-01-05 11:08:29,402 >> Model config LlamaConfig { "_name_or_path": "/home/.atp/models/llama3_cn_8b_instruct", "architectures": [ "LlamaForCausalLM" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "hidden_act": "silu", "hidden_size": 4096, "initializer_range": 0.02, "intermediate_size": 14336, "max_position_embeddings": 8192, "mlp_bias": false, "model_type": "llama", "num_attention_heads": 32, "num_hidden_layers": 32, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": null, "rope_theta": 500000.0, "tie_word_embeddings": false, "torch_dtype": "bfloat16", "transformers_version": "4.42.4", "use_cache": true, "vocab_size": 128256 } [INFO|modeling_utils.py:3553] 2025-01-05 11:08:29,440 >> loading weights file /home/.atp/models/llama3_cn_8b_instruct/model.safetensors.index.json [INFO|modeling_utils.py:1531] 2025-01-05 11:08:29,444 >> Instantiating LlamaForCausalLM model under default dtype torch.float16. [INFO|configuration_utils.py:1000] 2025-01-05 11:08:29,447 >> Generate config GenerationConfig { "bos_token_id": 128000, "eos_token_id": 128001 } Loading checkpoint shards: 0%| | 0/4 [00:00> All model checkpoint weights were used when initializing LlamaForCausalLM. [INFO|modeling_utils.py:4372] 2025-01-05 11:08:39,938 >> All the weights of LlamaForCausalLM were initialized from the model checkpoint at /home/.atp/models/llama3_cn_8b_instruct. If your task is similar to the task the model of the checkpoint was trained on, you can already use LlamaForCausalLM for predictions without further training. [INFO|configuration_utils.py:953] 2025-01-05 11:08:39,946 >> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/generation_config.json [INFO|configuration_utils.py:1000] 2025-01-05 11:08:39,946 >> Generate config GenerationConfig { "bos_token_id": 128000, "do_sample": true, "eos_token_id": 128001, "max_length": 4096, "temperature": 0.6, "top_p": 0.9 } Detected kernel version 3.10.0, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher. [INFO|trainer.py:642] 2025-01-05 11:08:41,722 >> Using auto half precision backend [INFO|trainer.py:2128] 2025-01-05 11:08:42,507 >> ***** Running training ***** [INFO|trainer.py:2129] 2025-01-05 11:08:42,508 >> Num examples = 2,932 [INFO|trainer.py:2130] 2025-01-05 11:08:42,508 >> Num Epochs = 5 [INFO|trainer.py:2131] 2025-01-05 11:08:42,508 >> Instantaneous batch size per device = 4 [INFO|trainer.py:2134] 2025-01-05 11:08:42,508 >> Total train batch size (w. parallel, distributed & accumulation) = 4 [INFO|trainer.py:2135] 2025-01-05 11:08:42,508 >> Gradient Accumulation steps = 1 [INFO|trainer.py:2136] 2025-01-05 11:08:42,508 >> Total optimization steps = 3,665 [INFO|trainer.py:2137] 2025-01-05 11:08:42,512 >> Number of trainable parameters = 20,971,520 0%| | 0/3665 [00:00> Saving model checkpoint to /work/train_output/checkpoint-733 [INFO|configuration_utils.py:731] 2025-01-05 11:16:58,199 >> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/config.json [INFO|configuration_utils.py:800] 2025-01-05 11:16:58,200 >> Model config LlamaConfig { "architectures": [ "LlamaForCausalLM" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "hidden_act": "silu", "hidden_size": 4096, "initializer_range": 0.02, "intermediate_size": 14336, "max_position_embeddings": 8192, "mlp_bias": false, "model_type": "llama", "num_attention_heads": 32, "num_hidden_layers": 32, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": null, "rope_theta": 500000.0, "tie_word_embeddings": false, "torch_dtype": "bfloat16", "transformers_version": "4.42.4", "use_cache": true, "vocab_size": 128256 } [INFO|tokenization_utils_base.py:2574] 2025-01-05 11:16:58,734 >> tokenizer config file saved in /work/train_output/checkpoint-733/tokenizer_config.json [INFO|tokenization_utils_base.py:2583] 2025-01-05 11:16:58,736 >> Special tokens file saved in /work/train_output/checkpoint-733/special_tokens_map.json 20%|██ | 734/3665 [08:17<41:16, 1.18it/s] 20%|██ | 735/3665 [08:17<37:51, 1.29it/s] 20%|██ | 736/3665 [08:18<37:29, 1.30it/s] 20%|██ | 737/3665 [08:19<35:33, 1.37it/s] 20%|██ | 738/3665 [08:19<35:02, 1.39it/s] 20%|██ | 739/3665 [08:20<33:30, 1.46it/s] 20%|██ | 740/3665 [08:20<32:39, 1.49it/s] 20%|██ | 740/3665 [08:20<32:39, 1.49it/s] 20%|██ | 741/3665 [08:21<33:04, 1.47it/s] 20%|██ | 742/3665 [08:22<32:16, 1.51it/s] 20%|██ | 743/3665 [08:22<32:35, 1.49it/s] 20%|██ | 744/3665 [08:23<31:58, 1.52it/s] 20%|██ | 745/3665 [08:24<33:17, 1.46it/s] 20%|██ | 746/3665 [08:24<32:22, 1.50it/s] 20%|██ | 747/3665 [08:25<31:46, 1.53it/s] 20%|██ | 748/3665 [08:26<33:20, 1.46it/s] 20%|██ | 749/3665 [08:27<33:09, 1.47it/s] 20%|██ | 750/3665 [08:27<33:12, 1.46it/s] 20%|██ | 750/3665 [08:27<33:12, 1.46it/s] 20%|██ | 751/3665 [08:28<34:11, 1.42it/s] 21%|██ | 752/3665 [08:29<33:07, 1.47it/s] 21%|██ | 753/3665 [08:30<37:17, 1.30it/s] 21%|██ | 754/3665 [08:30<35:54, 1.35it/s] 21%|██ | 755/3665 [08:31<34:14, 1.42it/s] 21%|██ | 756/3665 [08:32<34:13, 1.42it/s] 21%|██ | 757/3665 [08:32<33:11, 1.46it/s] 21%|██ | 758/3665 [08:33<32:16, 1.50it/s] 21%|██ | 759/3665 [08:33<31:50, 1.52it/s] 21%|██ | 760/3665 [08:35<39:13, 1.23it/s] 21%|██ | 760/3665 [08:35<39:13, 1.23it/s] 21%|██ | 761/3665 [08:35<38:49, 1.25it/s] 21%|██ | 762/3665 [08:36<36:16, 1.33it/s] 21%|██ | 763/3665 [08:37<34:14, 1.41it/s] 21%|██ | 764/3665 [08:37<33:00, 1.47it/s] 21%|██ | 765/3665 [08:38<32:07, 1.50it/s] 21%|██ | 766/3665 [08:39<31:34, 1.53it/s] 21%|██ | 767/3665 [08:39<31:12, 1.55it/s] 21%|██ | 768/3665 [08:40<30:41, 1.57it/s] 21%|██ | 769/3665 [08:40<30:31, 1.58it/s] 21%|██ | 770/3665 [08:41<29:47, 1.62it/s] 21%|██ | 770/3665 [08:41<29:47, 1.62it/s] 21%|██ | 771/3665 [08:42<30:14, 1.59it/s] 21%|██ | 772/3665 [08:42<30:23, 1.59it/s] 21%|██ | 773/3665 [08:43<30:18, 1.59it/s] 21%|██ | 774/3665 [08:44<31:51, 1.51it/s] 21%|██ | 775/3665 [08:44<33:07, 1.45it/s] 21%|██ | 776/3665 [08:45<31:59, 1.51it/s] 21%|██ | 777/3665 [08:46<39:56, 1.20it/s] 21%|██ | 778/3665 [08:47<37:41, 1.28it/s] 21%|██▏ | 779/3665 [08:47<35:13, 1.37it/s] 21%|██▏ | 780/3665 [08:48<33:30, 1.43it/s] 21%|██▏ | 780/3665 [08:48<33:30, 1.43it/s] 21%|██▏ | 781/3665 [08:49<32:42, 1.47it/s] 21%|██▏ | 782/3665 [08:49<33:20, 1.44it/s] 21%|██▏ | 783/3665 [08:50<33:48, 1.42it/s] 21%|██▏ | 784/3665 [08:51<32:02, 1.50it/s] 21%|██▏ | 785/3665 [08:51<31:32, 1.52it/s] 21%|██▏ | 786/3665 [08:52<31:14, 1.54it/s] 21%|██▏ | 787/3665 [08:53<30:48, 1.56it/s] 22%|██▏ | 788/3665 [08:53<30:36, 1.57it/s] 22%|██▏ | 789/3665 [08:54<29:47, 1.61it/s] 22%|██▏ | 790/3665 [08:54<29:38, 1.62it/s] 22%|██▏ | 790/3665 [08:55<29:38, 1.62it/s] 22%|██▏ | 791/3665 [08:55<34:55, 1.37it/s] 22%|██▏ | 792/3665 [08:56<35:22, 1.35it/s] 22%|██▏ | 793/3665 [08:57<33:08, 1.44it/s] 22%|██▏ | 794/3665 [08:57<31:57, 1.50it/s] 22%|██▏ | 795/3665 [08:58<32:57, 1.45it/s] 22%|██▏ | 796/3665 [08:59<32:01, 1.49it/s] 22%|██▏ | 797/3665 [09:00<32:28, 1.47it/s] 22%|██▏ | 798/3665 [09:00<31:43, 1.51it/s] 22%|██▏ | 799/3665 [09:01<31:18, 1.53it/s] 22%|██▏ | 800/3665 [09:01<30:41, 1.56it/s] 22%|██▏ | 800/3665 [09:01<30:41, 1.56it/s] 22%|██▏ | 801/3665 [09:02<31:19, 1.52it/s] 22%|██▏ | 802/3665 [09:03<31:33, 1.51it/s] 22%|██▏ | 803/3665 [09:03<32:07, 1.48it/s] 22%|██▏ | 804/3665 [09:04<31:24, 1.52it/s] 22%|██▏ | 805/3665 [09:05<31:46, 1.50it/s] 22%|██▏ | 806/3665 [09:05<31:14, 1.53it/s] 22%|██▏ | 807/3665 [09:06<34:08, 1.40it/s] 22%|██▏ | 808/3665 [09:07<33:29, 1.42it/s] 22%|██▏ | 809/3665 [09:08<32:54, 1.45it/s] 22%|██▏ | 810/3665 [09:08<31:55, 1.49it/s] 22%|██▏ | 810/3665 [09:08<31:55, 1.49it/s] 22%|██▏ | 811/3665 [09:09<34:07, 1.39it/s] 22%|██▏ | 812/3665 [09:10<34:16, 1.39it/s] 22%|██▏ | 813/3665 [09:10<32:43, 1.45it/s] 22%|██▏ | 814/3665 [09:11<33:38, 1.41it/s] 22%|██▏ | 815/3665 [09:12<32:24, 1.47it/s] 22%|██▏ | 816/3665 [09:12<32:11, 1.47it/s] 22%|██▏ | 817/3665 [09:13<35:09, 1.35it/s] 22%|██▏ | 818/3665 [09:14<33:33, 1.41it/s] 22%|██▏ | 819/3665 [09:15<32:10, 1.47it/s] 22%|██▏ | 820/3665 [09:15<31:21, 1.51it/s] 22%|██▏ | 820/3665 [09:15<31:21, 1.51it/s] 22%|██▏ | 821/3665 [09:16<30:24, 1.56it/s] 22%|██▏ | 822/3665 [09:16<29:58, 1.58it/s] 22%|██▏ | 823/3665 [09:17<29:39, 1.60it/s] 22%|██▏ | 824/3665 [09:18<31:13, 1.52it/s] 23%|██▎ | 825/3665 [09:18<31:20, 1.51it/s] 23%|██▎ | 826/3665 [09:19<30:38, 1.54it/s] 23%|██▎ | 827/3665 [09:20<31:47, 1.49it/s] 23%|██▎ | 828/3665 [09:20<30:30, 1.55it/s] 23%|██▎ | 829/3665 [09:21<30:09, 1.57it/s] 23%|██▎ | 830/3665 [09:22<30:03, 1.57it/s] 23%|██▎ | 830/3665 [09:22<30:03, 1.57it/s] 23%|██▎ | 831/3665 [09:22<29:26, 1.60it/s] 23%|██▎ | 832/3665 [09:23<29:17, 1.61it/s] 23%|██▎ | 833/3665 [09:23<29:20, 1.61it/s] 23%|██▎ | 834/3665 [09:24<29:27, 1.60it/s] 23%|██▎ | 835/3665 [09:25<31:12, 1.51it/s] 23%|██▎ | 836/3665 [09:25<30:36, 1.54it/s] 23%|██▎ | 837/3665 [09:26<30:23, 1.55it/s] 23%|██▎ | 838/3665 [09:27<30:09, 1.56it/s] 23%|██▎ | 839/3665 [09:27<30:32, 1.54it/s] 23%|██▎ | 840/3665 [09:28<30:10, 1.56it/s] 23%|██▎ | 840/3665 [09:28<30:10, 1.56it/s] 23%|██▎ | 841/3665 [09:29<31:47, 1.48it/s] 23%|██▎ | 842/3665 [09:29<31:07, 1.51it/s] 23%|██▎ | 843/3665 [09:30<29:58, 1.57it/s] 23%|██▎ | 844/3665 [09:31<29:37, 1.59it/s] 23%|██▎ | 845/3665 [09:31<29:35, 1.59it/s] 23%|██▎ | 846/3665 [09:32<29:34, 1.59it/s] 23%|██▎ | 847/3665 [09:33<30:57, 1.52it/s] 23%|██▎ | 848/3665 [09:33<29:50, 1.57it/s] 23%|██▎ | 849/3665 [09:34<29:39, 1.58it/s] 23%|██▎ | 850/3665 [09:34<29:41, 1.58it/s] 23%|██▎ | 850/3665 [09:34<29:41, 1.58it/s] 23%|██▎ | 851/3665 [09:35<29:34, 1.59it/s] 23%|██▎ | 852/3665 [09:36<29:39, 1.58it/s] 23%|██▎ | 853/3665 [09:36<29:40, 1.58it/s] 23%|██▎ | 854/3665 [09:37<29:22, 1.60it/s] 23%|██▎ | 855/3665 [09:38<32:54, 1.42it/s] 23%|██▎ | 856/3665 [09:38<31:57, 1.47it/s] 23%|██▎ | 857/3665 [09:39<33:36, 1.39it/s] 23%|██▎ | 858/3665 [09:40<31:40, 1.48it/s] 23%|██▎ | 859/3665 [09:40<30:46, 1.52it/s] 23%|██▎ | 860/3665 [09:41<30:26, 1.54it/s] 23%|██▎ | 860/3665 [09:41<30:26, 1.54it/s] 23%|██▎ | 861/3665 [09:42<30:11, 1.55it/s] 24%|██▎ | 862/3665 [09:42<29:56, 1.56it/s] 24%|██▎ | 863/3665 [09:43<29:38, 1.58it/s] 24%|██▎ | 864/3665 [09:44<29:30, 1.58it/s] 24%|██▎ | 865/3665 [09:44<29:12, 1.60it/s] 24%|██▎ | 866/3665 [09:45<31:18, 1.49it/s] 24%|██▎ | 867/3665 [09:46<30:37, 1.52it/s] 24%|██▎ | 868/3665 [09:46<30:18, 1.54it/s] 24%|██▎ | 869/3665 [09:47<30:07, 1.55it/s] 24%|██▎ | 870/3665 [09:47<30:34, 1.52it/s] 24%|██▎ | 870/3665 [09:47<30:34, 1.52it/s] 24%|██▍ | 871/3665 [09:48<29:44, 1.57it/s] 24%|██▍ | 872/3665 [09:49<31:02, 1.50it/s] 24%|██▍ | 873/3665 [09:50<31:53, 1.46it/s] 24%|██▍ | 874/3665 [09:50<31:00, 1.50it/s] 24%|██▍ | 875/3665 [09:51<30:28, 1.53it/s] 24%|██▍ | 876/3665 [09:52<31:28, 1.48it/s] 24%|██▍ | 877/3665 [09:52<31:27, 1.48it/s] 24%|██▍ | 878/3665 [09:53<30:43, 1.51it/s] 24%|██▍ | 879/3665 [09:54<31:47, 1.46it/s] 24%|██▍ | 880/3665 [09:54<32:31, 1.43it/s] 24%|██▍ | 880/3665 [09:54<32:31, 1.43it/s] 24%|██▍ | 881/3665 [09:55<33:04, 1.40it/s] 24%|██▍ | 882/3665 [09:56<32:56, 1.41it/s] 24%|██▍ | 883/3665 [09:56<31:34, 1.47it/s] 24%|██▍ | 884/3665 [09:57<30:37, 1.51it/s] 24%|██▍ | 885/3665 [09:58<30:10, 1.54it/s] 24%|██▍ | 886/3665 [09:58<30:30, 1.52it/s] 24%|██▍ | 887/3665 [09:59<30:00, 1.54it/s] 24%|██▍ | 888/3665 [10:00<31:43, 1.46it/s] 24%|██▍ | 889/3665 [10:01<34:33, 1.34it/s] 24%|██▍ | 890/3665 [10:01<32:13, 1.43it/s] 24%|██▍ | 890/3665 [10:01<32:13, 1.43it/s] 24%|██▍ | 891/3665 [10:02<31:25, 1.47it/s] 24%|██▍ | 892/3665 [10:02<30:45, 1.50it/s] 24%|██▍ | 893/3665 [10:03<30:13, 1.53it/s] 24%|██▍ | 894/3665 [10:04<29:48, 1.55it/s] 24%|██▍ | 895/3665 [10:04<30:12, 1.53it/s] 24%|██▍ | 896/3665 [10:05<29:49, 1.55it/s] 24%|██▍ | 897/3665 [10:06<29:20, 1.57it/s] 25%|██▍ | 898/3665 [10:06<29:16, 1.58it/s] 25%|██▍ | 899/3665 [10:07<29:06, 1.58it/s] 25%|██▍ | 900/3665 [10:08<29:41, 1.55it/s] 25%|██▍ | 900/3665 [10:08<29:41, 1.55it/s] 25%|██▍ | 901/3665 [10:08<29:44, 1.55it/s] 25%|██▍ | 902/3665 [10:09<31:10, 1.48it/s] 25%|██▍ | 903/3665 [10:10<30:29, 1.51it/s] 25%|██▍ | 904/3665 [10:10<30:05, 1.53it/s] 25%|██▍ | 905/3665 [10:11<31:25, 1.46it/s] 25%|██▍ | 906/3665 [10:12<33:48, 1.36it/s] 25%|██▍ | 907/3665 [10:12<32:07, 1.43it/s] 25%|██▍ | 908/3665 [10:13<33:38, 1.37it/s] 25%|██▍ | 909/3665 [10:14<31:57, 1.44it/s] 25%|██▍ | 910/3665 [10:15<32:24, 1.42it/s] 25%|██▍ | 910/3665 [10:15<32:24, 1.42it/s] 25%|██▍ | 911/3665 [10:15<31:36, 1.45it/s] 25%|██▍ | 912/3665 [10:16<32:15, 1.42it/s] 25%|██▍ | 913/3665 [10:17<32:53, 1.39it/s] 25%|██▍ | 914/3665 [10:17<31:36, 1.45it/s] 25%|██▍ | 915/3665 [10:18<30:42, 1.49it/s] 25%|██▍ | 916/3665 [10:19<30:04, 1.52it/s] 25%|██▌ | 917/3665 [10:19<30:10, 1.52it/s] 25%|██▌ | 918/3665 [10:20<33:56, 1.35it/s] 25%|██▌ | 919/3665 [10:21<33:07, 1.38it/s] 25%|██▌ | 920/3665 [10:21<31:52, 1.44it/s] 25%|██▌ | 920/3665 [10:21<31:52, 1.44it/s] 25%|██▌ | 921/3665 [10:22<32:05, 1.42it/s] 25%|██▌ | 922/3665 [10:23<31:00, 1.47it/s] 25%|██▌ | 923/3665 [10:24<31:43, 1.44it/s] 25%|██▌ | 924/3665 [10:24<30:45, 1.49it/s] 25%|██▌ | 925/3665 [10:25<31:38, 1.44it/s] 25%|██▌ | 926/3665 [10:26<31:23, 1.45it/s] 25%|██▌ | 927/3665 [10:26<30:30, 1.50it/s] 25%|██▌ | 928/3665 [10:27<30:02, 1.52it/s] 25%|██▌ | 929/3665 [10:28<30:15, 1.51it/s] 25%|██▌ | 930/3665 [10:28<30:47, 1.48it/s] 25%|██▌ | 930/3665 [10:28<30:47, 1.48it/s] 25%|██▌ | 931/3665 [10:29<30:50, 1.48it/s] 25%|██▌ | 932/3665 [10:30<31:48, 1.43it/s] 25%|██▌ | 933/3665 [10:30<31:35, 1.44it/s] 25%|██▌ | 934/3665 [10:31<30:28, 1.49it/s] 26%|██▌ | 935/3665 [10:32<31:39, 1.44it/s] 26%|██▌ | 936/3665 [10:32<30:30, 1.49it/s] 26%|██▌ | 937/3665 [10:33<31:24, 1.45it/s] 26%|██▌ | 938/3665 [10:34<29:52, 1.52it/s] 26%|██▌ | 939/3665 [10:34<30:27, 1.49it/s] 26%|██▌ | 940/3665 [10:35<29:51, 1.52it/s] 26%|██▌ | 940/3665 [10:35<29:51, 1.52it/s] 26%|██▌ | 941/3665 [10:36<29:43, 1.53it/s] 26%|██▌ | 942/3665 [10:36<30:32, 1.49it/s] 26%|██▌ | 943/3665 [10:37<29:56, 1.52it/s] 26%|██▌ | 944/3665 [10:38<29:29, 1.54it/s] 26%|██▌ | 945/3665 [10:38<29:48, 1.52it/s] 26%|██▌ | 946/3665 [10:39<29:12, 1.55it/s] 26%|██▌ | 947/3665 [10:39<28:59, 1.56it/s] 26%|██▌ | 948/3665 [10:40<29:28, 1.54it/s] 26%|██▌ | 949/3665 [10:41<36:19, 1.25it/s] 26%|██▌ | 950/3665 [10:42<33:52, 1.34it/s] 26%|██▌ | 950/3665 [10:42<33:52, 1.34it/s] 26%|██▌ | 951/3665 [10:43<32:55, 1.37it/s] 26%|██▌ | 952/3665 [10:43<31:33, 1.43it/s] 26%|██▌ | 953/3665 [10:44<29:57, 1.51it/s] 26%|██▌ | 954/3665 [10:45<30:06, 1.50it/s] 26%|██▌ | 955/3665 [10:45<29:21, 1.54it/s] 26%|██▌ | 956/3665 [10:46<28:24, 1.59it/s] 26%|██▌ | 957/3665 [10:46<28:10, 1.60it/s] 26%|██▌ | 958/3665 [10:47<28:59, 1.56it/s] 26%|██▌ | 959/3665 [10:48<29:34, 1.52it/s] 26%|██▌ | 960/3665 [10:48<31:04, 1.45it/s] 26%|██▌ | 960/3665 [10:48<31:04, 1.45it/s] 26%|██▌ | 961/3665 [10:49<32:45, 1.38it/s] 26%|██▌ | 962/3665 [10:50<32:03, 1.41it/s] 26%|██▋ | 963/3665 [10:51<30:52, 1.46it/s] 26%|██▋ | 964/3665 [10:51<30:02, 1.50it/s] 26%|██▋ | 965/3665 [10:52<30:32, 1.47it/s] 26%|██▋ | 966/3665 [10:53<29:47, 1.51it/s] 26%|██▋ | 967/3665 [10:53<29:49, 1.51it/s] 26%|██▋ | 968/3665 [10:54<29:58, 1.50it/s] 26%|██▋ | 969/3665 [10:55<31:12, 1.44it/s] 26%|██▋ | 970/3665 [10:55<31:18, 1.43it/s] 26%|██▋ | 970/3665 [10:55<31:18, 1.43it/s] 26%|██▋ | 971/3665 [10:56<29:53, 1.50it/s] 27%|██▋ | 972/3665 [10:57<29:09, 1.54it/s] 27%|██▋ | 973/3665 [10:57<32:59, 1.36it/s] 27%|██▋ | 974/3665 [10:58<31:28, 1.43it/s] 27%|██▋ | 975/3665 [10:59<29:51, 1.50it/s] 27%|██▋ | 976/3665 [10:59<29:10, 1.54it/s] 27%|██▋ | 977/3665 [11:00<30:15, 1.48it/s] 27%|██▋ | 978/3665 [11:01<30:22, 1.47it/s] 27%|██▋ | 979/3665 [11:01<29:47, 1.50it/s] 27%|██▋ | 980/3665 [11:02<29:46, 1.50it/s] 27%|██▋ | 980/3665 [11:02<29:46, 1.50it/s] 27%|██▋ | 981/3665 [11:03<29:22, 1.52it/s] 27%|██▋ | 982/3665 [11:03<28:54, 1.55it/s] 27%|██▋ | 983/3665 [11:04<28:39, 1.56it/s] 27%|██▋ | 984/3665 [11:05<28:58, 1.54it/s] 27%|██▋ | 985/3665 [11:05<28:46, 1.55it/s] 27%|██▋ | 986/3665 [11:06<30:37, 1.46it/s] 27%|██▋ | 987/3665 [11:07<31:12, 1.43it/s] 27%|██▋ | 988/3665 [11:07<31:13, 1.43it/s] 27%|██▋ | 989/3665 [11:08<30:13, 1.48it/s] 27%|██▋ | 990/3665 [11:09<30:04, 1.48it/s] 27%|██▋ | 990/3665 [11:09<30:04, 1.48it/s] 27%|██▋ | 991/3665 [11:09<30:10, 1.48it/s] 27%|██▋ | 992/3665 [11:10<29:33, 1.51it/s] 27%|██▋ | 993/3665 [11:11<32:07, 1.39it/s] 27%|██▋ | 994/3665 [11:11<30:47, 1.45it/s] 27%|██▋ | 995/3665 [11:12<29:57, 1.49it/s] 27%|██▋ | 996/3665 [11:13<29:08, 1.53it/s] 27%|██▋ | 997/3665 [11:13<28:32, 1.56it/s] 27%|██▋ | 998/3665 [11:14<28:28, 1.56it/s] 27%|██▋ | 999/3665 [11:15<29:03, 1.53it/s] 27%|██▋ | 1000/3665 [11:15<30:28, 1.46it/s] 27%|██▋ | 1000/3665 [11:15<30:28, 1.46it/s] 27%|██▋ | 1001/3665 [11:16<33:56, 1.31it/s] 27%|██▋ | 1002/3665 [11:17<31:53, 1.39it/s] 27%|██▋ | 1003/3665 [11:18<30:41, 1.45it/s] 27%|██▋ | 1004/3665 [11:18<29:55, 1.48it/s] 27%|██▋ | 1005/3665 [11:19<28:37, 1.55it/s] 27%|██▋ | 1006/3665 [11:19<28:21, 1.56it/s] 27%|██▋ | 1007/3665 [11:20<28:47, 1.54it/s] 28%|██▊ | 1008/3665 [11:21<28:15, 1.57it/s] 28%|██▊ | 1009/3665 [11:21<29:36, 1.50it/s] 28%|██▊ | 1010/3665 [11:22<29:12, 1.51it/s] 28%|██▊ | 1010/3665 [11:22<29:12, 1.51it/s] 28%|██▊ | 1011/3665 [11:23<30:23, 1.46it/s] 28%|██▊ | 1012/3665 [11:23<29:24, 1.50it/s] 28%|██▊ | 1013/3665 [11:24<28:49, 1.53it/s] 28%|██▊ | 1014/3665 [11:25<28:30, 1.55it/s] 28%|██▊ | 1015/3665 [11:25<29:01, 1.52it/s] 28%|██▊ | 1016/3665 [11:26<29:14, 1.51it/s] 28%|██▊ | 1017/3665 [11:27<28:42, 1.54it/s] 28%|██▊ | 1018/3665 [11:27<28:14, 1.56it/s] 28%|██▊ | 1019/3665 [11:28<28:11, 1.56it/s] 28%|██▊ | 1020/3665 [11:29<28:39, 1.54it/s] 28%|██▊ | 1020/3665 [11:29<28:39, 1.54it/s] 28%|██▊ | 1021/3665 [11:29<28:37, 1.54it/s] 28%|██▊ | 1022/3665 [11:30<29:20, 1.50it/s] 28%|██▊ | 1023/3665 [11:31<30:26, 1.45it/s] 28%|██▊ | 1024/3665 [11:31<28:57, 1.52it/s] 28%|██▊ | 1025/3665 [11:32<28:34, 1.54it/s] 28%|██▊ | 1026/3665 [11:33<28:13, 1.56it/s] 28%|██▊ | 1027/3665 [11:33<28:03, 1.57it/s] 28%|██▊ | 1028/3665 [11:34<30:56, 1.42it/s] 28%|██▊ | 1029/3665 [11:35<29:19, 1.50it/s] 28%|██▊ | 1030/3665 [11:35<28:42, 1.53it/s] 28%|██▊ | 1030/3665 [11:35<28:42, 1.53it/s] 28%|██▊ | 1031/3665 [11:36<28:29, 1.54it/s] 28%|██▊ | 1032/3665 [11:37<29:40, 1.48it/s] 28%|██▊ | 1033/3665 [11:37<28:59, 1.51it/s] 28%|██▊ | 1034/3665 [11:38<28:36, 1.53it/s] 28%|██▊ | 1035/3665 [11:39<28:47, 1.52it/s] 28%|██▊ | 1036/3665 [11:39<28:26, 1.54it/s] 28%|██▊ | 1037/3665 [11:40<28:06, 1.56it/s] 28%|██▊ | 1038/3665 [11:41<31:16, 1.40it/s] 28%|██▊ | 1039/3665 [11:41<29:29, 1.48it/s] 28%|██▊ | 1040/3665 [11:42<28:43, 1.52it/s] 28%|██▊ | 1040/3665 [11:42<28:43, 1.52it/s] 28%|██▊ | 1041/3665 [11:43<29:03, 1.50it/s] 28%|██▊ | 1042/3665 [11:43<28:31, 1.53it/s] 28%|██▊ | 1043/3665 [11:44<27:59, 1.56it/s] 28%|██▊ | 1044/3665 [11:45<29:08, 1.50it/s] 29%|██▊ | 1045/3665 [11:45<30:05, 1.45it/s] 29%|██▊ | 1046/3665 [11:46<29:19, 1.49it/s] 29%|██▊ | 1047/3665 [11:48<48:21, 1.11s/it] 29%|██▊ | 1048/3665 [11:49<43:21, 1.01it/s] 29%|██▊ | 1049/3665 [11:49<39:10, 1.11it/s] 29%|██▊ | 1050/3665 [11:50<35:33, 1.23it/s] 29%|██▊ | 1050/3665 [11:50<35:33, 1.23it/s] 29%|██▊ | 1051/3665 [11:51<33:02, 1.32it/s] 29%|██▊ | 1052/3665 [11:51<31:20, 1.39it/s] 29%|██▊ | 1053/3665 [11:52<30:03, 1.45it/s] 29%|██▉ | 1054/3665 [11:53<29:15, 1.49it/s] 29%|██▉ | 1055/3665 [11:53<30:00, 1.45it/s] 29%|██▉ | 1056/3665 [11:54<29:48, 1.46it/s] 29%|██▉ | 1057/3665 [11:55<30:45, 1.41it/s] 29%|██▉ | 1058/3665 [11:55<29:42, 1.46it/s] 29%|██▉ | 1059/3665 [11:56<29:29, 1.47it/s] 29%|██▉ | 1060/3665 [11:57<29:19, 1.48it/s] 29%|██▉ | 1060/3665 [11:57<29:19, 1.48it/s] 29%|██▉ | 1061/3665 [11:57<28:55, 1.50it/s] 29%|██▉ | 1062/3665 [11:58<28:14, 1.54it/s] 29%|██▉ | 1063/3665 [11:59<27:43, 1.56it/s] 29%|██▉ | 1064/3665 [11:59<27:20, 1.59it/s] 29%|██▉ | 1065/3665 [12:00<26:38, 1.63it/s] 29%|██▉ | 1066/3665 [12:01<29:02, 1.49it/s] 29%|██▉ | 1067/3665 [12:01<29:47, 1.45it/s] 29%|██▉ | 1068/3665 [12:02<28:56, 1.50it/s] 29%|██▉ | 1069/3665 [12:03<28:30, 1.52it/s] 29%|██▉ | 1070/3665 [12:03<27:53, 1.55it/s] 29%|██▉ | 1070/3665 [12:03<27:53, 1.55it/s] 29%|██▉ | 1071/3665 [12:04<29:07, 1.48it/s] 29%|██▉ | 1072/3665 [12:05<29:14, 1.48it/s] 29%|██▉ | 1073/3665 [12:05<30:02, 1.44it/s] 29%|██▉ | 1074/3665 [12:06<29:07, 1.48it/s] 29%|██▉ | 1075/3665 [12:07<29:28, 1.46it/s] 29%|██▉ | 1076/3665 [12:07<28:46, 1.50it/s] 29%|██▉ | 1077/3665 [12:08<29:00, 1.49it/s] 29%|██▉ | 1078/3665 [12:09<29:51, 1.44it/s] 29%|██▉ | 1079/3665 [12:09<28:49, 1.50it/s] 29%|██▉ | 1080/3665 [12:10<27:39, 1.56it/s] 29%|██▉ | 1080/3665 [12:10<27:39, 1.56it/s] 29%|██▉ | 1081/3665 [12:11<28:08, 1.53it/s] 30%|██▉ | 1082/3665 [12:11<27:47, 1.55it/s] 30%|██▉ | 1083/3665 [12:12<27:29, 1.57it/s] 30%|██▉ | 1084/3665 [12:13<28:38, 1.50it/s] 30%|██▉ | 1085/3665 [12:13<28:05, 1.53it/s] 30%|██▉ | 1086/3665 [12:14<27:41, 1.55it/s] 30%|██▉ | 1087/3665 [12:14<27:29, 1.56it/s] 30%|██▉ | 1088/3665 [12:15<27:24, 1.57it/s] 30%|██▉ | 1089/3665 [12:16<26:40, 1.61it/s] 30%|██▉ | 1090/3665 [12:16<26:40, 1.61it/s] 30%|██▉ | 1090/3665 [12:16<26:40, 1.61it/s] 30%|██▉ | 1091/3665 [12:17<27:22, 1.57it/s] 30%|██▉ | 1092/3665 [12:18<27:14, 1.57it/s] 30%|██▉ | 1093/3665 [12:18<26:56, 1.59it/s] 30%|██▉ | 1094/3665 [12:19<27:41, 1.55it/s] 30%|██▉ | 1095/3665 [12:20<27:15, 1.57it/s] 30%|██▉ | 1096/3665 [12:20<27:42, 1.54it/s] 30%|██▉ | 1097/3665 [12:21<27:34, 1.55it/s] 30%|██▉ | 1098/3665 [12:22<28:05, 1.52it/s] 30%|██▉ | 1099/3665 [12:22<28:27, 1.50it/s] 30%|███ | 1100/3665 [12:23<27:56, 1.53it/s] 30%|███ | 1100/3665 [12:23<27:56, 1.53it/s] 30%|███ | 1101/3665 [12:24<28:15, 1.51it/s] 30%|███ | 1102/3665 [12:24<28:20, 1.51it/s] 30%|███ | 1103/3665 [12:25<27:40, 1.54it/s] 30%|███ | 1104/3665 [12:25<27:20, 1.56it/s] 30%|███ | 1105/3665 [12:26<31:32, 1.35it/s] 30%|███ | 1106/3665 [12:27<29:55, 1.43it/s] 30%|███ | 1107/3665 [12:28<29:04, 1.47it/s] 30%|███ | 1108/3665 [12:28<28:11, 1.51it/s] 30%|███ | 1109/3665 [12:29<27:40, 1.54it/s] 30%|███ | 1110/3665 [12:29<27:12, 1.57it/s] 30%|███ | 1110/3665 [12:29<27:12, 1.57it/s] 30%|███ | 1111/3665 [12:30<27:02, 1.57it/s] 30%|███ | 1112/3665 [12:31<27:25, 1.55it/s] 30%|███ | 1113/3665 [12:31<27:16, 1.56it/s] 30%|███ | 1114/3665 [12:32<27:04, 1.57it/s] 30%|███ | 1115/3665 [12:33<26:46, 1.59it/s] 30%|███ | 1116/3665 [12:34<33:11, 1.28it/s] 30%|███ | 1117/3665 [12:34<31:11, 1.36it/s] 31%|███ | 1118/3665 [12:35<29:38, 1.43it/s] 31%|███ | 1119/3665 [12:36<28:33, 1.49it/s] 31%|███ | 1120/3665 [12:36<27:54, 1.52it/s] 31%|███ | 1120/3665 [12:36<27:54, 1.52it/s] 31%|███ | 1121/3665 [12:37<27:30, 1.54it/s] 31%|███ | 1122/3665 [12:38<28:31, 1.49it/s] 31%|███ | 1123/3665 [12:38<27:21, 1.55it/s] 31%|███ | 1124/3665 [12:39<27:53, 1.52it/s] 31%|███ | 1125/3665 [12:40<29:03, 1.46it/s] 31%|███ | 1126/3665 [12:40<28:07, 1.50it/s] 31%|███ | 1127/3665 [12:41<30:32, 1.39it/s] 31%|███ | 1128/3665 [12:42<30:34, 1.38it/s] 31%|███ | 1129/3665 [12:42<29:18, 1.44it/s] 31%|███ | 1130/3665 [12:43<29:04, 1.45it/s] 31%|███ | 1130/3665 [12:43<29:04, 1.45it/s] 31%|███ | 1131/3665 [12:44<28:29, 1.48it/s] 31%|███ | 1132/3665 [12:44<28:35, 1.48it/s] 31%|███ | 1133/3665 [12:45<27:57, 1.51it/s] 31%|███ | 1134/3665 [12:46<27:30, 1.53it/s] 31%|███ | 1135/3665 [12:46<27:53, 1.51it/s] 31%|███ | 1136/3665 [12:47<27:33, 1.53it/s] 31%|███ | 1137/3665 [12:48<27:18, 1.54it/s] 31%|███ | 1138/3665 [12:49<31:27, 1.34it/s] 31%|███ | 1139/3665 [12:49<31:55, 1.32it/s] 31%|███ | 1140/3665 [12:50<30:46, 1.37it/s] 31%|███ | 1140/3665 [12:50<30:46, 1.37it/s] 31%|███ | 1141/3665 [12:51<30:12, 1.39it/s] 31%|███ | 1142/3665 [12:52<32:39, 1.29it/s] 31%|███ | 1143/3665 [12:52<30:32, 1.38it/s] 31%|███ | 1144/3665 [12:53<30:39, 1.37it/s] 31%|███ | 1145/3665 [12:54<29:20, 1.43it/s] 31%|███▏ | 1146/3665 [12:54<30:45, 1.36it/s] 31%|███▏ | 1147/3665 [12:55<30:10, 1.39it/s] 31%|███▏ | 1148/3665 [12:56<28:51, 1.45it/s] 31%|███▏ | 1149/3665 [12:57<30:59, 1.35it/s] 31%|███▏ | 1150/3665 [12:57<29:23, 1.43it/s] 31%|███▏ | 1150/3665 [12:57<29:23, 1.43it/s] 31%|███▏ | 1151/3665 [12:58<28:37, 1.46it/s] 31%|███▏ | 1152/3665 [12:58<27:18, 1.53it/s] 31%|███▏ | 1153/3665 [12:59<26:56, 1.55it/s] 31%|███▏ | 1154/3665 [13:00<27:12, 1.54it/s] 32%|███▏ | 1155/3665 [13:01<28:33, 1.47it/s] 32%|███▏ | 1156/3665 [13:01<28:35, 1.46it/s] 32%|███▏ | 1157/3665 [13:02<27:16, 1.53it/s] 32%|███▏ | 1158/3665 [13:02<27:02, 1.55it/s] 32%|███▏ | 1159/3665 [13:03<26:49, 1.56it/s] 32%|███▏ | 1160/3665 [13:04<26:35, 1.57it/s] 32%|███▏ | 1160/3665 [13:04<26:35, 1.57it/s] 32%|███▏ | 1161/3665 [13:04<26:24, 1.58it/s] 32%|███▏ | 1162/3665 [13:05<27:11, 1.53it/s] 32%|███▏ | 1163/3665 [13:06<28:42, 1.45it/s] 32%|███▏ | 1164/3665 [13:07<29:19, 1.42it/s] 32%|███▏ | 1165/3665 [13:07<28:28, 1.46it/s] 32%|███▏ | 1166/3665 [13:08<27:51, 1.49it/s] 32%|███▏ | 1167/3665 [13:09<32:33, 1.28it/s] 32%|███▏ | 1168/3665 [13:10<31:59, 1.30it/s] 32%|███▏ | 1169/3665 [13:10<30:02, 1.38it/s] 32%|███▏ | 1170/3665 [13:11<28:47, 1.44it/s] 32%|███▏ | 1170/3665 [13:11<28:47, 1.44it/s] 32%|███▏ | 1171/3665 [13:12<30:25, 1.37it/s] 32%|███▏ | 1172/3665 [13:12<28:55, 1.44it/s] 32%|███▏ | 1173/3665 [13:13<28:59, 1.43it/s] 32%|███▏ | 1174/3665 [13:14<28:35, 1.45it/s] 32%|███▏ | 1175/3665 [13:14<27:50, 1.49it/s] 32%|███▏ | 1176/3665 [13:15<27:23, 1.51it/s] 32%|███▏ | 1177/3665 [13:16<31:20, 1.32it/s] 32%|███▏ | 1178/3665 [13:16<29:34, 1.40it/s] 32%|███▏ | 1179/3665 [13:17<28:25, 1.46it/s] 32%|███▏ | 1180/3665 [13:18<30:55, 1.34it/s] 32%|███▏ | 1180/3665 [13:18<30:55, 1.34it/s] 32%|███▏ | 1181/3665 [13:19<30:32, 1.36it/s] 32%|███▏ | 1182/3665 [13:19<28:55, 1.43it/s] 32%|███▏ | 1183/3665 [13:20<27:26, 1.51it/s] 32%|███▏ | 1184/3665 [13:20<26:47, 1.54it/s] 32%|███▏ | 1185/3665 [13:21<27:15, 1.52it/s] 32%|███▏ | 1186/3665 [13:22<28:23, 1.46it/s] 32%|███▏ | 1187/3665 [13:23<27:02, 1.53it/s] 32%|███▏ | 1188/3665 [13:23<27:22, 1.51it/s] 32%|███▏ | 1189/3665 [13:24<27:26, 1.50it/s] 32%|███▏ | 1190/3665 [13:24<26:46, 1.54it/s] 32%|███▏ | 1190/3665 [13:24<26:46, 1.54it/s] 32%|███▏ | 1191/3665 [13:25<26:44, 1.54it/s] 33%|███▎ | 1192/3665 [13:26<27:24, 1.50it/s] 33%|███▎ | 1193/3665 [13:27<27:51, 1.48it/s] 33%|███▎ | 1194/3665 [13:27<28:55, 1.42it/s] 33%|███▎ | 1195/3665 [13:28<34:04, 1.21it/s] 33%|███▎ | 1196/3665 [13:29<32:11, 1.28it/s] 33%|███▎ | 1197/3665 [13:30<31:11, 1.32it/s] 33%|███▎ | 1198/3665 [13:30<29:30, 1.39it/s] 33%|███▎ | 1199/3665 [13:31<29:54, 1.37it/s] 33%|███▎ | 1200/3665 [13:32<28:45, 1.43it/s] 33%|███▎ | 1200/3665 [13:32<28:45, 1.43it/s] 33%|███▎ | 1201/3665 [13:32<28:37, 1.43it/s] 33%|███▎ | 1202/3665 [13:33<28:12, 1.46it/s] 33%|███▎ | 1203/3665 [13:34<28:42, 1.43it/s] 33%|███▎ | 1204/3665 [13:35<30:47, 1.33it/s] 33%|███▎ | 1205/3665 [13:35<28:39, 1.43it/s] 33%|███▎ | 1206/3665 [13:36<29:31, 1.39it/s] 33%|███▎ | 1207/3665 [13:37<28:11, 1.45it/s] 33%|███▎ | 1208/3665 [13:37<27:14, 1.50it/s] 33%|███▎ | 1209/3665 [13:38<26:32, 1.54it/s] 33%|███▎ | 1210/3665 [13:39<26:44, 1.53it/s] 33%|███▎ | 1210/3665 [13:39<26:44, 1.53it/s] 33%|███▎ | 1211/3665 [13:39<28:06, 1.45it/s] 33%|███▎ | 1212/3665 [13:40<27:11, 1.50it/s] 33%|███▎ | 1213/3665 [13:41<26:40, 1.53it/s] 33%|███▎ | 1214/3665 [13:41<25:47, 1.58it/s] 33%|███▎ | 1215/3665 [13:42<25:33, 1.60it/s] 33%|███▎ | 1216/3665 [13:43<26:29, 1.54it/s] 33%|███▎ | 1217/3665 [13:43<27:36, 1.48it/s] 33%|███▎ | 1218/3665 [13:44<27:55, 1.46it/s] 33%|███▎ | 1219/3665 [13:45<27:13, 1.50it/s] 33%|███▎ | 1220/3665 [13:45<27:57, 1.46it/s] 33%|███▎ | 1220/3665 [13:45<27:57, 1.46it/s] 33%|███▎ | 1221/3665 [13:46<30:53, 1.32it/s] 33%|███▎ | 1222/3665 [13:47<29:46, 1.37it/s] 33%|███▎ | 1223/3665 [13:48<28:25, 1.43it/s] 33%|███▎ | 1224/3665 [13:48<28:09, 1.45it/s] 33%|███▎ | 1225/3665 [13:49<26:47, 1.52it/s] 33%|███▎ | 1226/3665 [13:49<26:24, 1.54it/s] 33%|███▎ | 1227/3665 [13:50<29:38, 1.37it/s] 34%|███▎ | 1228/3665 [13:51<28:57, 1.40it/s] 34%|███▎ | 1229/3665 [13:52<27:53, 1.46it/s] 34%|███▎ | 1230/3665 [13:52<26:29, 1.53it/s] 34%|███▎ | 1230/3665 [13:52<26:29, 1.53it/s] 34%|███▎ | 1231/3665 [13:53<26:07, 1.55it/s] 34%|███▎ | 1232/3665 [13:53<25:51, 1.57it/s] 34%|███▎ | 1233/3665 [13:54<25:43, 1.58it/s] 34%|███▎ | 1234/3665 [13:55<26:19, 1.54it/s] 34%|███▎ | 1235/3665 [13:55<25:58, 1.56it/s] 34%|███▎ | 1236/3665 [13:56<25:46, 1.57it/s] 34%|███▍ | 1237/3665 [13:57<27:00, 1.50it/s] 34%|███▍ | 1238/3665 [13:57<26:20, 1.54it/s] 34%|███▍ | 1239/3665 [13:58<26:03, 1.55it/s] 34%|███▍ | 1240/3665 [13:59<25:49, 1.57it/s] 34%|███▍ | 1240/3665 [13:59<25:49, 1.57it/s] 34%|███▍ | 1241/3665 [13:59<25:51, 1.56it/s] 34%|███▍ | 1242/3665 [14:00<25:04, 1.61it/s] 34%|███▍ | 1243/3665 [14:00<25:36, 1.58it/s] 34%|███▍ | 1244/3665 [14:02<31:32, 1.28it/s] 34%|███▍ | 1245/3665 [14:02<29:37, 1.36it/s] 34%|███▍ | 1246/3665 [14:03<27:46, 1.45it/s] 34%|███▍ | 1247/3665 [14:04<27:41, 1.46it/s] 34%|███▍ | 1248/3665 [14:04<26:20, 1.53it/s] 34%|███▍ | 1249/3665 [14:05<27:29, 1.46it/s] 34%|███▍ | 1250/3665 [14:06<28:32, 1.41it/s] 34%|███▍ | 1250/3665 [14:06<28:32, 1.41it/s] 34%|███▍ | 1251/3665 [14:06<27:29, 1.46it/s] 34%|███▍ | 1252/3665 [14:07<26:37, 1.51it/s] 34%|███▍ | 1253/3665 [14:07<26:07, 1.54it/s] 34%|███▍ | 1254/3665 [14:08<25:55, 1.55it/s] 34%|███▍ | 1255/3665 [14:09<26:22, 1.52it/s] 34%|███▍ | 1256/3665 [14:09<25:57, 1.55it/s] 34%|███▍ | 1257/3665 [14:10<26:19, 1.52it/s] 34%|███▍ | 1258/3665 [14:11<25:47, 1.56it/s] 34%|███▍ | 1259/3665 [14:11<25:32, 1.57it/s] 34%|███▍ | 1260/3665 [14:12<25:30, 1.57it/s] 34%|███▍ | 1260/3665 [14:12<25:30, 1.57it/s] 34%|███▍ | 1261/3665 [14:13<25:34, 1.57it/s] 34%|███▍ | 1262/3665 [14:13<26:09, 1.53it/s] 34%|███▍ | 1263/3665 [14:14<26:31, 1.51it/s] 34%|███▍ | 1264/3665 [14:15<27:01, 1.48it/s] 35%|███▍ | 1265/3665 [14:16<30:32, 1.31it/s] 35%|███▍ | 1266/3665 [14:16<30:38, 1.30it/s] 35%|███▍ | 1267/3665 [14:17<31:50, 1.25it/s] 35%|███▍ | 1268/3665 [14:18<30:59, 1.29it/s] 35%|███▍ | 1269/3665 [14:19<29:00, 1.38it/s] 35%|███▍ | 1270/3665 [14:19<28:31, 1.40it/s] 35%|███▍ | 1270/3665 [14:19<28:31, 1.40it/s] 35%|███▍ | 1271/3665 [14:20<29:03, 1.37it/s] 35%|███▍ | 1272/3665 [14:21<27:49, 1.43it/s] 35%|███▍ | 1273/3665 [14:21<26:26, 1.51it/s] 35%|███▍ | 1274/3665 [14:22<27:13, 1.46it/s] 35%|███▍ | 1275/3665 [14:23<27:12, 1.46it/s] 35%|███▍ | 1276/3665 [14:23<27:13, 1.46it/s] 35%|███▍ | 1277/3665 [14:24<27:44, 1.43it/s] 35%|███▍ | 1278/3665 [14:25<26:44, 1.49it/s] 35%|███▍ | 1279/3665 [14:25<26:12, 1.52it/s] 35%|███▍ | 1280/3665 [14:26<25:46, 1.54it/s] 35%|███▍ | 1280/3665 [14:26<25:46, 1.54it/s] 35%|███▍ | 1281/3665 [14:27<25:41, 1.55it/s] 35%|███▍ | 1282/3665 [14:27<25:32, 1.55it/s] 35%|███▌ | 1283/3665 [14:28<24:47, 1.60it/s] 35%|███▌ | 1284/3665 [14:28<24:38, 1.61it/s] 35%|███▌ | 1285/3665 [14:29<25:37, 1.55it/s] 35%|███▌ | 1286/3665 [14:30<24:49, 1.60it/s] 35%|███▌ | 1287/3665 [14:31<28:26, 1.39it/s] 35%|███▌ | 1288/3665 [14:31<27:23, 1.45it/s] 35%|███▌ | 1289/3665 [14:32<26:27, 1.50it/s] 35%|███▌ | 1290/3665 [14:33<26:04, 1.52it/s] 35%|███▌ | 1290/3665 [14:33<26:04, 1.52it/s] 35%|███▌ | 1291/3665 [14:33<25:39, 1.54it/s] 35%|███▌ | 1292/3665 [14:34<24:50, 1.59it/s] 35%|███▌ | 1293/3665 [14:34<24:16, 1.63it/s] 35%|███▌ | 1294/3665 [14:35<24:57, 1.58it/s] 35%|███▌ | 1295/3665 [14:36<25:21, 1.56it/s] 35%|███▌ | 1296/3665 [14:36<25:03, 1.58it/s] 35%|███▌ | 1297/3665 [14:37<25:52, 1.53it/s] 35%|███▌ | 1298/3665 [14:38<28:25, 1.39it/s] 35%|███▌ | 1299/3665 [14:39<30:47, 1.28it/s] 35%|███▌ | 1300/3665 [14:39<29:05, 1.36it/s] 35%|███▌ | 1300/3665 [14:39<29:05, 1.36it/s] 35%|███▌ | 1301/3665 [14:40<27:22, 1.44it/s] 36%|███▌ | 1302/3665 [14:41<27:15, 1.45it/s] 36%|███▌ | 1303/3665 [14:41<26:34, 1.48it/s] 36%|███▌ | 1304/3665 [14:42<27:10, 1.45it/s] 36%|███▌ | 1305/3665 [14:43<26:22, 1.49it/s] 36%|███▌ | 1306/3665 [14:43<25:51, 1.52it/s] 36%|███▌ | 1307/3665 [14:44<28:12, 1.39it/s] 36%|███▌ | 1308/3665 [14:45<28:02, 1.40it/s] 36%|███▌ | 1309/3665 [14:46<29:11, 1.35it/s] 36%|███▌ | 1310/3665 [14:46<29:53, 1.31it/s] 36%|███▌ | 1310/3665 [14:47<29:53, 1.31it/s] 36%|███▌ | 1311/3665 [14:47<28:31, 1.38it/s] 36%|███▌ | 1312/3665 [14:48<27:17, 1.44it/s] 36%|███▌ | 1313/3665 [14:48<26:19, 1.49it/s] 36%|███▌ | 1314/3665 [14:49<26:19, 1.49it/s] 36%|███▌ | 1315/3665 [14:50<25:50, 1.52it/s] 36%|███▌ | 1316/3665 [14:50<25:16, 1.55it/s] 36%|███▌ | 1317/3665 [14:51<25:03, 1.56it/s] 36%|███▌ | 1318/3665 [14:52<24:53, 1.57it/s] 36%|███▌ | 1319/3665 [14:52<24:12, 1.62it/s] 36%|███▌ | 1320/3665 [14:53<24:15, 1.61it/s] 36%|███▌ | 1320/3665 [14:53<24:15, 1.61it/s] 36%|███▌ | 1321/3665 [14:54<27:10, 1.44it/s] 36%|███▌ | 1322/3665 [14:54<27:02, 1.44it/s] 36%|███▌ | 1323/3665 [14:55<26:15, 1.49it/s] 36%|███▌ | 1324/3665 [14:56<25:50, 1.51it/s] 36%|███▌ | 1325/3665 [14:56<25:22, 1.54it/s] 36%|███▌ | 1326/3665 [14:57<24:56, 1.56it/s] 36%|███▌ | 1327/3665 [14:57<24:44, 1.57it/s] 36%|███▌ | 1328/3665 [14:58<25:30, 1.53it/s] 36%|███▋ | 1329/3665 [14:59<26:20, 1.48it/s] 36%|███▋ | 1330/3665 [15:00<25:55, 1.50it/s] 36%|███▋ | 1330/3665 [15:00<25:55, 1.50it/s] 36%|███▋ | 1331/3665 [15:00<26:54, 1.45it/s] 36%|███▋ | 1332/3665 [15:01<29:43, 1.31it/s] 36%|███▋ | 1333/3665 [15:02<28:03, 1.39it/s] 36%|███▋ | 1334/3665 [15:02<26:45, 1.45it/s] 36%|███▋ | 1335/3665 [15:03<25:58, 1.49it/s] 36%|███▋ | 1336/3665 [15:04<25:27, 1.52it/s] 36%|███▋ | 1337/3665 [15:04<26:47, 1.45it/s] 37%|███▋ | 1338/3665 [15:05<27:27, 1.41it/s] 37%|███▋ | 1339/3665 [15:06<27:10, 1.43it/s] 37%|███▋ | 1340/3665 [15:07<26:45, 1.45it/s] 37%|███▋ | 1340/3665 [15:07<26:45, 1.45it/s] 37%|███▋ | 1341/3665 [15:07<26:15, 1.47it/s] 37%|███▋ | 1342/3665 [15:08<25:36, 1.51it/s] 37%|███▋ | 1343/3665 [15:08<25:13, 1.53it/s] 37%|███▋ | 1344/3665 [15:09<24:22, 1.59it/s] 37%|███▋ | 1345/3665 [15:10<24:17, 1.59it/s] 37%|███▋ | 1346/3665 [15:10<24:41, 1.57it/s] 37%|███▋ | 1347/3665 [15:11<26:11, 1.47it/s] 37%|███▋ | 1348/3665 [15:12<25:44, 1.50it/s] 37%|███▋ | 1349/3665 [15:12<25:14, 1.53it/s] 37%|███▋ | 1350/3665 [15:13<24:53, 1.55it/s] 37%|███▋ | 1350/3665 [15:13<24:53, 1.55it/s] 37%|███▋ | 1351/3665 [15:14<24:17, 1.59it/s] 37%|███▋ | 1352/3665 [15:14<24:48, 1.55it/s] 37%|███▋ | 1353/3665 [15:15<26:08, 1.47it/s] 37%|███▋ | 1354/3665 [15:16<27:03, 1.42it/s] 37%|███▋ | 1355/3665 [15:16<26:00, 1.48it/s] 37%|███▋ | 1356/3665 [15:17<25:16, 1.52it/s] 37%|███▋ | 1357/3665 [15:18<25:34, 1.50it/s] 37%|███▋ | 1358/3665 [15:18<25:04, 1.53it/s] 37%|███▋ | 1359/3665 [15:19<24:35, 1.56it/s] 37%|███▋ | 1360/3665 [15:20<24:58, 1.54it/s] 37%|███▋ | 1360/3665 [15:20<24:58, 1.54it/s] 37%|███▋ | 1361/3665 [15:20<24:40, 1.56it/s] 37%|███▋ | 1362/3665 [15:21<24:35, 1.56it/s] 37%|███▋ | 1363/3665 [15:21<24:24, 1.57it/s] 37%|███▋ | 1364/3665 [15:22<25:46, 1.49it/s] 37%|███▋ | 1365/3665 [15:23<25:23, 1.51it/s] 37%|███▋ | 1366/3665 [15:23<24:56, 1.54it/s] 37%|███▋ | 1367/3665 [15:24<24:28, 1.56it/s] 37%|███▋ | 1368/3665 [15:25<25:11, 1.52it/s] 37%|███▋ | 1369/3665 [15:25<24:47, 1.54it/s] 37%|███▋ | 1370/3665 [15:26<24:01, 1.59it/s] 37%|███▋ | 1370/3665 [15:26<24:01, 1.59it/s] 37%|███▋ | 1371/3665 [15:27<25:40, 1.49it/s] 37%|███▋ | 1372/3665 [15:28<27:15, 1.40it/s] 37%|███▋ | 1373/3665 [15:28<28:00, 1.36it/s] 37%|███▋ | 1374/3665 [15:29<26:14, 1.45it/s] 38%|███▊ | 1375/3665 [15:30<34:10, 1.12it/s] 38%|███▊ | 1376/3665 [15:31<31:46, 1.20it/s] 38%|███▊ | 1377/3665 [15:32<28:51, 1.32it/s] 38%|███▊ | 1378/3665 [15:32<29:07, 1.31it/s] 38%|███▊ | 1379/3665 [15:33<28:06, 1.36it/s] 38%|███▊ | 1380/3665 [15:34<27:20, 1.39it/s] 38%|███▊ | 1380/3665 [15:34<27:20, 1.39it/s] 38%|███▊ | 1381/3665 [15:34<26:54, 1.41it/s] 38%|███▊ | 1382/3665 [15:35<26:05, 1.46it/s] 38%|███▊ | 1383/3665 [15:36<24:52, 1.53it/s] 38%|███▊ | 1384/3665 [15:36<24:35, 1.55it/s] 38%|███▊ | 1385/3665 [15:37<25:13, 1.51it/s] 38%|███▊ | 1386/3665 [15:38<24:43, 1.54it/s] 38%|███▊ | 1387/3665 [15:38<24:26, 1.55it/s] 38%|███▊ | 1388/3665 [15:39<24:46, 1.53it/s] 38%|███▊ | 1389/3665 [15:39<24:25, 1.55it/s] 38%|███▊ | 1390/3665 [15:40<24:18, 1.56it/s] 38%|███▊ | 1390/3665 [15:40<24:18, 1.56it/s] 38%|███▊ | 1391/3665 [15:41<24:07, 1.57it/s] 38%|███▊ | 1392/3665 [15:41<24:09, 1.57it/s] 38%|███▊ | 1393/3665 [15:42<23:29, 1.61it/s] 38%|███▊ | 1394/3665 [15:43<23:01, 1.64it/s] 38%|███▊ | 1395/3665 [15:43<24:30, 1.54it/s] 38%|███▊ | 1396/3665 [15:44<24:16, 1.56it/s] 38%|███▊ | 1397/3665 [15:45<24:10, 1.56it/s] 38%|███▊ | 1398/3665 [15:45<24:28, 1.54it/s] 38%|███▊ | 1399/3665 [15:46<25:54, 1.46it/s] 38%|███▊ | 1400/3665 [15:47<25:02, 1.51it/s] 38%|███▊ | 1400/3665 [15:47<25:02, 1.51it/s] 38%|███▊ | 1401/3665 [15:47<25:55, 1.46it/s] 38%|███▊ | 1402/3665 [15:48<25:10, 1.50it/s] 38%|███▊ | 1403/3665 [15:49<24:32, 1.54it/s] 38%|███▊ | 1404/3665 [15:49<25:31, 1.48it/s] 38%|███▊ | 1405/3665 [15:50<28:11, 1.34it/s] 38%|███▊ | 1406/3665 [15:51<26:16, 1.43it/s] 38%|███▊ | 1407/3665 [15:51<24:56, 1.51it/s] 38%|███▊ | 1408/3665 [15:52<25:00, 1.50it/s] 38%|███▊ | 1409/3665 [15:53<24:03, 1.56it/s] 38%|███▊ | 1410/3665 [15:53<23:55, 1.57it/s] 38%|███▊ | 1410/3665 [15:53<23:55, 1.57it/s] 38%|███▊ | 1411/3665 [15:54<24:23, 1.54it/s] 39%|███▊ | 1412/3665 [15:55<24:47, 1.52it/s] 39%|███▊ | 1413/3665 [15:55<24:26, 1.54it/s] 39%|███▊ | 1414/3665 [15:56<24:11, 1.55it/s] 39%|███▊ | 1415/3665 [15:57<24:36, 1.52it/s] 39%|███▊ | 1416/3665 [15:57<24:15, 1.55it/s] 39%|███▊ | 1417/3665 [15:58<24:28, 1.53it/s] 39%|███▊ | 1418/3665 [15:59<24:42, 1.52it/s] 39%|███▊ | 1419/3665 [15:59<24:45, 1.51it/s] 39%|███▊ | 1420/3665 [16:00<23:49, 1.57it/s] 39%|███▊ | 1420/3665 [16:00<23:49, 1.57it/s] 39%|███▉ | 1421/3665 [16:00<23:50, 1.57it/s] 39%|███▉ | 1422/3665 [16:01<23:49, 1.57it/s] 39%|███▉ | 1423/3665 [16:02<23:41, 1.58it/s] 39%|███▉ | 1424/3665 [16:02<24:01, 1.55it/s] 39%|███▉ | 1425/3665 [16:03<23:47, 1.57it/s] 39%|███▉ | 1426/3665 [16:04<23:28, 1.59it/s] 39%|███▉ | 1427/3665 [16:04<24:16, 1.54it/s] 39%|███▉ | 1428/3665 [16:05<23:59, 1.55it/s] 39%|███▉ | 1429/3665 [16:06<24:14, 1.54it/s] 39%|███▉ | 1430/3665 [16:06<24:03, 1.55it/s] 39%|███▉ | 1430/3665 [16:06<24:03, 1.55it/s] 39%|███▉ | 1431/3665 [16:07<23:59, 1.55it/s] 39%|███▉ | 1432/3665 [16:07<23:45, 1.57it/s] 39%|███▉ | 1433/3665 [16:08<23:41, 1.57it/s] 39%|███▉ | 1434/3665 [16:09<23:24, 1.59it/s] 39%|███▉ | 1435/3665 [16:09<23:12, 1.60it/s] 39%|███▉ | 1436/3665 [16:10<24:33, 1.51it/s] 39%|███▉ | 1437/3665 [16:11<24:00, 1.55it/s] 39%|███▉ | 1438/3665 [16:11<25:27, 1.46it/s] 39%|███▉ | 1439/3665 [16:12<24:37, 1.51it/s] 39%|███▉ | 1440/3665 [16:13<24:17, 1.53it/s] 39%|███▉ | 1440/3665 [16:13<24:17, 1.53it/s] 39%|███▉ | 1441/3665 [16:13<24:32, 1.51it/s] 39%|███▉ | 1442/3665 [16:14<24:10, 1.53it/s] 39%|███▉ | 1443/3665 [16:15<23:48, 1.56it/s] 39%|███▉ | 1444/3665 [16:15<24:02, 1.54it/s] 39%|███▉ | 1445/3665 [16:16<23:36, 1.57it/s] 39%|███▉ | 1446/3665 [16:17<23:34, 1.57it/s] 39%|███▉ | 1447/3665 [16:17<23:25, 1.58it/s] 40%|███▉ | 1448/3665 [16:18<24:42, 1.50it/s] 40%|███▉ | 1449/3665 [16:19<24:06, 1.53it/s] 40%|███▉ | 1450/3665 [16:19<24:54, 1.48it/s] 40%|███▉ | 1450/3665 [16:19<24:54, 1.48it/s] 40%|███▉ | 1451/3665 [16:20<25:21, 1.46it/s] 40%|███▉ | 1452/3665 [16:21<24:39, 1.50it/s] 40%|███▉ | 1453/3665 [16:21<24:49, 1.48it/s] 40%|███▉ | 1454/3665 [16:22<25:24, 1.45it/s] 40%|███▉ | 1455/3665 [16:23<24:49, 1.48it/s] 40%|███▉ | 1456/3665 [16:23<25:32, 1.44it/s] 40%|███▉ | 1457/3665 [16:24<25:54, 1.42it/s] 40%|███▉ | 1458/3665 [16:25<28:32, 1.29it/s] 40%|███▉ | 1459/3665 [16:26<26:58, 1.36it/s] 40%|███▉ | 1460/3665 [16:26<25:44, 1.43it/s] 40%|███▉ | 1460/3665 [16:26<25:44, 1.43it/s] 40%|███▉ | 1461/3665 [16:27<24:31, 1.50it/s] 40%|███▉ | 1462/3665 [16:28<24:06, 1.52it/s] 40%|███▉ | 1463/3665 [16:29<31:15, 1.17it/s] 40%|███▉ | 1464/3665 [16:30<29:24, 1.25it/s] 40%|███▉ | 1465/3665 [16:30<26:56, 1.36it/s] 40%|████ | 1466/3665 [16:31<27:05, 1.35it/s][INFO|trainer.py:3478] 2025-01-05 11:25:13,929 >> Saving model checkpoint to /work/train_output/checkpoint-1466 [INFO|configuration_utils.py:731] 2025-01-05 11:25:13,972 >> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/config.json [INFO|configuration_utils.py:800] 2025-01-05 11:25:13,973 >> Model config LlamaConfig { "architectures": [ "LlamaForCausalLM" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "hidden_act": "silu", "hidden_size": 4096, "initializer_range": 0.02, "intermediate_size": 14336, "max_position_embeddings": 8192, "mlp_bias": false, "model_type": "llama", "num_attention_heads": 32, "num_hidden_layers": 32, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": null, "rope_theta": 500000.0, "tie_word_embeddings": false, "torch_dtype": "bfloat16", "transformers_version": "4.42.4", "use_cache": true, "vocab_size": 128256 } [INFO|tokenization_utils_base.py:2574] 2025-01-05 11:25:14,478 >> tokenizer config file saved in /work/train_output/checkpoint-1466/tokenizer_config.json [INFO|tokenization_utils_base.py:2583] 2025-01-05 11:25:14,481 >> Special tokens file saved in /work/train_output/checkpoint-1466/special_tokens_map.json [INFO|trainer.py:3570] 2025-01-05 11:25:14,683 >> Deleting older checkpoint [/work/train_output/checkpoint-733] due to args.save_total_limit 40%|████ | 1467/3665 [16:32<34:40, 1.06it/s] 40%|████ | 1468/3665 [16:33<31:08, 1.18it/s] 40%|████ | 1469/3665 [16:34<28:39, 1.28it/s] 40%|████ | 1470/3665 [16:34<28:01, 1.31it/s] 40%|████ | 1470/3665 [16:34<28:01, 1.31it/s] 40%|████ | 1471/3665 [16:35<28:13, 1.30it/s] 40%|████ | 1472/3665 [16:36<26:35, 1.37it/s] 40%|████ | 1473/3665 [16:36<26:35, 1.37it/s] 40%|████ | 1474/3665 [16:37<25:54, 1.41it/s] 40%|████ | 1475/3665 [16:38<24:48, 1.47it/s] 40%|████ | 1476/3665 [16:38<24:05, 1.51it/s] 40%|████ | 1477/3665 [16:39<23:42, 1.54it/s] 40%|████ | 1478/3665 [16:40<26:47, 1.36it/s] 40%|████ | 1479/3665 [16:41<25:37, 1.42it/s] 40%|████ | 1480/3665 [16:41<24:52, 1.46it/s] 40%|████ | 1480/3665 [16:41<24:52, 1.46it/s] 40%|████ | 1481/3665 [16:42<24:22, 1.49it/s] 40%|████ | 1482/3665 [16:43<24:47, 1.47it/s] 40%|████ | 1483/3665 [16:43<25:36, 1.42it/s] 40%|████ | 1484/3665 [16:44<24:46, 1.47it/s] 41%|████ | 1485/3665 [16:45<25:15, 1.44it/s] 41%|████ | 1486/3665 [16:45<23:59, 1.51it/s] 41%|████ | 1487/3665 [16:46<24:27, 1.48it/s] 41%|████ | 1488/3665 [16:48<40:20, 1.11s/it] 41%|████ | 1489/3665 [16:49<36:39, 1.01s/it] 41%|████ | 1490/3665 [16:50<33:33, 1.08it/s] 41%|████ | 1490/3665 [16:50<33:33, 1.08it/s] 41%|████ | 1491/3665 [16:50<30:16, 1.20it/s] 41%|████ | 1492/3665 [16:51<28:49, 1.26it/s] 41%|████ | 1493/3665 [16:51<26:47, 1.35it/s] 41%|████ | 1494/3665 [16:52<25:30, 1.42it/s] 41%|████ | 1495/3665 [16:53<25:52, 1.40it/s] 41%|████ | 1496/3665 [16:53<24:43, 1.46it/s] 41%|████ | 1497/3665 [16:54<24:02, 1.50it/s] 41%|████ | 1498/3665 [16:55<24:01, 1.50it/s] 41%|████ | 1499/3665 [16:55<23:25, 1.54it/s] 41%|████ | 1500/3665 [16:56<23:16, 1.55it/s] 41%|████ | 1500/3665 [16:56<23:16, 1.55it/s] 41%|████ | 1501/3665 [16:57<23:16, 1.55it/s] 41%|████ | 1502/3665 [16:57<23:01, 1.57it/s] 41%|████ | 1503/3665 [16:58<23:33, 1.53it/s] 41%|████ | 1504/3665 [16:59<29:04, 1.24it/s] 41%|████ | 1505/3665 [17:00<26:56, 1.34it/s] 41%|████ | 1506/3665 [17:00<27:03, 1.33it/s] 41%|████ | 1507/3665 [17:01<26:48, 1.34it/s] 41%|████ | 1508/3665 [17:02<27:04, 1.33it/s] 41%|████ | 1509/3665 [17:03<27:14, 1.32it/s] 41%|████ | 1510/3665 [17:03<25:44, 1.40it/s] 41%|████ | 1510/3665 [17:03<25:44, 1.40it/s] 41%|████ | 1511/3665 [17:04<25:01, 1.43it/s] 41%|████▏ | 1512/3665 [17:05<25:39, 1.40it/s] 41%|████▏ | 1513/3665 [17:05<24:45, 1.45it/s] 41%|████▏ | 1514/3665 [17:06<23:34, 1.52it/s] 41%|████▏ | 1515/3665 [17:07<24:25, 1.47it/s] 41%|████▏ | 1516/3665 [17:07<23:47, 1.51it/s] 41%|████▏ | 1517/3665 [17:08<23:12, 1.54it/s] 41%|████▏ | 1518/3665 [17:09<23:29, 1.52it/s] 41%|████▏ | 1519/3665 [17:09<23:10, 1.54it/s] 41%|████▏ | 1520/3665 [17:10<22:26, 1.59it/s] 41%|████▏ | 1520/3665 [17:10<22:26, 1.59it/s] 42%|████▏ | 1521/3665 [17:10<22:36, 1.58it/s] 42%|████▏ | 1522/3665 [17:11<23:09, 1.54it/s] 42%|████▏ | 1523/3665 [17:12<24:00, 1.49it/s] 42%|████▏ | 1524/3665 [17:13<24:51, 1.44it/s] 42%|████▏ | 1525/3665 [17:13<23:36, 1.51it/s] 42%|████▏ | 1526/3665 [17:14<23:11, 1.54it/s] 42%|████▏ | 1527/3665 [17:15<23:00, 1.55it/s] 42%|████▏ | 1528/3665 [17:15<25:28, 1.40it/s] 42%|████▏ | 1529/3665 [17:16<25:02, 1.42it/s] 42%|████▏ | 1530/3665 [17:17<24:02, 1.48it/s] 42%|████▏ | 1530/3665 [17:17<24:02, 1.48it/s] 42%|████▏ | 1531/3665 [17:17<24:45, 1.44it/s] 42%|████▏ | 1532/3665 [17:18<23:51, 1.49it/s] 42%|████▏ | 1533/3665 [17:19<24:45, 1.44it/s] 42%|████▏ | 1534/3665 [17:20<25:09, 1.41it/s] 42%|████▏ | 1535/3665 [17:20<23:46, 1.49it/s] 42%|████▏ | 1536/3665 [17:21<23:20, 1.52it/s] 42%|████▏ | 1537/3665 [17:21<22:30, 1.58it/s] 42%|████▏ | 1538/3665 [17:22<22:27, 1.58it/s] 42%|████▏ | 1539/3665 [17:23<21:51, 1.62it/s] 42%|████▏ | 1540/3665 [17:23<22:36, 1.57it/s] 42%|████▏ | 1540/3665 [17:23<22:36, 1.57it/s] 42%|████▏ | 1541/3665 [17:24<22:35, 1.57it/s] 42%|████▏ | 1542/3665 [17:25<23:32, 1.50it/s] 42%|████▏ | 1543/3665 [17:25<23:32, 1.50it/s] 42%|████▏ | 1544/3665 [17:26<23:37, 1.50it/s] 42%|████▏ | 1545/3665 [17:27<23:01, 1.53it/s] 42%|████▏ | 1546/3665 [17:27<23:57, 1.47it/s] 42%|████▏ | 1547/3665 [17:28<23:13, 1.52it/s] 42%|████▏ | 1548/3665 [17:28<22:52, 1.54it/s] 42%|████▏ | 1549/3665 [17:29<22:44, 1.55it/s] 42%|████▏ | 1550/3665 [17:30<22:37, 1.56it/s] 42%|████▏ | 1550/3665 [17:30<22:37, 1.56it/s] 42%|████▏ | 1551/3665 [17:30<22:33, 1.56it/s] 42%|████▏ | 1552/3665 [17:31<21:54, 1.61it/s] 42%|████▏ | 1553/3665 [17:32<21:55, 1.61it/s] 42%|████▏ | 1554/3665 [17:32<22:35, 1.56it/s] 42%|████▏ | 1555/3665 [17:33<22:24, 1.57it/s] 42%|████▏ | 1556/3665 [17:34<22:08, 1.59it/s] 42%|████▏ | 1557/3665 [17:34<24:02, 1.46it/s] 43%|████▎ | 1558/3665 [17:35<23:22, 1.50it/s] 43%|████▎ | 1559/3665 [17:36<24:08, 1.45it/s] 43%|████▎ | 1560/3665 [17:36<23:35, 1.49it/s] 43%|████▎ | 1560/3665 [17:36<23:35, 1.49it/s] 43%|████▎ | 1561/3665 [17:37<23:05, 1.52it/s] 43%|████▎ | 1562/3665 [17:38<23:20, 1.50it/s] 43%|████▎ | 1563/3665 [17:38<23:19, 1.50it/s] 43%|████▎ | 1564/3665 [17:39<24:25, 1.43it/s] 43%|████▎ | 1565/3665 [17:40<23:35, 1.48it/s] 43%|████▎ | 1566/3665 [17:40<23:06, 1.51it/s] 43%|████▎ | 1567/3665 [17:41<22:36, 1.55it/s] 43%|████▎ | 1568/3665 [17:42<22:21, 1.56it/s] 43%|████▎ | 1569/3665 [17:42<22:04, 1.58it/s] 43%|████▎ | 1570/3665 [17:43<22:24, 1.56it/s] 43%|████▎ | 1570/3665 [17:43<22:24, 1.56it/s] 43%|████▎ | 1571/3665 [17:44<25:41, 1.36it/s] 43%|████▎ | 1572/3665 [17:44<24:22, 1.43it/s] 43%|████▎ | 1573/3665 [17:45<24:12, 1.44it/s] 43%|████▎ | 1574/3665 [17:46<25:07, 1.39it/s] 43%|████▎ | 1575/3665 [17:47<24:44, 1.41it/s] 43%|████▎ | 1576/3665 [17:47<23:42, 1.47it/s] 43%|████▎ | 1577/3665 [17:48<22:38, 1.54it/s] 43%|████▎ | 1578/3665 [17:49<27:54, 1.25it/s] 43%|████▎ | 1579/3665 [17:50<29:39, 1.17it/s] 43%|████▎ | 1580/3665 [17:51<27:07, 1.28it/s] 43%|████▎ | 1580/3665 [17:51<27:07, 1.28it/s] 43%|████▎ | 1581/3665 [17:51<25:34, 1.36it/s] 43%|████▎ | 1582/3665 [17:52<24:28, 1.42it/s] 43%|████▎ | 1583/3665 [17:53<25:35, 1.36it/s] 43%|████▎ | 1584/3665 [17:53<24:16, 1.43it/s] 43%|████▎ | 1585/3665 [17:54<23:19, 1.49it/s] 43%|████▎ | 1586/3665 [17:55<23:37, 1.47it/s] 43%|████▎ | 1587/3665 [17:55<24:24, 1.42it/s] 43%|████▎ | 1588/3665 [17:56<23:25, 1.48it/s] 43%|████▎ | 1589/3665 [17:57<22:55, 1.51it/s] 43%|████▎ | 1590/3665 [17:57<22:37, 1.53it/s] 43%|████▎ | 1590/3665 [17:57<22:37, 1.53it/s] 43%|████▎ | 1591/3665 [17:58<22:28, 1.54it/s] 43%|████▎ | 1592/3665 [17:59<23:24, 1.48it/s] 43%|████▎ | 1593/3665 [17:59<22:23, 1.54it/s] 43%|████▎ | 1594/3665 [18:00<22:14, 1.55it/s] 44%|████▎ | 1595/3665 [18:00<21:53, 1.58it/s] 44%|████▎ | 1596/3665 [18:01<21:45, 1.59it/s] 44%|████▎ | 1597/3665 [18:02<21:33, 1.60it/s] 44%|████▎ | 1598/3665 [18:02<21:31, 1.60it/s] 44%|████▎ | 1599/3665 [18:03<21:30, 1.60it/s] 44%|████▎ | 1600/3665 [18:03<21:22, 1.61it/s] 44%|████▎ | 1600/3665 [18:03<21:22, 1.61it/s] 44%|████▎ | 1601/3665 [18:04<22:35, 1.52it/s] 44%|████▎ | 1602/3665 [18:05<22:46, 1.51it/s] 44%|████▎ | 1603/3665 [18:06<22:47, 1.51it/s] 44%|████▍ | 1604/3665 [18:06<23:27, 1.46it/s] 44%|████▍ | 1605/3665 [18:07<22:56, 1.50it/s] 44%|████▍ | 1606/3665 [18:08<22:34, 1.52it/s] 44%|████▍ | 1607/3665 [18:08<22:04, 1.55it/s] 44%|████▍ | 1608/3665 [18:09<22:22, 1.53it/s] 44%|████▍ | 1609/3665 [18:10<25:40, 1.33it/s] 44%|████▍ | 1610/3665 [18:10<24:50, 1.38it/s] 44%|████▍ | 1610/3665 [18:10<24:50, 1.38it/s] 44%|████▍ | 1611/3665 [18:11<23:56, 1.43it/s] 44%|████▍ | 1612/3665 [18:12<23:16, 1.47it/s] 44%|████▍ | 1613/3665 [18:12<23:06, 1.48it/s] 44%|████▍ | 1614/3665 [18:13<23:00, 1.49it/s] 44%|████▍ | 1615/3665 [18:14<22:21, 1.53it/s] 44%|████▍ | 1616/3665 [18:14<22:00, 1.55it/s] 44%|████▍ | 1617/3665 [18:15<22:35, 1.51it/s] 44%|████▍ | 1618/3665 [18:16<24:55, 1.37it/s] 44%|████▍ | 1619/3665 [18:17<24:52, 1.37it/s] 44%|████▍ | 1620/3665 [18:17<24:12, 1.41it/s] 44%|████▍ | 1620/3665 [18:17<24:12, 1.41it/s] 44%|████▍ | 1621/3665 [18:18<23:19, 1.46it/s] 44%|████▍ | 1622/3665 [18:19<22:40, 1.50it/s] 44%|████▍ | 1623/3665 [18:19<22:51, 1.49it/s] 44%|████▍ | 1624/3665 [18:20<22:20, 1.52it/s] 44%|████▍ | 1625/3665 [18:20<22:03, 1.54it/s] 44%|████▍ | 1626/3665 [18:21<22:18, 1.52it/s] 44%|████▍ | 1627/3665 [18:22<25:29, 1.33it/s] 44%|████▍ | 1628/3665 [18:23<24:37, 1.38it/s] 44%|████▍ | 1629/3665 [18:23<23:06, 1.47it/s] 44%|████▍ | 1630/3665 [18:24<22:04, 1.54it/s] 44%|████▍ | 1630/3665 [18:24<22:04, 1.54it/s] 45%|████▍ | 1631/3665 [18:25<22:25, 1.51it/s] 45%|████▍ | 1632/3665 [18:25<21:54, 1.55it/s] 45%|████▍ | 1633/3665 [18:26<22:49, 1.48it/s] 45%|████▍ | 1634/3665 [18:27<22:20, 1.52it/s] 45%|████▍ | 1635/3665 [18:27<22:25, 1.51it/s] 45%|████▍ | 1636/3665 [18:28<23:35, 1.43it/s] 45%|████▍ | 1637/3665 [18:29<23:25, 1.44it/s] 45%|████▍ | 1638/3665 [18:29<22:44, 1.49it/s] 45%|████▍ | 1639/3665 [18:30<22:11, 1.52it/s] 45%|████▍ | 1640/3665 [18:31<21:53, 1.54it/s] 45%|████▍ | 1640/3665 [18:31<21:53, 1.54it/s] 45%|████▍ | 1641/3665 [18:31<22:11, 1.52it/s] 45%|████▍ | 1642/3665 [18:32<21:42, 1.55it/s] 45%|████▍ | 1643/3665 [18:33<21:23, 1.58it/s] 45%|████▍ | 1644/3665 [18:33<21:09, 1.59it/s] 45%|████▍ | 1645/3665 [18:34<21:08, 1.59it/s] 45%|████▍ | 1646/3665 [18:34<22:20, 1.51it/s] 45%|████▍ | 1647/3665 [18:35<21:55, 1.53it/s] 45%|████▍ | 1648/3665 [18:36<22:24, 1.50it/s] 45%|████▍ | 1649/3665 [18:37<26:13, 1.28it/s] 45%|████▌ | 1650/3665 [18:37<24:39, 1.36it/s] 45%|████▌ | 1650/3665 [18:38<24:39, 1.36it/s] 45%|████▌ | 1651/3665 [18:38<23:42, 1.42it/s] 45%|████▌ | 1652/3665 [18:39<22:50, 1.47it/s] 45%|████▌ | 1653/3665 [18:39<22:09, 1.51it/s] 45%|████▌ | 1654/3665 [18:40<24:07, 1.39it/s] 45%|████▌ | 1655/3665 [18:41<23:47, 1.41it/s] 45%|████▌ | 1656/3665 [18:42<22:58, 1.46it/s] 45%|████▌ | 1657/3665 [18:42<22:45, 1.47it/s] 45%|████▌ | 1658/3665 [18:43<22:08, 1.51it/s] 45%|████▌ | 1659/3665 [18:43<21:54, 1.53it/s] 45%|████▌ | 1660/3665 [18:44<23:23, 1.43it/s] 45%|████▌ | 1660/3665 [18:44<23:23, 1.43it/s] 45%|████▌ | 1661/3665 [18:45<25:06, 1.33it/s] 45%|████▌ | 1662/3665 [18:46<24:34, 1.36it/s] 45%|████▌ | 1663/3665 [18:47<24:05, 1.39it/s] 45%|████▌ | 1664/3665 [18:47<24:14, 1.38it/s] 45%|████▌ | 1665/3665 [18:48<23:14, 1.43it/s] 45%|████▌ | 1666/3665 [18:49<22:23, 1.49it/s] 45%|████▌ | 1667/3665 [18:49<22:58, 1.45it/s] 46%|████▌ | 1668/3665 [18:50<22:20, 1.49it/s] 46%|████▌ | 1669/3665 [18:51<22:22, 1.49it/s] 46%|████▌ | 1670/3665 [18:51<21:51, 1.52it/s] 46%|████▌ | 1670/3665 [18:51<21:51, 1.52it/s] 46%|████▌ | 1671/3665 [18:52<22:26, 1.48it/s] 46%|████▌ | 1672/3665 [18:53<22:19, 1.49it/s] 46%|████▌ | 1673/3665 [18:53<21:53, 1.52it/s] 46%|████▌ | 1674/3665 [18:54<21:31, 1.54it/s] 46%|████▌ | 1675/3665 [18:55<24:20, 1.36it/s] 46%|████▌ | 1676/3665 [18:55<23:14, 1.43it/s] 46%|████▌ | 1677/3665 [18:56<22:26, 1.48it/s] 46%|████▌ | 1678/3665 [18:57<21:52, 1.51it/s] 46%|████▌ | 1679/3665 [18:57<21:30, 1.54it/s] 46%|████▌ | 1680/3665 [18:58<21:13, 1.56it/s] 46%|████▌ | 1680/3665 [18:58<21:13, 1.56it/s] 46%|████▌ | 1681/3665 [18:58<21:03, 1.57it/s] 46%|████▌ | 1682/3665 [18:59<22:14, 1.49it/s] 46%|████▌ | 1683/3665 [19:00<22:11, 1.49it/s] 46%|████▌ | 1684/3665 [19:01<21:48, 1.51it/s] 46%|████▌ | 1685/3665 [19:01<21:28, 1.54it/s] 46%|████▌ | 1686/3665 [19:02<22:27, 1.47it/s] 46%|████▌ | 1687/3665 [19:03<24:10, 1.36it/s] 46%|████▌ | 1688/3665 [19:04<25:41, 1.28it/s] 46%|████▌ | 1689/3665 [19:04<24:01, 1.37it/s] 46%|████▌ | 1690/3665 [19:05<23:00, 1.43it/s] 46%|████▌ | 1690/3665 [19:05<23:00, 1.43it/s] 46%|████▌ | 1691/3665 [19:06<22:24, 1.47it/s] 46%|████▌ | 1692/3665 [19:06<22:26, 1.46it/s] 46%|████▌ | 1693/3665 [19:07<22:38, 1.45it/s] 46%|████▌ | 1694/3665 [19:08<22:02, 1.49it/s] 46%|████▌ | 1695/3665 [19:08<23:57, 1.37it/s] 46%|████▋ | 1696/3665 [19:09<23:29, 1.40it/s] 46%|████▋ | 1697/3665 [19:10<22:08, 1.48it/s] 46%|████▋ | 1698/3665 [19:10<21:30, 1.52it/s] 46%|████▋ | 1699/3665 [19:11<23:01, 1.42it/s] 46%|████▋ | 1700/3665 [19:12<22:12, 1.47it/s] 46%|████▋ | 1700/3665 [19:12<22:12, 1.47it/s] 46%|████▋ | 1701/3665 [19:12<22:24, 1.46it/s] 46%|████▋ | 1702/3665 [19:13<23:18, 1.40it/s] 46%|████▋ | 1703/3665 [19:14<22:33, 1.45it/s] 46%|████▋ | 1704/3665 [19:14<21:52, 1.49it/s] 47%|████▋ | 1705/3665 [19:15<21:29, 1.52it/s] 47%|████▋ | 1706/3665 [19:16<21:11, 1.54it/s] 47%|████▋ | 1707/3665 [19:16<20:55, 1.56it/s] 47%|████▋ | 1708/3665 [19:17<20:36, 1.58it/s] 47%|████▋ | 1709/3665 [19:18<21:07, 1.54it/s] 47%|████▋ | 1710/3665 [19:18<20:53, 1.56it/s] 47%|████▋ | 1710/3665 [19:18<20:53, 1.56it/s] 47%|████▋ | 1711/3665 [19:19<23:13, 1.40it/s] 47%|████▋ | 1712/3665 [19:20<22:12, 1.47it/s] 47%|████▋ | 1713/3665 [19:21<24:27, 1.33it/s] 47%|████▋ | 1714/3665 [19:21<24:30, 1.33it/s] 47%|████▋ | 1715/3665 [19:22<24:14, 1.34it/s] 47%|████▋ | 1716/3665 [19:23<23:04, 1.41it/s] 47%|████▋ | 1717/3665 [19:24<23:27, 1.38it/s] 47%|████▋ | 1718/3665 [19:24<22:28, 1.44it/s] 47%|████▋ | 1719/3665 [19:25<22:12, 1.46it/s] 47%|████▋ | 1720/3665 [19:25<21:45, 1.49it/s] 47%|████▋ | 1720/3665 [19:25<21:45, 1.49it/s] 47%|████▋ | 1721/3665 [19:26<21:49, 1.48it/s] 47%|████▋ | 1722/3665 [19:27<22:04, 1.47it/s] 47%|████▋ | 1723/3665 [19:27<21:38, 1.50it/s] 47%|████▋ | 1724/3665 [19:29<26:01, 1.24it/s] 47%|████▋ | 1725/3665 [19:29<24:07, 1.34it/s] 47%|████▋ | 1726/3665 [19:30<23:19, 1.39it/s] 47%|████▋ | 1727/3665 [19:31<22:56, 1.41it/s] 47%|████▋ | 1728/3665 [19:31<21:58, 1.47it/s] 47%|████▋ | 1729/3665 [19:32<21:19, 1.51it/s] 47%|████▋ | 1730/3665 [19:33<22:04, 1.46it/s] 47%|████▋ | 1730/3665 [19:33<22:04, 1.46it/s] 47%|████▋ | 1731/3665 [19:33<21:36, 1.49it/s] 47%|████▋ | 1732/3665 [19:34<21:07, 1.53it/s] 47%|████▋ | 1733/3665 [19:34<21:18, 1.51it/s] 47%|████▋ | 1734/3665 [19:35<22:07, 1.46it/s] 47%|████▋ | 1735/3665 [19:36<21:22, 1.50it/s] 47%|████▋ | 1736/3665 [19:36<20:51, 1.54it/s] 47%|████▋ | 1737/3665 [19:37<20:39, 1.56it/s] 47%|████▋ | 1738/3665 [19:38<24:46, 1.30it/s] 47%|████▋ | 1739/3665 [19:39<23:49, 1.35it/s] 47%|████▋ | 1740/3665 [19:39<22:46, 1.41it/s] 47%|████▋ | 1740/3665 [19:39<22:46, 1.41it/s] 48%|████▊ | 1741/3665 [19:40<22:03, 1.45it/s] 48%|████▊ | 1742/3665 [19:41<21:30, 1.49it/s] 48%|████▊ | 1743/3665 [19:42<22:49, 1.40it/s] 48%|████▊ | 1744/3665 [19:42<22:27, 1.43it/s] 48%|████▊ | 1745/3665 [19:43<21:42, 1.47it/s] 48%|████▊ | 1746/3665 [19:43<21:02, 1.52it/s] 48%|████▊ | 1747/3665 [19:44<21:28, 1.49it/s] 48%|████▊ | 1748/3665 [19:45<22:31, 1.42it/s] 48%|████▊ | 1749/3665 [19:46<22:12, 1.44it/s] 48%|████▊ | 1750/3665 [19:46<21:56, 1.45it/s] 48%|████▊ | 1750/3665 [19:46<21:56, 1.45it/s] 48%|████▊ | 1751/3665 [19:47<21:26, 1.49it/s] 48%|████▊ | 1752/3665 [19:48<21:01, 1.52it/s] 48%|████▊ | 1753/3665 [19:48<21:24, 1.49it/s] 48%|████▊ | 1754/3665 [19:49<21:56, 1.45it/s] 48%|████▊ | 1755/3665 [19:50<21:27, 1.48it/s] 48%|████▊ | 1756/3665 [19:50<21:03, 1.51it/s] 48%|████▊ | 1757/3665 [19:51<23:00, 1.38it/s] 48%|████▊ | 1758/3665 [19:52<22:26, 1.42it/s] 48%|████▊ | 1759/3665 [19:53<22:43, 1.40it/s] 48%|████▊ | 1760/3665 [19:53<21:52, 1.45it/s] 48%|████▊ | 1760/3665 [19:53<21:52, 1.45it/s] 48%|████▊ | 1761/3665 [19:54<21:16, 1.49it/s] 48%|████▊ | 1762/3665 [19:55<22:04, 1.44it/s] 48%|████▊ | 1763/3665 [19:55<21:25, 1.48it/s] 48%|████▊ | 1764/3665 [19:56<20:48, 1.52it/s] 48%|████▊ | 1765/3665 [19:56<20:23, 1.55it/s] 48%|████▊ | 1766/3665 [19:57<20:13, 1.57it/s] 48%|████▊ | 1767/3665 [19:58<20:06, 1.57it/s] 48%|████▊ | 1768/3665 [19:58<19:58, 1.58it/s] 48%|████▊ | 1769/3665 [19:59<19:56, 1.58it/s] 48%|████▊ | 1770/3665 [19:59<19:44, 1.60it/s] 48%|████▊ | 1770/3665 [20:00<19:44, 1.60it/s] 48%|████▊ | 1771/3665 [20:00<19:44, 1.60it/s] 48%|████▊ | 1772/3665 [20:01<20:53, 1.51it/s] 48%|████▊ | 1773/3665 [20:01<20:31, 1.54it/s] 48%|████▊ | 1774/3665 [20:02<21:20, 1.48it/s] 48%|████▊ | 1775/3665 [20:03<20:49, 1.51it/s] 48%|████▊ | 1776/3665 [20:04<21:38, 1.45it/s] 48%|████▊ | 1777/3665 [20:04<21:05, 1.49it/s] 49%|████▊ | 1778/3665 [20:05<21:14, 1.48it/s] 49%|████▊ | 1779/3665 [20:06<20:53, 1.50it/s] 49%|████▊ | 1780/3665 [20:06<20:32, 1.53it/s] 49%|████▊ | 1780/3665 [20:06<20:32, 1.53it/s] 49%|████▊ | 1781/3665 [20:07<21:34, 1.46it/s] 49%|████▊ | 1782/3665 [20:08<20:57, 1.50it/s] 49%|████▊ | 1783/3665 [20:08<21:31, 1.46it/s] 49%|████▊ | 1784/3665 [20:09<21:24, 1.46it/s] 49%|████▊ | 1785/3665 [20:10<21:36, 1.45it/s] 49%|████▊ | 1786/3665 [20:10<21:44, 1.44it/s] 49%|████▉ | 1787/3665 [20:11<21:02, 1.49it/s] 49%|████▉ | 1788/3665 [20:12<20:27, 1.53it/s] 49%|████▉ | 1789/3665 [20:12<20:11, 1.55it/s] 49%|████▉ | 1790/3665 [20:13<19:51, 1.57it/s] 49%|████▉ | 1790/3665 [20:13<19:51, 1.57it/s] 49%|████▉ | 1791/3665 [20:14<20:58, 1.49it/s] 49%|████▉ | 1792/3665 [20:14<21:00, 1.49it/s] 49%|████▉ | 1793/3665 [20:15<21:16, 1.47it/s] 49%|████▉ | 1794/3665 [20:16<20:50, 1.50it/s] 49%|████▉ | 1795/3665 [20:16<21:28, 1.45it/s] 49%|████▉ | 1796/3665 [20:17<21:20, 1.46it/s] 49%|████▉ | 1797/3665 [20:18<22:29, 1.38it/s] 49%|████▉ | 1798/3665 [20:18<21:39, 1.44it/s] 49%|████▉ | 1799/3665 [20:19<21:04, 1.48it/s] 49%|████▉ | 1800/3665 [20:20<20:34, 1.51it/s] 49%|████▉ | 1800/3665 [20:20<20:34, 1.51it/s] 49%|████▉ | 1801/3665 [20:21<21:31, 1.44it/s] 49%|████▉ | 1802/3665 [20:21<21:25, 1.45it/s] 49%|████▉ | 1803/3665 [20:22<20:40, 1.50it/s] 49%|████▉ | 1804/3665 [20:22<20:08, 1.54it/s] 49%|████▉ | 1805/3665 [20:23<19:52, 1.56it/s] 49%|████▉ | 1806/3665 [20:24<20:15, 1.53it/s] 49%|████▉ | 1807/3665 [20:24<20:57, 1.48it/s] 49%|████▉ | 1808/3665 [20:25<20:32, 1.51it/s] 49%|████▉ | 1809/3665 [20:26<20:43, 1.49it/s] 49%|████▉ | 1810/3665 [20:26<20:20, 1.52it/s] 49%|████▉ | 1810/3665 [20:26<20:20, 1.52it/s] 49%|████▉ | 1811/3665 [20:27<21:11, 1.46it/s] 49%|████▉ | 1812/3665 [20:28<20:41, 1.49it/s] 49%|████▉ | 1813/3665 [20:28<20:15, 1.52it/s] 49%|████▉ | 1814/3665 [20:29<20:24, 1.51it/s] 50%|████▉ | 1815/3665 [20:30<21:16, 1.45it/s] 50%|████▉ | 1816/3665 [20:30<20:46, 1.48it/s] 50%|████▉ | 1817/3665 [20:31<20:18, 1.52it/s] 50%|████▉ | 1818/3665 [20:32<20:26, 1.51it/s] 50%|████▉ | 1819/3665 [20:32<20:04, 1.53it/s] 50%|████▉ | 1820/3665 [20:33<23:01, 1.34it/s] 50%|████▉ | 1820/3665 [20:33<23:01, 1.34it/s] 50%|████▉ | 1821/3665 [20:34<23:42, 1.30it/s] 50%|████▉ | 1822/3665 [20:35<22:21, 1.37it/s] 50%|████▉ | 1823/3665 [20:35<21:23, 1.44it/s] 50%|████▉ | 1824/3665 [20:36<20:19, 1.51it/s] 50%|████▉ | 1825/3665 [20:37<19:56, 1.54it/s] 50%|████▉ | 1826/3665 [20:37<20:04, 1.53it/s] 50%|████▉ | 1827/3665 [20:38<20:13, 1.51it/s] 50%|████▉ | 1828/3665 [20:39<20:21, 1.50it/s] 50%|████▉ | 1829/3665 [20:39<19:52, 1.54it/s] 50%|████▉ | 1830/3665 [20:40<19:37, 1.56it/s] 50%|████▉ | 1830/3665 [20:40<19:37, 1.56it/s] 50%|████▉ | 1831/3665 [20:41<19:38, 1.56it/s] 50%|████▉ | 1832/3665 [20:41<19:21, 1.58it/s] 50%|█████ | 1833/3665 [20:42<18:50, 1.62it/s] 50%|█████ | 1834/3665 [20:42<18:53, 1.61it/s] 50%|█████ | 1835/3665 [20:43<20:11, 1.51it/s] 50%|█████ | 1836/3665 [20:44<19:55, 1.53it/s] 50%|█████ | 1837/3665 [20:44<19:38, 1.55it/s] 50%|█████ | 1838/3665 [20:45<19:00, 1.60it/s] 50%|█████ | 1839/3665 [20:46<19:05, 1.59it/s] 50%|█████ | 1840/3665 [20:46<20:41, 1.47it/s] 50%|█████ | 1840/3665 [20:46<20:41, 1.47it/s] 50%|█████ | 1841/3665 [20:47<23:06, 1.32it/s] 50%|█████ | 1842/3665 [20:48<21:50, 1.39it/s] 50%|█████ | 1843/3665 [20:49<23:45, 1.28it/s] 50%|█████ | 1844/3665 [20:49<21:54, 1.39it/s] 50%|█████ | 1845/3665 [20:50<21:00, 1.44it/s] 50%|█████ | 1846/3665 [20:51<20:23, 1.49it/s] 50%|█████ | 1847/3665 [20:51<20:57, 1.45it/s] 50%|█████ | 1848/3665 [20:52<20:42, 1.46it/s] 50%|█████ | 1849/3665 [20:53<20:12, 1.50it/s] 50%|█████ | 1850/3665 [20:53<20:44, 1.46it/s] 50%|█████ | 1850/3665 [20:54<20:44, 1.46it/s] 51%|█████ | 1851/3665 [20:54<21:37, 1.40it/s] 51%|█████ | 1852/3665 [20:55<20:43, 1.46it/s] 51%|█████ | 1853/3665 [20:56<20:03, 1.51it/s] 51%|█████ | 1854/3665 [20:56<19:40, 1.53it/s] 51%|█████ | 1855/3665 [20:57<19:24, 1.55it/s] 51%|█████ | 1856/3665 [20:57<19:07, 1.58it/s] 51%|█████ | 1857/3665 [20:58<18:54, 1.59it/s] 51%|█████ | 1858/3665 [20:59<19:18, 1.56it/s] 51%|█████ | 1859/3665 [20:59<18:46, 1.60it/s] 51%|█████ | 1860/3665 [21:00<18:43, 1.61it/s] 51%|█████ | 1860/3665 [21:00<18:43, 1.61it/s] 51%|█████ | 1861/3665 [21:01<19:18, 1.56it/s] 51%|█████ | 1862/3665 [21:01<19:02, 1.58it/s] 51%|█████ | 1863/3665 [21:02<19:59, 1.50it/s] 51%|█████ | 1864/3665 [21:03<20:04, 1.49it/s] 51%|█████ | 1865/3665 [21:03<20:46, 1.44it/s] 51%|█████ | 1866/3665 [21:04<20:02, 1.50it/s] 51%|█████ | 1867/3665 [21:05<19:30, 1.54it/s] 51%|█████ | 1868/3665 [21:05<19:48, 1.51it/s] 51%|█████ | 1869/3665 [21:06<19:03, 1.57it/s] 51%|█████ | 1870/3665 [21:06<19:03, 1.57it/s] 51%|█████ | 1870/3665 [21:06<19:03, 1.57it/s] 51%|█████ | 1871/3665 [21:07<18:40, 1.60it/s] 51%|█████ | 1872/3665 [21:08<18:41, 1.60it/s] 51%|█████ | 1873/3665 [21:08<19:02, 1.57it/s] 51%|█████ | 1874/3665 [21:09<18:48, 1.59it/s] 51%|█████ | 1875/3665 [21:10<18:37, 1.60it/s] 51%|█████ | 1876/3665 [21:10<18:39, 1.60it/s] 51%|█████ | 1877/3665 [21:11<19:10, 1.55it/s] 51%|█████ | 1878/3665 [21:12<19:01, 1.57it/s] 51%|█████▏ | 1879/3665 [21:12<18:55, 1.57it/s] 51%|█████▏ | 1880/3665 [21:13<18:48, 1.58it/s] 51%|█████▏ | 1880/3665 [21:13<18:48, 1.58it/s] 51%|█████▏ | 1881/3665 [21:13<18:50, 1.58it/s] 51%|█████▏ | 1882/3665 [21:14<18:46, 1.58it/s] 51%|█████▏ | 1883/3665 [21:15<18:44, 1.58it/s] 51%|█████▏ | 1884/3665 [21:15<18:39, 1.59it/s] 51%|█████▏ | 1885/3665 [21:16<18:35, 1.59it/s] 51%|█████▏ | 1886/3665 [21:17<19:15, 1.54it/s] 51%|█████▏ | 1887/3665 [21:17<18:57, 1.56it/s] 52%|█████▏ | 1888/3665 [21:18<18:51, 1.57it/s] 52%|█████▏ | 1889/3665 [21:19<19:40, 1.50it/s] 52%|█████▏ | 1890/3665 [21:19<19:17, 1.53it/s] 52%|█████▏ | 1890/3665 [21:19<19:17, 1.53it/s] 52%|█████▏ | 1891/3665 [21:20<19:09, 1.54it/s] 52%|█████▏ | 1892/3665 [21:21<21:01, 1.41it/s] 52%|█████▏ | 1893/3665 [21:21<20:13, 1.46it/s] 52%|█████▏ | 1894/3665 [21:22<19:33, 1.51it/s] 52%|█████▏ | 1895/3665 [21:23<19:06, 1.54it/s] 52%|█████▏ | 1896/3665 [21:23<19:19, 1.53it/s] 52%|█████▏ | 1897/3665 [21:24<19:01, 1.55it/s] 52%|█████▏ | 1898/3665 [21:24<18:57, 1.55it/s] 52%|█████▏ | 1899/3665 [21:25<18:46, 1.57it/s] 52%|█████▏ | 1900/3665 [21:26<20:41, 1.42it/s] 52%|█████▏ | 1900/3665 [21:26<20:41, 1.42it/s] 52%|█████▏ | 1901/3665 [21:27<21:07, 1.39it/s] 52%|█████▏ | 1902/3665 [21:27<20:44, 1.42it/s] 52%|█████▏ | 1903/3665 [21:28<20:06, 1.46it/s] 52%|█████▏ | 1904/3665 [21:29<19:37, 1.50it/s] 52%|█████▏ | 1905/3665 [21:29<19:12, 1.53it/s] 52%|█████▏ | 1906/3665 [21:30<19:00, 1.54it/s] 52%|█████▏ | 1907/3665 [21:31<18:40, 1.57it/s] 52%|█████▏ | 1908/3665 [21:31<18:26, 1.59it/s] 52%|█████▏ | 1909/3665 [21:32<18:29, 1.58it/s] 52%|█████▏ | 1910/3665 [21:33<19:25, 1.51it/s] 52%|█████▏ | 1910/3665 [21:33<19:25, 1.51it/s] 52%|█████▏ | 1911/3665 [21:33<19:11, 1.52it/s] 52%|█████▏ | 1912/3665 [21:34<21:56, 1.33it/s] 52%|█████▏ | 1913/3665 [21:35<20:49, 1.40it/s] 52%|█████▏ | 1914/3665 [21:35<19:55, 1.47it/s] 52%|█████▏ | 1915/3665 [21:36<19:01, 1.53it/s] 52%|█████▏ | 1916/3665 [21:37<18:39, 1.56it/s] 52%|█████▏ | 1917/3665 [21:37<18:08, 1.61it/s] 52%|█████▏ | 1918/3665 [21:38<18:12, 1.60it/s] 52%|█████▏ | 1919/3665 [21:38<18:32, 1.57it/s] 52%|█████▏ | 1920/3665 [21:39<18:18, 1.59it/s] 52%|█████▏ | 1920/3665 [21:39<18:18, 1.59it/s] 52%|█████▏ | 1921/3665 [21:40<18:15, 1.59it/s] 52%|█████▏ | 1922/3665 [21:40<18:18, 1.59it/s] 52%|█████▏ | 1923/3665 [21:41<17:52, 1.62it/s] 52%|█████▏ | 1924/3665 [21:42<17:56, 1.62it/s] 53%|█████▎ | 1925/3665 [21:42<17:53, 1.62it/s] 53%|█████▎ | 1926/3665 [21:43<18:03, 1.60it/s] 53%|█████▎ | 1927/3665 [21:43<19:02, 1.52it/s] 53%|█████▎ | 1928/3665 [21:44<18:44, 1.55it/s] 53%|█████▎ | 1929/3665 [21:45<19:04, 1.52it/s] 53%|█████▎ | 1930/3665 [21:45<19:08, 1.51it/s] 53%|█████▎ | 1930/3665 [21:45<19:08, 1.51it/s] 53%|█████▎ | 1931/3665 [21:46<18:50, 1.53it/s] 53%|█████▎ | 1932/3665 [21:47<18:37, 1.55it/s] 53%|█████▎ | 1933/3665 [21:47<18:30, 1.56it/s] 53%|█████▎ | 1934/3665 [21:48<18:42, 1.54it/s] 53%|█████▎ | 1935/3665 [21:49<18:31, 1.56it/s] 53%|█████▎ | 1936/3665 [21:49<18:53, 1.53it/s] 53%|█████▎ | 1937/3665 [21:50<18:13, 1.58it/s] 53%|█████▎ | 1938/3665 [21:51<18:07, 1.59it/s] 53%|█████▎ | 1939/3665 [21:51<18:06, 1.59it/s] 53%|█████▎ | 1940/3665 [21:52<17:44, 1.62it/s] 53%|█████▎ | 1940/3665 [21:52<17:44, 1.62it/s] 53%|█████▎ | 1941/3665 [21:52<17:52, 1.61it/s] 53%|█████▎ | 1942/3665 [21:53<18:57, 1.51it/s] 53%|█████▎ | 1943/3665 [21:54<18:45, 1.53it/s] 53%|█████▎ | 1944/3665 [21:54<18:51, 1.52it/s] 53%|█████▎ | 1945/3665 [21:55<18:33, 1.54it/s] 53%|█████▎ | 1946/3665 [21:56<17:58, 1.59it/s] 53%|█████▎ | 1947/3665 [21:56<18:03, 1.59it/s] 53%|█████▎ | 1948/3665 [21:57<18:25, 1.55it/s] 53%|█████▎ | 1949/3665 [21:58<19:20, 1.48it/s] 53%|█████▎ | 1950/3665 [21:58<18:53, 1.51it/s] 53%|█████▎ | 1950/3665 [21:58<18:53, 1.51it/s] 53%|█████▎ | 1951/3665 [21:59<19:06, 1.50it/s] 53%|█████▎ | 1952/3665 [22:00<19:03, 1.50it/s] 53%|█████▎ | 1953/3665 [22:00<18:41, 1.53it/s] 53%|█████▎ | 1954/3665 [22:01<19:17, 1.48it/s] 53%|█████▎ | 1955/3665 [22:02<19:42, 1.45it/s] 53%|█████▎ | 1956/3665 [22:02<18:45, 1.52it/s] 53%|█████▎ | 1957/3665 [22:03<19:08, 1.49it/s] 53%|█████▎ | 1958/3665 [22:04<22:58, 1.24it/s] 53%|█████▎ | 1959/3665 [22:05<21:22, 1.33it/s] 53%|█████▎ | 1960/3665 [22:06<20:56, 1.36it/s] 53%|█████▎ | 1960/3665 [22:06<20:56, 1.36it/s] 54%|█████▎ | 1961/3665 [22:06<20:00, 1.42it/s] 54%|█████▎ | 1962/3665 [22:07<20:11, 1.41it/s] 54%|█████▎ | 1963/3665 [22:07<19:03, 1.49it/s] 54%|█████▎ | 1964/3665 [22:08<19:00, 1.49it/s] 54%|█████▎ | 1965/3665 [22:09<18:30, 1.53it/s] 54%|█████▎ | 1966/3665 [22:09<18:37, 1.52it/s] 54%|█████▎ | 1967/3665 [22:10<18:19, 1.54it/s] 54%|█████▎ | 1968/3665 [22:11<18:10, 1.56it/s] 54%|█████▎ | 1969/3665 [22:11<17:54, 1.58it/s] 54%|█████▍ | 1970/3665 [22:12<17:48, 1.59it/s] 54%|█████▍ | 1970/3665 [22:12<17:48, 1.59it/s] 54%|█████▍ | 1971/3665 [22:13<19:50, 1.42it/s] 54%|█████▍ | 1972/3665 [22:13<18:49, 1.50it/s] 54%|█████▍ | 1973/3665 [22:14<19:23, 1.45it/s] 54%|█████▍ | 1974/3665 [22:15<18:53, 1.49it/s] 54%|█████▍ | 1975/3665 [22:15<18:35, 1.51it/s] 54%|█████▍ | 1976/3665 [22:16<19:19, 1.46it/s] 54%|█████▍ | 1977/3665 [22:17<18:46, 1.50it/s] 54%|█████▍ | 1978/3665 [22:17<18:29, 1.52it/s] 54%|█████▍ | 1979/3665 [22:18<18:18, 1.53it/s] 54%|█████▍ | 1980/3665 [22:19<22:19, 1.26it/s] 54%|█████▍ | 1980/3665 [22:19<22:19, 1.26it/s] 54%|█████▍ | 1981/3665 [22:20<21:29, 1.31it/s] 54%|█████▍ | 1982/3665 [22:21<22:25, 1.25it/s] 54%|█████▍ | 1983/3665 [22:21<20:50, 1.35it/s] 54%|█████▍ | 1984/3665 [22:22<19:48, 1.41it/s] 54%|█████▍ | 1985/3665 [22:23<18:59, 1.47it/s] 54%|█████▍ | 1986/3665 [22:23<18:57, 1.48it/s] 54%|█████▍ | 1987/3665 [22:24<18:55, 1.48it/s] 54%|█████▍ | 1988/3665 [22:25<19:26, 1.44it/s] 54%|█████▍ | 1989/3665 [22:25<20:48, 1.34it/s] 54%|█████▍ | 1990/3665 [22:26<20:17, 1.38it/s] 54%|█████▍ | 1990/3665 [22:26<20:17, 1.38it/s] 54%|█████▍ | 1991/3665 [22:27<19:31, 1.43it/s] 54%|█████▍ | 1992/3665 [22:28<19:45, 1.41it/s] 54%|█████▍ | 1993/3665 [22:28<19:59, 1.39it/s] 54%|█████▍ | 1994/3665 [22:29<19:05, 1.46it/s] 54%|█████▍ | 1995/3665 [22:30<18:53, 1.47it/s] 54%|█████▍ | 1996/3665 [22:30<18:50, 1.48it/s] 54%|█████▍ | 1997/3665 [22:31<19:20, 1.44it/s] 55%|█████▍ | 1998/3665 [22:32<18:37, 1.49it/s] 55%|█████▍ | 1999/3665 [22:32<18:12, 1.52it/s] 55%|█████▍ | 2000/3665 [22:33<18:48, 1.47it/s] 55%|█████▍ | 2000/3665 [22:33<18:48, 1.47it/s] 55%|█████▍ | 2001/3665 [22:34<19:40, 1.41it/s] 55%|█████▍ | 2002/3665 [22:34<18:51, 1.47it/s] 55%|█████▍ | 2003/3665 [22:35<18:21, 1.51it/s] 55%|█████▍ | 2004/3665 [22:36<18:21, 1.51it/s] 55%|█████▍ | 2005/3665 [22:36<17:39, 1.57it/s] 55%|█████▍ | 2006/3665 [22:37<18:00, 1.54it/s] 55%|█████▍ | 2007/3665 [22:37<17:45, 1.56it/s] 55%|█████▍ | 2008/3665 [22:38<17:56, 1.54it/s] 55%|█████▍ | 2009/3665 [22:39<17:49, 1.55it/s] 55%|█████▍ | 2010/3665 [22:39<17:43, 1.56it/s] 55%|█████▍ | 2010/3665 [22:39<17:43, 1.56it/s] 55%|█████▍ | 2011/3665 [22:40<18:18, 1.51it/s] 55%|█████▍ | 2012/3665 [22:41<18:01, 1.53it/s] 55%|█████▍ | 2013/3665 [22:41<18:06, 1.52it/s] 55%|█████▍ | 2014/3665 [22:42<17:51, 1.54it/s] 55%|█████▍ | 2015/3665 [22:43<17:37, 1.56it/s] 55%|█████▌ | 2016/3665 [22:43<17:23, 1.58it/s] 55%|█████▌ | 2017/3665 [22:44<17:17, 1.59it/s] 55%|█████▌ | 2018/3665 [22:45<18:05, 1.52it/s] 55%|█████▌ | 2019/3665 [22:45<18:18, 1.50it/s] 55%|█████▌ | 2020/3665 [22:46<19:02, 1.44it/s] 55%|█████▌ | 2020/3665 [22:46<19:02, 1.44it/s] 55%|█████▌ | 2021/3665 [22:47<18:39, 1.47it/s] 55%|█████▌ | 2022/3665 [22:48<19:16, 1.42it/s] 55%|█████▌ | 2023/3665 [22:48<18:31, 1.48it/s] 55%|█████▌ | 2024/3665 [22:49<18:28, 1.48it/s] 55%|█████▌ | 2025/3665 [22:49<18:01, 1.52it/s] 55%|█████▌ | 2026/3665 [22:50<18:21, 1.49it/s] 55%|█████▌ | 2027/3665 [22:51<17:51, 1.53it/s] 55%|█████▌ | 2028/3665 [22:51<18:00, 1.51it/s] 55%|█████▌ | 2029/3665 [22:52<18:02, 1.51it/s] 55%|█████▌ | 2030/3665 [22:53<17:37, 1.55it/s] 55%|█████▌ | 2030/3665 [22:53<17:37, 1.55it/s] 55%|█████▌ | 2031/3665 [22:53<17:34, 1.55it/s] 55%|█████▌ | 2032/3665 [22:54<19:56, 1.36it/s] 55%|█████▌ | 2033/3665 [22:55<20:04, 1.36it/s] 55%|█████▌ | 2034/3665 [22:56<19:08, 1.42it/s] 56%|█████▌ | 2035/3665 [22:56<18:57, 1.43it/s] 56%|█████▌ | 2036/3665 [22:57<19:11, 1.41it/s] 56%|█████▌ | 2037/3665 [22:58<20:53, 1.30it/s] 56%|█████▌ | 2038/3665 [22:59<20:43, 1.31it/s] 56%|█████▌ | 2039/3665 [22:59<19:28, 1.39it/s] 56%|█████▌ | 2040/3665 [23:00<18:43, 1.45it/s] 56%|█████▌ | 2040/3665 [23:00<18:43, 1.45it/s] 56%|█████▌ | 2041/3665 [23:01<18:26, 1.47it/s] 56%|█████▌ | 2042/3665 [23:01<17:40, 1.53it/s] 56%|█████▌ | 2043/3665 [23:02<17:30, 1.54it/s] 56%|█████▌ | 2044/3665 [23:02<17:13, 1.57it/s] 56%|█████▌ | 2045/3665 [23:03<17:30, 1.54it/s] 56%|█████▌ | 2046/3665 [23:04<18:23, 1.47it/s] 56%|█████▌ | 2047/3665 [23:04<17:50, 1.51it/s] 56%|█████▌ | 2048/3665 [23:05<19:51, 1.36it/s] 56%|█████▌ | 2049/3665 [23:06<19:16, 1.40it/s] 56%|█████▌ | 2050/3665 [23:07<18:10, 1.48it/s] 56%|█████▌ | 2050/3665 [23:07<18:10, 1.48it/s] 56%|█████▌ | 2051/3665 [23:07<17:45, 1.51it/s] 56%|█████▌ | 2052/3665 [23:08<17:22, 1.55it/s] 56%|█████▌ | 2053/3665 [23:09<17:16, 1.55it/s] 56%|█████▌ | 2054/3665 [23:09<17:45, 1.51it/s] 56%|█████▌ | 2055/3665 [23:10<17:21, 1.55it/s] 56%|█████▌ | 2056/3665 [23:10<16:48, 1.59it/s] 56%|█████▌ | 2057/3665 [23:11<17:07, 1.57it/s] 56%|█████▌ | 2058/3665 [23:12<17:05, 1.57it/s] 56%|█████▌ | 2059/3665 [23:12<18:08, 1.48it/s] 56%|█████▌ | 2060/3665 [23:13<20:06, 1.33it/s] 56%|█████▌ | 2060/3665 [23:13<20:06, 1.33it/s] 56%|█████▌ | 2061/3665 [23:14<19:31, 1.37it/s] 56%|█████▋ | 2062/3665 [23:15<18:40, 1.43it/s] 56%|█████▋ | 2063/3665 [23:15<18:03, 1.48it/s] 56%|█████▋ | 2064/3665 [23:16<17:38, 1.51it/s] 56%|█████▋ | 2065/3665 [23:17<18:48, 1.42it/s] 56%|█████▋ | 2066/3665 [23:17<18:02, 1.48it/s] 56%|█████▋ | 2067/3665 [23:18<18:36, 1.43it/s] 56%|█████▋ | 2068/3665 [23:19<17:40, 1.51it/s] 56%|█████▋ | 2069/3665 [23:19<17:19, 1.53it/s] 56%|█████▋ | 2070/3665 [23:20<17:10, 1.55it/s] 56%|█████▋ | 2070/3665 [23:20<17:10, 1.55it/s] 57%|█████▋ | 2071/3665 [23:21<17:00, 1.56it/s] 57%|█████▋ | 2072/3665 [23:21<16:46, 1.58it/s] 57%|█████▋ | 2073/3665 [23:22<16:41, 1.59it/s] 57%|█████▋ | 2074/3665 [23:23<17:01, 1.56it/s] 57%|█████▋ | 2075/3665 [23:23<16:31, 1.60it/s] 57%|█████▋ | 2076/3665 [23:24<17:20, 1.53it/s] 57%|█████▋ | 2077/3665 [23:24<17:04, 1.55it/s] 57%|█████▋ | 2078/3665 [23:25<19:58, 1.32it/s] 57%|█████▋ | 2079/3665 [23:26<18:55, 1.40it/s] 57%|█████▋ | 2080/3665 [23:27<18:39, 1.42it/s] 57%|█████▋ | 2080/3665 [23:27<18:39, 1.42it/s] 57%|█████▋ | 2081/3665 [23:27<18:00, 1.47it/s] 57%|█████▋ | 2082/3665 [23:28<17:12, 1.53it/s] 57%|█████▋ | 2083/3665 [23:29<16:58, 1.55it/s] 57%|█████▋ | 2084/3665 [23:29<17:12, 1.53it/s] 57%|█████▋ | 2085/3665 [23:30<18:11, 1.45it/s] 57%|█████▋ | 2086/3665 [23:31<17:39, 1.49it/s] 57%|█████▋ | 2087/3665 [23:31<18:06, 1.45it/s] 57%|█████▋ | 2088/3665 [23:32<18:33, 1.42it/s] 57%|█████▋ | 2089/3665 [23:33<17:56, 1.46it/s] 57%|█████▋ | 2090/3665 [23:33<17:32, 1.50it/s] 57%|█████▋ | 2090/3665 [23:33<17:32, 1.50it/s] 57%|█████▋ | 2091/3665 [23:34<17:37, 1.49it/s] 57%|█████▋ | 2092/3665 [23:35<18:31, 1.42it/s] 57%|█████▋ | 2093/3665 [23:36<18:53, 1.39it/s] 57%|█████▋ | 2094/3665 [23:37<22:46, 1.15it/s] 57%|█████▋ | 2095/3665 [23:38<23:37, 1.11it/s] 57%|█████▋ | 2096/3665 [23:39<22:20, 1.17it/s] 57%|█████▋ | 2097/3665 [23:39<20:32, 1.27it/s] 57%|█████▋ | 2098/3665 [23:40<19:34, 1.33it/s] 57%|█████▋ | 2099/3665 [23:41<18:58, 1.38it/s] 57%|█████▋ | 2100/3665 [23:41<18:15, 1.43it/s] 57%|█████▋ | 2100/3665 [23:41<18:15, 1.43it/s] 57%|█████▋ | 2101/3665 [23:42<17:46, 1.47it/s] 57%|█████▋ | 2102/3665 [23:42<16:54, 1.54it/s] 57%|█████▋ | 2103/3665 [23:43<17:36, 1.48it/s] 57%|█████▋ | 2104/3665 [23:44<17:05, 1.52it/s] 57%|█████▋ | 2105/3665 [23:44<16:43, 1.56it/s] 57%|█████▋ | 2106/3665 [23:45<16:33, 1.57it/s] 57%|█████▋ | 2107/3665 [23:46<16:29, 1.57it/s] 58%|█████▊ | 2108/3665 [23:46<16:47, 1.55it/s] 58%|█████▊ | 2109/3665 [23:47<16:40, 1.55it/s] 58%|█████▊ | 2110/3665 [23:48<16:25, 1.58it/s] 58%|█████▊ | 2110/3665 [23:48<16:25, 1.58it/s] 58%|█████▊ | 2111/3665 [23:48<16:26, 1.58it/s] 58%|█████▊ | 2112/3665 [23:49<16:58, 1.52it/s] 58%|█████▊ | 2113/3665 [23:49<16:38, 1.55it/s] 58%|█████▊ | 2114/3665 [23:50<16:30, 1.57it/s] 58%|█████▊ | 2115/3665 [23:51<16:52, 1.53it/s] 58%|█████▊ | 2116/3665 [23:51<16:35, 1.56it/s] 58%|█████▊ | 2117/3665 [23:52<16:26, 1.57it/s] 58%|█████▊ | 2118/3665 [23:53<16:23, 1.57it/s] 58%|█████▊ | 2119/3665 [23:53<16:53, 1.52it/s] 58%|█████▊ | 2120/3665 [23:55<21:58, 1.17it/s] 58%|█████▊ | 2120/3665 [23:55<21:58, 1.17it/s] 58%|█████▊ | 2121/3665 [23:55<20:38, 1.25it/s] 58%|█████▊ | 2122/3665 [23:56<19:35, 1.31it/s] 58%|█████▊ | 2123/3665 [23:57<18:32, 1.39it/s] 58%|█████▊ | 2124/3665 [23:57<18:14, 1.41it/s] 58%|█████▊ | 2125/3665 [23:58<17:44, 1.45it/s] 58%|█████▊ | 2126/3665 [23:59<17:10, 1.49it/s] 58%|█████▊ | 2127/3665 [23:59<16:51, 1.52it/s] 58%|█████▊ | 2128/3665 [24:00<17:23, 1.47it/s] 58%|█████▊ | 2129/3665 [24:01<17:03, 1.50it/s] 58%|█████▊ | 2130/3665 [24:01<16:48, 1.52it/s] 58%|█████▊ | 2130/3665 [24:01<16:48, 1.52it/s] 58%|█████▊ | 2131/3665 [24:02<16:42, 1.53it/s] 58%|█████▊ | 2132/3665 [24:03<17:07, 1.49it/s] 58%|█████▊ | 2133/3665 [24:03<17:35, 1.45it/s] 58%|█████▊ | 2134/3665 [24:04<17:09, 1.49it/s] 58%|█████▊ | 2135/3665 [24:05<16:40, 1.53it/s] 58%|█████▊ | 2136/3665 [24:05<16:25, 1.55it/s] 58%|█████▊ | 2137/3665 [24:06<16:18, 1.56it/s] 58%|█████▊ | 2138/3665 [24:06<15:50, 1.61it/s] 58%|█████▊ | 2139/3665 [24:07<18:03, 1.41it/s] 58%|█████▊ | 2140/3665 [24:08<17:23, 1.46it/s] 58%|█████▊ | 2140/3665 [24:08<17:23, 1.46it/s] 58%|█████▊ | 2141/3665 [24:09<16:42, 1.52it/s] 58%|█████▊ | 2142/3665 [24:09<17:49, 1.42it/s] 58%|█████▊ | 2143/3665 [24:11<22:59, 1.10it/s] 58%|█████▊ | 2144/3665 [24:11<21:16, 1.19it/s] 59%|█████▊ | 2145/3665 [24:12<19:39, 1.29it/s] 59%|█████▊ | 2146/3665 [24:13<18:23, 1.38it/s] 59%|█████▊ | 2147/3665 [24:13<17:38, 1.43it/s] 59%|█████▊ | 2148/3665 [24:14<17:26, 1.45it/s] 59%|█████▊ | 2149/3665 [24:15<16:36, 1.52it/s] 59%|█████▊ | 2150/3665 [24:15<16:43, 1.51it/s] 59%|█████▊ | 2150/3665 [24:15<16:43, 1.51it/s] 59%|█████▊ | 2151/3665 [24:16<17:08, 1.47it/s] 59%|█████▊ | 2152/3665 [24:17<16:42, 1.51it/s] 59%|█████▊ | 2153/3665 [24:17<16:03, 1.57it/s] 59%|█████▉ | 2154/3665 [24:18<15:53, 1.58it/s] 59%|█████▉ | 2155/3665 [24:19<17:50, 1.41it/s] 59%|█████▉ | 2156/3665 [24:19<17:10, 1.46it/s] 59%|█████▉ | 2157/3665 [24:20<17:02, 1.47it/s] 59%|█████▉ | 2158/3665 [24:21<17:29, 1.44it/s] 59%|█████▉ | 2159/3665 [24:21<17:24, 1.44it/s] 59%|█████▉ | 2160/3665 [24:22<17:50, 1.41it/s] 59%|█████▉ | 2160/3665 [24:22<17:50, 1.41it/s] 59%|█████▉ | 2161/3665 [24:23<17:40, 1.42it/s] 59%|█████▉ | 2162/3665 [24:23<16:44, 1.50it/s] 59%|█████▉ | 2163/3665 [24:24<16:18, 1.53it/s] 59%|█████▉ | 2164/3665 [24:25<16:05, 1.55it/s] 59%|█████▉ | 2165/3665 [24:25<16:31, 1.51it/s] 59%|█████▉ | 2166/3665 [24:26<17:00, 1.47it/s] 59%|█████▉ | 2167/3665 [24:27<16:39, 1.50it/s] 59%|█████▉ | 2168/3665 [24:27<16:22, 1.52it/s] 59%|█████▉ | 2169/3665 [24:28<17:02, 1.46it/s] 59%|█████▉ | 2170/3665 [24:29<17:01, 1.46it/s] 59%|█████▉ | 2170/3665 [24:29<17:01, 1.46it/s] 59%|█████▉ | 2171/3665 [24:29<16:44, 1.49it/s] 59%|█████▉ | 2172/3665 [24:30<17:08, 1.45it/s] 59%|█████▉ | 2173/3665 [24:31<16:38, 1.49it/s] 59%|█████▉ | 2174/3665 [24:31<16:52, 1.47it/s] 59%|█████▉ | 2175/3665 [24:32<17:27, 1.42it/s] 59%|█████▉ | 2176/3665 [24:33<17:15, 1.44it/s] 59%|█████▉ | 2177/3665 [24:34<16:44, 1.48it/s] 59%|█████▉ | 2178/3665 [24:34<16:56, 1.46it/s] 59%|█████▉ | 2179/3665 [24:35<16:31, 1.50it/s] 59%|█████▉ | 2180/3665 [24:35<16:06, 1.54it/s] 59%|█████▉ | 2180/3665 [24:35<16:06, 1.54it/s] 60%|█████▉ | 2181/3665 [24:36<16:22, 1.51it/s] 60%|█████▉ | 2182/3665 [24:37<16:00, 1.54it/s] 60%|█████▉ | 2183/3665 [24:37<16:16, 1.52it/s] 60%|█████▉ | 2184/3665 [24:38<16:48, 1.47it/s] 60%|█████▉ | 2185/3665 [24:39<18:43, 1.32it/s] 60%|█████▉ | 2186/3665 [24:40<17:23, 1.42it/s] 60%|█████▉ | 2187/3665 [24:40<16:42, 1.47it/s] 60%|█████▉ | 2188/3665 [24:41<15:58, 1.54it/s] 60%|█████▉ | 2189/3665 [24:42<15:41, 1.57it/s] 60%|█████▉ | 2190/3665 [24:42<17:18, 1.42it/s] 60%|█████▉ | 2190/3665 [24:42<17:18, 1.42it/s] 60%|█████▉ | 2191/3665 [24:43<18:08, 1.35it/s] 60%|█████▉ | 2192/3665 [24:44<17:17, 1.42it/s] 60%|█████▉ | 2193/3665 [24:44<16:45, 1.46it/s] 60%|█████▉ | 2194/3665 [24:45<16:18, 1.50it/s] 60%|█████▉ | 2195/3665 [24:46<16:04, 1.52it/s] 60%|█████▉ | 2196/3665 [24:46<16:40, 1.47it/s] 60%|█████▉ | 2197/3665 [24:47<16:17, 1.50it/s] 60%|█████▉ | 2198/3665 [24:48<15:58, 1.53it/s] 60%|██████ | 2199/3665 [24:48<16:18, 1.50it/s][INFO|trainer.py:3478] 2025-01-05 11:33:31,431 >> Saving model checkpoint to /work/train_output/checkpoint-2199 [INFO|configuration_utils.py:731] 2025-01-05 11:33:31,469 >> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/config.json [INFO|configuration_utils.py:800] 2025-01-05 11:33:31,470 >> Model config LlamaConfig { "architectures": [ "LlamaForCausalLM" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "hidden_act": "silu", "hidden_size": 4096, "initializer_range": 0.02, "intermediate_size": 14336, "max_position_embeddings": 8192, "mlp_bias": false, "model_type": "llama", "num_attention_heads": 32, "num_hidden_layers": 32, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": null, "rope_theta": 500000.0, "tie_word_embeddings": false, "torch_dtype": "bfloat16", "transformers_version": "4.42.4", "use_cache": true, "vocab_size": 128256 } [INFO|tokenization_utils_base.py:2574] 2025-01-05 11:33:31,980 >> tokenizer config file saved in /work/train_output/checkpoint-2199/tokenizer_config.json [INFO|tokenization_utils_base.py:2583] 2025-01-05 11:33:31,982 >> Special tokens file saved in /work/train_output/checkpoint-2199/special_tokens_map.json [INFO|trainer.py:3570] 2025-01-05 11:33:32,148 >> Deleting older checkpoint [/work/train_output/checkpoint-1466] due to args.save_total_limit 60%|██████ | 2200/3665 [24:50<21:33, 1.13it/s] 60%|██████ | 2200/3665 [24:50<21:33, 1.13it/s] 60%|██████ | 2201/3665 [24:50<19:45, 1.23it/s] 60%|██████ | 2202/3665 [24:51<18:18, 1.33it/s] 60%|██████ | 2203/3665 [24:52<17:21, 1.40it/s] 60%|██████ | 2204/3665 [24:52<16:43, 1.46it/s] 60%|██████ | 2205/3665 [24:53<17:00, 1.43it/s] 60%|██████ | 2206/3665 [24:54<16:22, 1.49it/s] 60%|██████ | 2207/3665 [24:55<19:37, 1.24it/s] 60%|██████ | 2208/3665 [24:55<18:50, 1.29it/s] 60%|██████ | 2209/3665 [24:56<17:37, 1.38it/s] 60%|██████ | 2210/3665 [24:57<17:26, 1.39it/s] 60%|██████ | 2210/3665 [24:57<17:26, 1.39it/s] 60%|██████ | 2211/3665 [24:57<17:17, 1.40it/s] 60%|██████ | 2212/3665 [24:58<16:39, 1.45it/s] 60%|██████ | 2213/3665 [24:59<16:33, 1.46it/s] 60%|██████ | 2214/3665 [24:59<16:10, 1.50it/s] 60%|██████ | 2215/3665 [25:00<15:44, 1.53it/s] 60%|██████ | 2216/3665 [25:01<16:49, 1.43it/s] 60%|██████ | 2217/3665 [25:02<17:11, 1.40it/s] 61%|██████ | 2218/3665 [25:02<16:31, 1.46it/s] 61%|██████ | 2219/3665 [25:03<15:45, 1.53it/s] 61%|██████ | 2220/3665 [25:03<15:58, 1.51it/s] 61%|██████ | 2220/3665 [25:03<15:58, 1.51it/s] 61%|██████ | 2221/3665 [25:04<16:12, 1.48it/s] 61%|██████ | 2222/3665 [25:05<15:49, 1.52it/s] 61%|██████ | 2223/3665 [25:05<15:56, 1.51it/s] 61%|██████ | 2224/3665 [25:06<15:38, 1.54it/s] 61%|██████ | 2225/3665 [25:07<15:08, 1.58it/s] 61%|██████ | 2226/3665 [25:07<15:06, 1.59it/s] 61%|██████ | 2227/3665 [25:08<15:04, 1.59it/s] 61%|██████ | 2228/3665 [25:09<15:22, 1.56it/s] 61%|██████ | 2229/3665 [25:09<16:12, 1.48it/s] 61%|██████ | 2230/3665 [25:10<15:48, 1.51it/s] 61%|██████ | 2230/3665 [25:10<15:48, 1.51it/s] 61%|██████ | 2231/3665 [25:11<16:27, 1.45it/s] 61%|██████ | 2232/3665 [25:11<15:54, 1.50it/s] 61%|██████ | 2233/3665 [25:12<16:51, 1.42it/s] 61%|██████ | 2234/3665 [25:13<15:56, 1.50it/s] 61%|██████ | 2235/3665 [25:13<15:54, 1.50it/s] 61%|██████ | 2236/3665 [25:15<20:58, 1.14it/s] 61%|██████ | 2237/3665 [25:15<19:12, 1.24it/s] 61%|██████ | 2238/3665 [25:16<18:11, 1.31it/s] 61%|██████ | 2239/3665 [25:17<17:55, 1.33it/s] 61%|██████ | 2240/3665 [25:17<16:40, 1.42it/s] 61%|██████ | 2240/3665 [25:17<16:40, 1.42it/s] 61%|██████ | 2241/3665 [25:18<16:19, 1.45it/s] 61%|██████ | 2242/3665 [25:19<16:48, 1.41it/s] 61%|██████ | 2243/3665 [25:19<16:11, 1.46it/s] 61%|██████ | 2244/3665 [25:20<15:46, 1.50it/s] 61%|██████▏ | 2245/3665 [25:21<15:23, 1.54it/s] 61%|██████▏ | 2246/3665 [25:21<15:55, 1.48it/s] 61%|██████▏ | 2247/3665 [25:22<15:33, 1.52it/s] 61%|██████▏ | 2248/3665 [25:23<15:18, 1.54it/s] 61%|██████▏ | 2249/3665 [25:23<15:07, 1.56it/s] 61%|██████▏ | 2250/3665 [25:24<15:20, 1.54it/s] 61%|██████▏ | 2250/3665 [25:24<15:20, 1.54it/s] 61%|██████▏ | 2251/3665 [25:25<15:13, 1.55it/s] 61%|██████▏ | 2252/3665 [25:25<14:57, 1.57it/s] 61%|██████▏ | 2253/3665 [25:26<14:57, 1.57it/s] 62%|██████▏ | 2254/3665 [25:26<15:14, 1.54it/s] 62%|██████▏ | 2255/3665 [25:27<15:20, 1.53it/s] 62%|██████▏ | 2256/3665 [25:28<15:42, 1.49it/s] 62%|██████▏ | 2257/3665 [25:29<15:44, 1.49it/s] 62%|██████▏ | 2258/3665 [25:29<15:57, 1.47it/s] 62%|██████▏ | 2259/3665 [25:30<16:16, 1.44it/s] 62%|██████▏ | 2260/3665 [25:31<15:48, 1.48it/s] 62%|██████▏ | 2260/3665 [25:31<15:48, 1.48it/s] 62%|██████▏ | 2261/3665 [25:31<16:24, 1.43it/s] 62%|██████▏ | 2262/3665 [25:32<15:53, 1.47it/s] 62%|██████▏ | 2263/3665 [25:33<15:24, 1.52it/s] 62%|██████▏ | 2264/3665 [25:33<15:09, 1.54it/s] 62%|██████▏ | 2265/3665 [25:34<15:15, 1.53it/s] 62%|██████▏ | 2266/3665 [25:35<15:57, 1.46it/s] 62%|██████▏ | 2267/3665 [25:35<15:32, 1.50it/s] 62%|██████▏ | 2268/3665 [25:36<15:31, 1.50it/s] 62%|██████▏ | 2269/3665 [25:37<16:27, 1.41it/s] 62%|██████▏ | 2270/3665 [25:37<15:46, 1.47it/s] 62%|██████▏ | 2270/3665 [25:37<15:46, 1.47it/s] 62%|██████▏ | 2271/3665 [25:38<15:46, 1.47it/s] 62%|██████▏ | 2272/3665 [25:39<15:23, 1.51it/s] 62%|██████▏ | 2273/3665 [25:40<18:47, 1.23it/s] 62%|██████▏ | 2274/3665 [25:41<19:55, 1.16it/s] 62%|██████▏ | 2275/3665 [25:41<18:49, 1.23it/s] 62%|██████▏ | 2276/3665 [25:42<19:38, 1.18it/s] 62%|██████▏ | 2277/3665 [25:43<18:00, 1.29it/s] 62%|██████▏ | 2278/3665 [25:44<17:00, 1.36it/s] 62%|██████▏ | 2279/3665 [25:44<16:31, 1.40it/s] 62%|██████▏ | 2280/3665 [25:45<15:54, 1.45it/s] 62%|██████▏ | 2280/3665 [25:45<15:54, 1.45it/s] 62%|██████▏ | 2281/3665 [25:46<18:27, 1.25it/s] 62%|██████▏ | 2282/3665 [25:47<17:19, 1.33it/s] 62%|██████▏ | 2283/3665 [25:47<16:20, 1.41it/s] 62%|██████▏ | 2284/3665 [25:48<15:45, 1.46it/s] 62%|██████▏ | 2285/3665 [25:49<15:20, 1.50it/s] 62%|██████▏ | 2286/3665 [25:49<17:10, 1.34it/s] 62%|██████▏ | 2287/3665 [25:50<16:39, 1.38it/s] 62%|██████▏ | 2288/3665 [25:51<16:40, 1.38it/s] 62%|██████▏ | 2289/3665 [25:51<15:39, 1.47it/s] 62%|██████▏ | 2290/3665 [25:52<15:13, 1.50it/s] 62%|██████▏ | 2290/3665 [25:52<15:13, 1.50it/s] 63%|██████▎ | 2291/3665 [25:53<15:01, 1.52it/s] 63%|██████▎ | 2292/3665 [25:53<14:46, 1.55it/s] 63%|██████▎ | 2293/3665 [25:54<14:19, 1.60it/s] 63%|██████▎ | 2294/3665 [25:55<14:20, 1.59it/s] 63%|██████▎ | 2295/3665 [25:55<14:22, 1.59it/s] 63%|██████▎ | 2296/3665 [25:56<14:21, 1.59it/s] 63%|██████▎ | 2297/3665 [25:56<14:50, 1.54it/s] 63%|██████▎ | 2298/3665 [25:57<16:37, 1.37it/s] 63%|██████▎ | 2299/3665 [25:58<16:10, 1.41it/s] 63%|██████▎ | 2300/3665 [25:59<15:58, 1.42it/s] 63%|██████▎ | 2300/3665 [25:59<15:58, 1.42it/s] 63%|██████▎ | 2301/3665 [25:59<15:26, 1.47it/s] 63%|██████▎ | 2302/3665 [26:00<14:58, 1.52it/s] 63%|██████▎ | 2303/3665 [26:01<14:38, 1.55it/s] 63%|██████▎ | 2304/3665 [26:01<15:46, 1.44it/s] 63%|██████▎ | 2305/3665 [26:02<14:59, 1.51it/s] 63%|██████▎ | 2306/3665 [26:04<24:58, 1.10s/it] 63%|██████▎ | 2307/3665 [26:05<21:37, 1.05it/s] 63%|██████▎ | 2308/3665 [26:05<19:46, 1.14it/s] 63%|██████▎ | 2309/3665 [26:06<18:06, 1.25it/s] 63%|██████▎ | 2310/3665 [26:07<18:51, 1.20it/s] 63%|██████▎ | 2310/3665 [26:07<18:51, 1.20it/s] 63%|██████▎ | 2311/3665 [26:08<17:24, 1.30it/s] 63%|██████▎ | 2312/3665 [26:08<16:25, 1.37it/s] 63%|██████▎ | 2313/3665 [26:09<15:31, 1.45it/s] 63%|██████▎ | 2314/3665 [26:10<15:31, 1.45it/s] 63%|██████▎ | 2315/3665 [26:10<15:49, 1.42it/s] 63%|██████▎ | 2316/3665 [26:11<15:21, 1.46it/s] 63%|██████▎ | 2317/3665 [26:12<14:59, 1.50it/s] 63%|██████▎ | 2318/3665 [26:12<14:39, 1.53it/s] 63%|██████▎ | 2319/3665 [26:13<14:22, 1.56it/s] 63%|██████▎ | 2320/3665 [26:13<14:10, 1.58it/s] 63%|██████▎ | 2320/3665 [26:13<14:10, 1.58it/s] 63%|██████▎ | 2321/3665 [26:14<14:43, 1.52it/s] 63%|██████▎ | 2322/3665 [26:15<16:52, 1.33it/s] 63%|██████▎ | 2323/3665 [26:16<16:01, 1.40it/s] 63%|██████▎ | 2324/3665 [26:17<16:58, 1.32it/s] 63%|██████▎ | 2325/3665 [26:17<16:45, 1.33it/s] 63%|██████▎ | 2326/3665 [26:18<15:35, 1.43it/s] 63%|██████▎ | 2327/3665 [26:18<14:59, 1.49it/s] 64%|██████▎ | 2328/3665 [26:20<18:02, 1.24it/s] 64%|██████▎ | 2329/3665 [26:20<16:48, 1.33it/s] 64%|██████▎ | 2330/3665 [26:21<16:19, 1.36it/s] 64%|██████▎ | 2330/3665 [26:21<16:19, 1.36it/s] 64%|██████▎ | 2331/3665 [26:22<15:59, 1.39it/s] 64%|██████▎ | 2332/3665 [26:22<15:21, 1.45it/s] 64%|██████▎ | 2333/3665 [26:23<15:14, 1.46it/s] 64%|██████▎ | 2334/3665 [26:24<14:50, 1.50it/s] 64%|██████▎ | 2335/3665 [26:24<14:14, 1.56it/s] 64%|██████▎ | 2336/3665 [26:25<14:03, 1.58it/s] 64%|██████▍ | 2337/3665 [26:25<14:43, 1.50it/s] 64%|██████▍ | 2338/3665 [26:26<14:22, 1.54it/s] 64%|██████▍ | 2339/3665 [26:27<14:32, 1.52it/s] 64%|██████▍ | 2340/3665 [26:28<16:35, 1.33it/s] 64%|██████▍ | 2340/3665 [26:28<16:35, 1.33it/s] 64%|██████▍ | 2341/3665 [26:28<15:45, 1.40it/s] 64%|██████▍ | 2342/3665 [26:30<19:40, 1.12it/s] 64%|██████▍ | 2343/3665 [26:30<17:36, 1.25it/s] 64%|██████▍ | 2344/3665 [26:31<16:30, 1.33it/s] 64%|██████▍ | 2345/3665 [26:31<15:40, 1.40it/s] 64%|██████▍ | 2346/3665 [26:32<15:55, 1.38it/s] 64%|██████▍ | 2347/3665 [26:33<15:10, 1.45it/s] 64%|██████▍ | 2348/3665 [26:34<15:24, 1.42it/s] 64%|██████▍ | 2349/3665 [26:34<14:49, 1.48it/s] 64%|██████▍ | 2350/3665 [26:35<14:29, 1.51it/s] 64%|██████▍ | 2350/3665 [26:35<14:29, 1.51it/s] 64%|██████▍ | 2351/3665 [26:35<14:15, 1.54it/s] 64%|██████▍ | 2352/3665 [26:36<13:47, 1.59it/s] 64%|██████▍ | 2353/3665 [26:37<14:14, 1.54it/s] 64%|██████▍ | 2354/3665 [26:37<14:03, 1.55it/s] 64%|██████▍ | 2355/3665 [26:38<15:58, 1.37it/s] 64%|██████▍ | 2356/3665 [26:39<16:05, 1.36it/s] 64%|██████▍ | 2357/3665 [26:40<15:15, 1.43it/s] 64%|██████▍ | 2358/3665 [26:40<15:08, 1.44it/s] 64%|██████▍ | 2359/3665 [26:41<14:39, 1.48it/s] 64%|██████▍ | 2360/3665 [26:42<14:15, 1.53it/s] 64%|██████▍ | 2360/3665 [26:42<14:15, 1.53it/s] 64%|██████▍ | 2361/3665 [26:42<14:12, 1.53it/s] 64%|██████▍ | 2362/3665 [26:43<14:30, 1.50it/s] 64%|██████▍ | 2363/3665 [26:44<14:43, 1.47it/s] 65%|██████▍ | 2364/3665 [26:44<15:22, 1.41it/s] 65%|██████▍ | 2365/3665 [26:45<14:54, 1.45it/s] 65%|██████▍ | 2366/3665 [26:46<14:52, 1.46it/s] 65%|██████▍ | 2367/3665 [26:46<14:31, 1.49it/s] 65%|██████▍ | 2368/3665 [26:47<14:14, 1.52it/s] 65%|██████▍ | 2369/3665 [26:48<14:31, 1.49it/s] 65%|██████▍ | 2370/3665 [26:48<14:16, 1.51it/s] 65%|██████▍ | 2370/3665 [26:48<14:16, 1.51it/s] 65%|██████▍ | 2371/3665 [26:49<14:13, 1.52it/s] 65%|██████▍ | 2372/3665 [26:50<13:57, 1.54it/s] 65%|██████▍ | 2373/3665 [26:50<14:03, 1.53it/s] 65%|██████▍ | 2374/3665 [26:51<13:52, 1.55it/s] 65%|██████▍ | 2375/3665 [26:52<14:23, 1.49it/s] 65%|██████▍ | 2376/3665 [26:53<15:47, 1.36it/s] 65%|██████▍ | 2377/3665 [26:53<15:44, 1.36it/s] 65%|██████▍ | 2378/3665 [26:54<15:24, 1.39it/s] 65%|██████▍ | 2379/3665 [26:55<14:42, 1.46it/s] 65%|██████▍ | 2380/3665 [26:55<15:01, 1.42it/s] 65%|██████▍ | 2380/3665 [26:55<15:01, 1.42it/s] 65%|██████▍ | 2381/3665 [26:56<17:28, 1.22it/s] 65%|██████▍ | 2382/3665 [26:57<16:57, 1.26it/s] 65%|██████▌ | 2383/3665 [26:58<16:15, 1.31it/s] 65%|██████▌ | 2384/3665 [26:58<15:17, 1.40it/s] 65%|██████▌ | 2385/3665 [26:59<14:41, 1.45it/s] 65%|██████▌ | 2386/3665 [27:00<14:17, 1.49it/s] 65%|██████▌ | 2387/3665 [27:00<13:54, 1.53it/s] 65%|██████▌ | 2388/3665 [27:01<13:26, 1.58it/s] 65%|██████▌ | 2389/3665 [27:02<15:21, 1.38it/s] 65%|██████▌ | 2390/3665 [27:03<15:31, 1.37it/s] 65%|██████▌ | 2390/3665 [27:03<15:31, 1.37it/s] 65%|██████▌ | 2391/3665 [27:03<14:55, 1.42it/s] 65%|██████▌ | 2392/3665 [27:04<15:20, 1.38it/s] 65%|██████▌ | 2393/3665 [27:05<14:43, 1.44it/s] 65%|██████▌ | 2394/3665 [27:05<14:20, 1.48it/s] 65%|██████▌ | 2395/3665 [27:06<13:54, 1.52it/s] 65%|██████▌ | 2396/3665 [27:07<14:20, 1.47it/s] 65%|██████▌ | 2397/3665 [27:07<14:15, 1.48it/s] 65%|██████▌ | 2398/3665 [27:08<15:05, 1.40it/s] 65%|██████▌ | 2399/3665 [27:09<14:32, 1.45it/s] 65%|██████▌ | 2400/3665 [27:09<14:02, 1.50it/s] 65%|██████▌ | 2400/3665 [27:09<14:02, 1.50it/s] 66%|██████▌ | 2401/3665 [27:10<14:30, 1.45it/s] 66%|██████▌ | 2402/3665 [27:11<14:00, 1.50it/s] 66%|██████▌ | 2403/3665 [27:11<14:27, 1.45it/s] 66%|██████▌ | 2404/3665 [27:12<15:31, 1.35it/s] 66%|██████▌ | 2405/3665 [27:13<16:49, 1.25it/s] 66%|██████▌ | 2406/3665 [27:14<15:45, 1.33it/s] 66%|██████▌ | 2407/3665 [27:14<15:18, 1.37it/s] 66%|██████▌ | 2408/3665 [27:15<14:33, 1.44it/s] 66%|██████▌ | 2409/3665 [27:16<14:10, 1.48it/s] 66%|██████▌ | 2410/3665 [27:16<13:50, 1.51it/s] 66%|██████▌ | 2410/3665 [27:16<13:50, 1.51it/s] 66%|██████▌ | 2411/3665 [27:17<13:56, 1.50it/s] 66%|██████▌ | 2412/3665 [27:18<14:30, 1.44it/s] 66%|██████▌ | 2413/3665 [27:18<13:57, 1.49it/s] 66%|██████▌ | 2414/3665 [27:19<13:35, 1.53it/s] 66%|██████▌ | 2415/3665 [27:20<13:53, 1.50it/s] 66%|██████▌ | 2416/3665 [27:20<13:31, 1.54it/s] 66%|██████▌ | 2417/3665 [27:21<13:16, 1.57it/s] 66%|██████▌ | 2418/3665 [27:22<13:34, 1.53it/s] 66%|██████▌ | 2419/3665 [27:22<14:09, 1.47it/s] 66%|██████▌ | 2420/3665 [27:23<14:16, 1.45it/s] 66%|██████▌ | 2420/3665 [27:23<14:16, 1.45it/s] 66%|██████▌ | 2421/3665 [27:24<13:56, 1.49it/s] 66%|██████▌ | 2422/3665 [27:24<14:16, 1.45it/s] 66%|██████▌ | 2423/3665 [27:25<14:10, 1.46it/s] 66%|██████▌ | 2424/3665 [27:26<14:06, 1.47it/s] 66%|██████▌ | 2425/3665 [27:26<13:45, 1.50it/s] 66%|██████▌ | 2426/3665 [27:27<13:25, 1.54it/s] 66%|██████▌ | 2427/3665 [27:28<13:33, 1.52it/s] 66%|██████▌ | 2428/3665 [27:28<13:16, 1.55it/s] 66%|██████▋ | 2429/3665 [27:29<13:23, 1.54it/s] 66%|██████▋ | 2430/3665 [27:30<15:25, 1.33it/s] 66%|██████▋ | 2430/3665 [27:30<15:25, 1.33it/s] 66%|██████▋ | 2431/3665 [27:31<14:39, 1.40it/s] 66%|██████▋ | 2432/3665 [27:31<14:07, 1.46it/s] 66%|██████▋ | 2433/3665 [27:32<13:43, 1.50it/s] 66%|██████▋ | 2434/3665 [27:33<14:16, 1.44it/s] 66%|██████▋ | 2435/3665 [27:33<14:31, 1.41it/s] 66%|██████▋ | 2436/3665 [27:34<13:55, 1.47it/s] 66%|██████▋ | 2437/3665 [27:35<13:29, 1.52it/s] 67%|██████▋ | 2438/3665 [27:35<13:17, 1.54it/s] 67%|██████▋ | 2439/3665 [27:36<13:07, 1.56it/s] 67%|██████▋ | 2440/3665 [27:36<12:55, 1.58it/s] 67%|██████▋ | 2440/3665 [27:36<12:55, 1.58it/s] 67%|██████▋ | 2441/3665 [27:37<14:05, 1.45it/s] 67%|██████▋ | 2442/3665 [27:38<13:24, 1.52it/s] 67%|██████▋ | 2443/3665 [27:38<13:07, 1.55it/s] 67%|██████▋ | 2444/3665 [27:39<13:01, 1.56it/s] 67%|██████▋ | 2445/3665 [27:40<12:50, 1.58it/s] 67%|██████▋ | 2446/3665 [27:40<12:30, 1.62it/s] 67%|██████▋ | 2447/3665 [27:41<12:54, 1.57it/s] 67%|██████▋ | 2448/3665 [27:42<13:31, 1.50it/s] 67%|██████▋ | 2449/3665 [27:42<13:30, 1.50it/s] 67%|██████▋ | 2450/3665 [27:43<14:03, 1.44it/s] 67%|██████▋ | 2450/3665 [27:43<14:03, 1.44it/s] 67%|██████▋ | 2451/3665 [27:44<13:42, 1.48it/s] 67%|██████▋ | 2452/3665 [27:44<13:37, 1.48it/s] 67%|██████▋ | 2453/3665 [27:45<13:40, 1.48it/s] 67%|██████▋ | 2454/3665 [27:46<13:05, 1.54it/s] 67%|██████▋ | 2455/3665 [27:46<12:59, 1.55it/s] 67%|██████▋ | 2456/3665 [27:47<12:56, 1.56it/s] 67%|██████▋ | 2457/3665 [27:48<13:08, 1.53it/s] 67%|██████▋ | 2458/3665 [27:48<14:22, 1.40it/s] 67%|██████▋ | 2459/3665 [27:49<14:07, 1.42it/s] 67%|██████▋ | 2460/3665 [27:50<13:38, 1.47it/s] 67%|██████▋ | 2460/3665 [27:50<13:38, 1.47it/s] 67%|██████▋ | 2461/3665 [27:51<14:12, 1.41it/s] 67%|██████▋ | 2462/3665 [27:51<13:25, 1.49it/s] 67%|██████▋ | 2463/3665 [27:52<12:53, 1.55it/s] 67%|██████▋ | 2464/3665 [27:52<13:26, 1.49it/s] 67%|██████▋ | 2465/3665 [27:53<13:26, 1.49it/s] 67%|██████▋ | 2466/3665 [27:54<13:30, 1.48it/s] 67%|██████▋ | 2467/3665 [27:55<13:38, 1.46it/s] 67%|██████▋ | 2468/3665 [27:55<13:16, 1.50it/s] 67%|██████▋ | 2469/3665 [27:56<12:56, 1.54it/s] 67%|██████▋ | 2470/3665 [27:57<13:39, 1.46it/s] 67%|██████▋ | 2470/3665 [27:57<13:39, 1.46it/s] 67%|██████▋ | 2471/3665 [27:57<13:50, 1.44it/s] 67%|██████▋ | 2472/3665 [27:58<13:25, 1.48it/s] 67%|██████▋ | 2473/3665 [27:58<13:08, 1.51it/s] 68%|██████▊ | 2474/3665 [27:59<12:54, 1.54it/s] 68%|██████▊ | 2475/3665 [28:00<12:46, 1.55it/s] 68%|██████▊ | 2476/3665 [28:00<12:38, 1.57it/s] 68%|██████▊ | 2477/3665 [28:01<12:32, 1.58it/s] 68%|██████▊ | 2478/3665 [28:02<12:31, 1.58it/s] 68%|██████▊ | 2479/3665 [28:02<12:12, 1.62it/s] 68%|██████▊ | 2480/3665 [28:03<12:16, 1.61it/s] 68%|██████▊ | 2480/3665 [28:03<12:16, 1.61it/s] 68%|██████▊ | 2481/3665 [28:03<12:05, 1.63it/s] 68%|██████▊ | 2482/3665 [28:04<12:08, 1.62it/s] 68%|██████▊ | 2483/3665 [28:05<12:28, 1.58it/s] 68%|██████▊ | 2484/3665 [28:06<13:47, 1.43it/s] 68%|██████▊ | 2485/3665 [28:06<14:04, 1.40it/s] 68%|██████▊ | 2486/3665 [28:07<13:15, 1.48it/s] 68%|██████▊ | 2487/3665 [28:07<12:41, 1.55it/s] 68%|██████▊ | 2488/3665 [28:08<12:17, 1.60it/s] 68%|██████▊ | 2489/3665 [28:09<12:19, 1.59it/s] 68%|██████▊ | 2490/3665 [28:09<12:12, 1.60it/s] 68%|██████▊ | 2490/3665 [28:09<12:12, 1.60it/s] 68%|██████▊ | 2491/3665 [28:10<12:13, 1.60it/s] 68%|██████▊ | 2492/3665 [28:11<12:33, 1.56it/s] 68%|██████▊ | 2493/3665 [28:11<12:22, 1.58it/s] 68%|██████▊ | 2494/3665 [28:12<12:22, 1.58it/s] 68%|██████▊ | 2495/3665 [28:13<12:18, 1.58it/s] 68%|██████▊ | 2496/3665 [28:13<12:42, 1.53it/s] 68%|██████▊ | 2497/3665 [28:14<12:46, 1.52it/s] 68%|██████▊ | 2498/3665 [28:14<12:35, 1.54it/s] 68%|██████▊ | 2499/3665 [28:15<12:28, 1.56it/s] 68%|██████▊ | 2500/3665 [28:16<12:57, 1.50it/s] 68%|██████▊ | 2500/3665 [28:16<12:57, 1.50it/s] 68%|██████▊ | 2501/3665 [28:17<13:01, 1.49it/s] 68%|██████▊ | 2502/3665 [28:17<13:11, 1.47it/s] 68%|██████▊ | 2503/3665 [28:18<12:52, 1.50it/s] 68%|██████▊ | 2504/3665 [28:19<12:55, 1.50it/s] 68%|██████▊ | 2505/3665 [28:19<12:40, 1.53it/s] 68%|██████▊ | 2506/3665 [28:20<13:05, 1.47it/s] 68%|██████▊ | 2507/3665 [28:21<13:03, 1.48it/s] 68%|██████▊ | 2508/3665 [28:21<13:32, 1.42it/s] 68%|██████▊ | 2509/3665 [28:22<13:22, 1.44it/s] 68%|██████▊ | 2510/3665 [28:23<12:58, 1.48it/s] 68%|██████▊ | 2510/3665 [28:23<12:58, 1.48it/s] 69%|██████▊ | 2511/3665 [28:23<12:30, 1.54it/s] 69%|██████▊ | 2512/3665 [28:24<13:06, 1.47it/s] 69%|██████▊ | 2513/3665 [28:25<12:49, 1.50it/s] 69%|██████▊ | 2514/3665 [28:25<12:37, 1.52it/s] 69%|██████▊ | 2515/3665 [28:26<12:26, 1.54it/s] 69%|██████▊ | 2516/3665 [28:27<12:53, 1.48it/s] 69%|██████▊ | 2517/3665 [28:27<12:51, 1.49it/s] 69%|██████▊ | 2518/3665 [28:28<12:30, 1.53it/s] 69%|██████▊ | 2519/3665 [28:29<12:20, 1.55it/s] 69%|██████▉ | 2520/3665 [28:29<12:11, 1.57it/s] 69%|██████▉ | 2520/3665 [28:29<12:11, 1.57it/s] 69%|██████▉ | 2521/3665 [28:30<12:14, 1.56it/s] 69%|██████▉ | 2522/3665 [28:30<12:11, 1.56it/s] 69%|██████▉ | 2523/3665 [28:31<12:00, 1.58it/s] 69%|██████▉ | 2524/3665 [28:32<11:59, 1.58it/s] 69%|██████▉ | 2525/3665 [28:32<11:52, 1.60it/s] 69%|██████▉ | 2526/3665 [28:33<12:18, 1.54it/s] 69%|██████▉ | 2527/3665 [28:34<12:08, 1.56it/s] 69%|██████▉ | 2528/3665 [28:34<12:06, 1.57it/s] 69%|██████▉ | 2529/3665 [28:35<12:36, 1.50it/s] 69%|██████▉ | 2530/3665 [28:36<12:42, 1.49it/s] 69%|██████▉ | 2530/3665 [28:36<12:42, 1.49it/s] 69%|██████▉ | 2531/3665 [28:36<12:30, 1.51it/s] 69%|██████▉ | 2532/3665 [28:37<12:19, 1.53it/s] 69%|██████▉ | 2533/3665 [28:38<12:29, 1.51it/s] 69%|██████▉ | 2534/3665 [28:38<12:17, 1.53it/s] 69%|██████▉ | 2535/3665 [28:39<12:34, 1.50it/s] 69%|██████▉ | 2536/3665 [28:40<12:32, 1.50it/s] 69%|██████▉ | 2537/3665 [28:40<12:31, 1.50it/s] 69%|██████▉ | 2538/3665 [28:41<12:12, 1.54it/s] 69%|██████▉ | 2539/3665 [28:42<12:04, 1.55it/s] 69%|██████▉ | 2540/3665 [28:42<12:23, 1.51it/s] 69%|██████▉ | 2540/3665 [28:42<12:23, 1.51it/s] 69%|██████▉ | 2541/3665 [28:43<12:15, 1.53it/s] 69%|██████▉ | 2542/3665 [28:43<12:01, 1.56it/s] 69%|██████▉ | 2543/3665 [28:44<12:40, 1.47it/s] 69%|██████▉ | 2544/3665 [28:45<12:24, 1.51it/s] 69%|██████▉ | 2545/3665 [28:46<13:32, 1.38it/s] 69%|██████▉ | 2546/3665 [28:46<12:59, 1.44it/s] 69%|██████▉ | 2547/3665 [28:47<12:51, 1.45it/s] 70%|██████▉ | 2548/3665 [28:48<13:46, 1.35it/s] 70%|██████▉ | 2549/3665 [28:49<13:08, 1.42it/s] 70%|██████▉ | 2550/3665 [28:49<13:24, 1.39it/s] 70%|██████▉ | 2550/3665 [28:49<13:24, 1.39it/s] 70%|██████▉ | 2551/3665 [28:50<12:59, 1.43it/s] 70%|██████▉ | 2552/3665 [28:51<12:36, 1.47it/s] 70%|██████▉ | 2553/3665 [28:51<12:55, 1.43it/s] 70%|██████▉ | 2554/3665 [28:52<12:29, 1.48it/s] 70%|██████▉ | 2555/3665 [28:53<12:47, 1.45it/s] 70%|██████▉ | 2556/3665 [28:53<12:24, 1.49it/s] 70%|██████▉ | 2557/3665 [28:54<12:24, 1.49it/s] 70%|██████▉ | 2558/3665 [28:55<12:34, 1.47it/s] 70%|██████▉ | 2559/3665 [28:55<12:53, 1.43it/s] 70%|██████▉ | 2560/3665 [28:56<12:41, 1.45it/s] 70%|██████▉ | 2560/3665 [28:56<12:41, 1.45it/s] 70%|██████▉ | 2561/3665 [28:57<12:25, 1.48it/s] 70%|██████▉ | 2562/3665 [28:57<12:28, 1.47it/s] 70%|██████▉ | 2563/3665 [28:58<12:11, 1.51it/s] 70%|██████▉ | 2564/3665 [28:59<12:18, 1.49it/s] 70%|██████▉ | 2565/3665 [28:59<12:15, 1.50it/s] 70%|███████ | 2566/3665 [29:00<11:55, 1.54it/s] 70%|███████ | 2567/3665 [29:01<11:49, 1.55it/s] 70%|███████ | 2568/3665 [29:01<11:43, 1.56it/s] 70%|███████ | 2569/3665 [29:02<11:33, 1.58it/s] 70%|███████ | 2570/3665 [29:03<12:20, 1.48it/s] 70%|███████ | 2570/3665 [29:03<12:20, 1.48it/s] 70%|███████ | 2571/3665 [29:03<12:24, 1.47it/s] 70%|███████ | 2572/3665 [29:04<12:24, 1.47it/s] 70%|███████ | 2573/3665 [29:05<12:04, 1.51it/s] 70%|███████ | 2574/3665 [29:05<11:47, 1.54it/s] 70%|███████ | 2575/3665 [29:06<12:16, 1.48it/s] 70%|███████ | 2576/3665 [29:07<11:55, 1.52it/s] 70%|███████ | 2577/3665 [29:07<11:41, 1.55it/s] 70%|███████ | 2578/3665 [29:08<11:54, 1.52it/s] 70%|███████ | 2579/3665 [29:09<11:43, 1.54it/s] 70%|███████ | 2580/3665 [29:09<11:49, 1.53it/s] 70%|███████ | 2580/3665 [29:09<11:49, 1.53it/s] 70%|███████ | 2581/3665 [29:10<11:40, 1.55it/s] 70%|███████ | 2582/3665 [29:10<11:32, 1.56it/s] 70%|███████ | 2583/3665 [29:11<12:01, 1.50it/s] 71%|███████ | 2584/3665 [29:12<11:47, 1.53it/s] 71%|███████ | 2585/3665 [29:13<12:39, 1.42it/s] 71%|███████ | 2586/3665 [29:13<12:32, 1.43it/s] 71%|███████ | 2587/3665 [29:14<12:08, 1.48it/s] 71%|███████ | 2588/3665 [29:15<13:42, 1.31it/s] 71%|███████ | 2589/3665 [29:16<13:33, 1.32it/s] 71%|███████ | 2590/3665 [29:16<12:36, 1.42it/s] 71%|███████ | 2590/3665 [29:16<12:36, 1.42it/s] 71%|███████ | 2591/3665 [29:17<13:39, 1.31it/s] 71%|███████ | 2592/3665 [29:18<12:55, 1.38it/s] 71%|███████ | 2593/3665 [29:18<12:19, 1.45it/s] 71%|███████ | 2594/3665 [29:19<11:53, 1.50it/s] 71%|███████ | 2595/3665 [29:20<12:13, 1.46it/s] 71%|███████ | 2596/3665 [29:20<12:30, 1.42it/s] 71%|███████ | 2597/3665 [29:21<12:09, 1.47it/s] 71%|███████ | 2598/3665 [29:22<12:27, 1.43it/s] 71%|███████ | 2599/3665 [29:22<12:15, 1.45it/s] 71%|███████ | 2600/3665 [29:23<11:55, 1.49it/s] 71%|███████ | 2600/3665 [29:23<11:55, 1.49it/s] 71%|███████ | 2601/3665 [29:24<12:17, 1.44it/s] 71%|███████ | 2602/3665 [29:25<12:19, 1.44it/s] 71%|███████ | 2603/3665 [29:25<11:55, 1.48it/s] 71%|███████ | 2604/3665 [29:26<11:25, 1.55it/s] 71%|███████ | 2605/3665 [29:27<11:57, 1.48it/s] 71%|███████ | 2606/3665 [29:27<12:14, 1.44it/s] 71%|███████ | 2607/3665 [29:28<11:47, 1.50it/s] 71%|███████ | 2608/3665 [29:28<11:36, 1.52it/s] 71%|███████ | 2609/3665 [29:29<11:44, 1.50it/s] 71%|███████ | 2610/3665 [29:30<11:18, 1.56it/s] 71%|███████ | 2610/3665 [29:30<11:18, 1.56it/s] 71%|███████ | 2611/3665 [29:31<11:52, 1.48it/s] 71%|███████▏ | 2612/3665 [29:31<11:38, 1.51it/s] 71%|███████▏ | 2613/3665 [29:32<11:44, 1.49it/s] 71%|███████▏ | 2614/3665 [29:32<11:29, 1.52it/s] 71%|███████▏ | 2615/3665 [29:33<11:18, 1.55it/s] 71%|███████▏ | 2616/3665 [29:34<11:24, 1.53it/s] 71%|███████▏ | 2617/3665 [29:35<11:55, 1.46it/s] 71%|███████▏ | 2618/3665 [29:35<11:53, 1.47it/s] 71%|███████▏ | 2619/3665 [29:36<11:34, 1.51it/s] 71%|███████▏ | 2620/3665 [29:37<11:46, 1.48it/s] 71%|███████▏ | 2620/3665 [29:37<11:46, 1.48it/s] 72%|███████▏ | 2621/3665 [29:37<11:34, 1.50it/s] 72%|███████▏ | 2622/3665 [29:38<11:17, 1.54it/s] 72%|███████▏ | 2623/3665 [29:38<11:09, 1.56it/s] 72%|███████▏ | 2624/3665 [29:39<10:59, 1.58it/s] 72%|███████▏ | 2625/3665 [29:40<10:52, 1.59it/s] 72%|███████▏ | 2626/3665 [29:40<10:53, 1.59it/s] 72%|███████▏ | 2627/3665 [29:41<10:47, 1.60it/s] 72%|███████▏ | 2628/3665 [29:41<10:43, 1.61it/s] 72%|███████▏ | 2629/3665 [29:42<10:46, 1.60it/s] 72%|███████▏ | 2630/3665 [29:43<10:42, 1.61it/s] 72%|███████▏ | 2630/3665 [29:43<10:42, 1.61it/s] 72%|███████▏ | 2631/3665 [29:43<10:59, 1.57it/s] 72%|███████▏ | 2632/3665 [29:44<10:41, 1.61it/s] 72%|███████▏ | 2633/3665 [29:45<10:45, 1.60it/s] 72%|███████▏ | 2634/3665 [29:45<10:40, 1.61it/s] 72%|███████▏ | 2635/3665 [29:46<10:37, 1.61it/s] 72%|███████▏ | 2636/3665 [29:47<10:56, 1.57it/s] 72%|███████▏ | 2637/3665 [29:47<10:37, 1.61it/s] 72%|███████▏ | 2638/3665 [29:48<11:26, 1.50it/s] 72%|███████▏ | 2639/3665 [29:49<11:30, 1.48it/s] 72%|███████▏ | 2640/3665 [29:49<11:16, 1.51it/s] 72%|███████▏ | 2640/3665 [29:49<11:16, 1.51it/s] 72%|███████▏ | 2641/3665 [29:50<11:06, 1.54it/s] 72%|███████▏ | 2642/3665 [29:51<12:18, 1.38it/s] 72%|███████▏ | 2643/3665 [29:51<12:03, 1.41it/s] 72%|███████▏ | 2644/3665 [29:52<13:22, 1.27it/s] 72%|███████▏ | 2645/3665 [29:53<13:07, 1.30it/s] 72%|███████▏ | 2646/3665 [29:54<12:37, 1.35it/s] 72%|███████▏ | 2647/3665 [29:54<12:02, 1.41it/s] 72%|███████▏ | 2648/3665 [29:55<11:53, 1.42it/s] 72%|███████▏ | 2649/3665 [29:56<11:16, 1.50it/s] 72%|███████▏ | 2650/3665 [29:56<11:02, 1.53it/s] 72%|███████▏ | 2650/3665 [29:56<11:02, 1.53it/s] 72%|███████▏ | 2651/3665 [29:57<11:54, 1.42it/s] 72%|███████▏ | 2652/3665 [29:58<12:14, 1.38it/s] 72%|███████▏ | 2653/3665 [29:59<11:43, 1.44it/s] 72%|███████▏ | 2654/3665 [29:59<11:23, 1.48it/s] 72%|███████▏ | 2655/3665 [30:00<11:05, 1.52it/s] 72%|███████▏ | 2656/3665 [30:00<10:51, 1.55it/s] 72%|███████▏ | 2657/3665 [30:01<11:02, 1.52it/s] 73%|███████▎ | 2658/3665 [30:02<11:07, 1.51it/s] 73%|███████▎ | 2659/3665 [30:02<10:42, 1.57it/s] 73%|███████▎ | 2660/3665 [30:03<10:33, 1.59it/s] 73%|███████▎ | 2660/3665 [30:03<10:33, 1.59it/s] 73%|███████▎ | 2661/3665 [30:04<10:35, 1.58it/s] 73%|███████▎ | 2662/3665 [30:04<11:49, 1.41it/s] 73%|███████▎ | 2663/3665 [30:05<11:11, 1.49it/s] 73%|███████▎ | 2664/3665 [30:06<11:27, 1.46it/s] 73%|███████▎ | 2665/3665 [30:06<11:08, 1.50it/s] 73%|███████▎ | 2666/3665 [30:07<11:35, 1.44it/s] 73%|███████▎ | 2667/3665 [30:08<11:47, 1.41it/s] 73%|███████▎ | 2668/3665 [30:08<11:08, 1.49it/s] 73%|███████▎ | 2669/3665 [30:09<10:58, 1.51it/s] 73%|███████▎ | 2670/3665 [30:10<10:46, 1.54it/s] 73%|███████▎ | 2670/3665 [30:10<10:46, 1.54it/s] 73%|███████▎ | 2671/3665 [30:10<11:00, 1.50it/s] 73%|███████▎ | 2672/3665 [30:11<12:23, 1.34it/s] 73%|███████▎ | 2673/3665 [30:12<12:23, 1.33it/s] 73%|███████▎ | 2674/3665 [30:13<11:58, 1.38it/s] 73%|███████▎ | 2675/3665 [30:14<11:58, 1.38it/s] 73%|███████▎ | 2676/3665 [30:14<11:28, 1.44it/s] 73%|███████▎ | 2677/3665 [30:15<11:06, 1.48it/s] 73%|███████▎ | 2678/3665 [30:15<10:48, 1.52it/s] 73%|███████▎ | 2679/3665 [30:16<10:53, 1.51it/s] 73%|███████▎ | 2680/3665 [30:17<10:41, 1.54it/s] 73%|███████▎ | 2680/3665 [30:17<10:41, 1.54it/s] 73%|███████▎ | 2681/3665 [30:18<11:31, 1.42it/s] 73%|███████▎ | 2682/3665 [30:18<11:53, 1.38it/s] 73%|███████▎ | 2683/3665 [30:19<11:19, 1.45it/s] 73%|███████▎ | 2684/3665 [30:19<10:45, 1.52it/s] 73%|███████▎ | 2685/3665 [30:20<10:34, 1.54it/s] 73%|███████▎ | 2686/3665 [30:21<12:52, 1.27it/s] 73%|███████▎ | 2687/3665 [30:22<12:33, 1.30it/s] 73%|███████▎ | 2688/3665 [30:23<11:51, 1.37it/s] 73%|███████▎ | 2689/3665 [30:23<11:54, 1.37it/s] 73%|███████▎ | 2690/3665 [30:24<11:22, 1.43it/s] 73%|███████▎ | 2690/3665 [30:24<11:22, 1.43it/s] 73%|███████▎ | 2691/3665 [30:25<10:50, 1.50it/s] 73%|███████▎ | 2692/3665 [30:25<10:37, 1.53it/s] 73%|███████▎ | 2693/3665 [30:26<10:29, 1.54it/s] 74%|███████▎ | 2694/3665 [30:26<10:09, 1.59it/s] 74%|███████▎ | 2695/3665 [30:27<10:19, 1.57it/s] 74%|███████▎ | 2696/3665 [30:28<10:57, 1.47it/s] 74%|███████▎ | 2697/3665 [30:29<11:03, 1.46it/s] 74%|███████▎ | 2698/3665 [30:29<11:18, 1.42it/s] 74%|███████▎ | 2699/3665 [30:30<11:09, 1.44it/s] 74%|███████▎ | 2700/3665 [30:31<11:11, 1.44it/s] 74%|███████▎ | 2700/3665 [30:31<11:11, 1.44it/s] 74%|███████▎ | 2701/3665 [30:31<10:55, 1.47it/s] 74%|███████▎ | 2702/3665 [30:32<11:00, 1.46it/s] 74%|███████▍ | 2703/3665 [30:33<11:18, 1.42it/s] 74%|███████▍ | 2704/3665 [30:33<11:06, 1.44it/s] 74%|███████▍ | 2705/3665 [30:34<10:46, 1.49it/s] 74%|███████▍ | 2706/3665 [30:35<10:31, 1.52it/s] 74%|███████▍ | 2707/3665 [30:35<10:32, 1.51it/s] 74%|███████▍ | 2708/3665 [30:36<10:18, 1.55it/s] 74%|███████▍ | 2709/3665 [30:37<10:11, 1.56it/s] 74%|███████▍ | 2710/3665 [30:37<10:38, 1.50it/s] 74%|███████▍ | 2710/3665 [30:37<10:38, 1.50it/s] 74%|███████▍ | 2711/3665 [30:38<10:29, 1.52it/s] 74%|███████▍ | 2712/3665 [30:39<10:14, 1.55it/s] 74%|███████▍ | 2713/3665 [30:39<10:11, 1.56it/s] 74%|███████▍ | 2714/3665 [30:40<10:07, 1.56it/s] 74%|███████▍ | 2715/3665 [30:40<10:06, 1.57it/s] 74%|███████▍ | 2716/3665 [30:41<09:58, 1.59it/s] 74%|███████▍ | 2717/3665 [30:42<09:43, 1.62it/s] 74%|███████▍ | 2718/3665 [30:42<09:59, 1.58it/s] 74%|███████▍ | 2719/3665 [30:43<09:56, 1.59it/s] 74%|███████▍ | 2720/3665 [30:44<10:26, 1.51it/s] 74%|███████▍ | 2720/3665 [30:44<10:26, 1.51it/s] 74%|███████▍ | 2721/3665 [30:44<10:15, 1.53it/s] 74%|███████▍ | 2722/3665 [30:45<10:03, 1.56it/s] 74%|███████▍ | 2723/3665 [30:46<09:58, 1.57it/s] 74%|███████▍ | 2724/3665 [30:46<09:54, 1.58it/s] 74%|███████▍ | 2725/3665 [30:47<10:06, 1.55it/s] 74%|███████▍ | 2726/3665 [30:47<10:00, 1.56it/s] 74%|███████▍ | 2727/3665 [30:48<09:55, 1.58it/s] 74%|███████▍ | 2728/3665 [30:49<09:39, 1.62it/s] 74%|███████▍ | 2729/3665 [30:49<09:51, 1.58it/s] 74%|███████▍ | 2730/3665 [30:50<09:50, 1.58it/s] 74%|███████▍ | 2730/3665 [30:50<09:50, 1.58it/s] 75%|███████▍ | 2731/3665 [30:51<10:21, 1.50it/s] 75%|███████▍ | 2732/3665 [30:51<10:49, 1.44it/s] 75%|███████▍ | 2733/3665 [30:52<10:29, 1.48it/s] 75%|███████▍ | 2734/3665 [30:53<10:14, 1.52it/s] 75%|███████▍ | 2735/3665 [30:53<10:15, 1.51it/s] 75%|███████▍ | 2736/3665 [30:54<10:26, 1.48it/s] 75%|███████▍ | 2737/3665 [30:55<11:16, 1.37it/s] 75%|███████▍ | 2738/3665 [30:56<10:43, 1.44it/s] 75%|███████▍ | 2739/3665 [30:56<11:44, 1.31it/s] 75%|███████▍ | 2740/3665 [30:57<11:02, 1.40it/s] 75%|███████▍ | 2740/3665 [30:57<11:02, 1.40it/s] 75%|███████▍ | 2741/3665 [30:58<10:40, 1.44it/s] 75%|███████▍ | 2742/3665 [30:58<10:37, 1.45it/s] 75%|███████▍ | 2743/3665 [30:59<11:01, 1.39it/s] 75%|███████▍ | 2744/3665 [31:00<10:38, 1.44it/s] 75%|███████▍ | 2745/3665 [31:00<10:16, 1.49it/s] 75%|███████▍ | 2746/3665 [31:01<10:02, 1.52it/s] 75%|███████▍ | 2747/3665 [31:02<10:26, 1.47it/s] 75%|███████▍ | 2748/3665 [31:02<10:11, 1.50it/s] 75%|███████▌ | 2749/3665 [31:03<10:51, 1.41it/s] 75%|███████▌ | 2750/3665 [31:04<10:43, 1.42it/s] 75%|███████▌ | 2750/3665 [31:04<10:43, 1.42it/s] 75%|███████▌ | 2751/3665 [31:05<10:21, 1.47it/s] 75%|███████▌ | 2752/3665 [31:05<10:02, 1.51it/s] 75%|███████▌ | 2753/3665 [31:06<09:49, 1.55it/s] 75%|███████▌ | 2754/3665 [31:06<09:40, 1.57it/s] 75%|███████▌ | 2755/3665 [31:07<09:36, 1.58it/s] 75%|███████▌ | 2756/3665 [31:08<09:21, 1.62it/s] 75%|███████▌ | 2757/3665 [31:08<09:19, 1.62it/s] 75%|███████▌ | 2758/3665 [31:09<09:09, 1.65it/s] 75%|███████▌ | 2759/3665 [31:09<09:13, 1.64it/s] 75%|███████▌ | 2760/3665 [31:10<09:04, 1.66it/s] 75%|███████▌ | 2760/3665 [31:10<09:04, 1.66it/s] 75%|███████▌ | 2761/3665 [31:11<09:27, 1.59it/s] 75%|███████▌ | 2762/3665 [31:11<09:39, 1.56it/s] 75%|███████▌ | 2763/3665 [31:12<09:34, 1.57it/s] 75%|███████▌ | 2764/3665 [31:13<09:18, 1.61it/s] 75%|███████▌ | 2765/3665 [31:13<09:24, 1.59it/s] 75%|███████▌ | 2766/3665 [31:14<09:26, 1.59it/s] 75%|███████▌ | 2767/3665 [31:14<09:25, 1.59it/s] 76%|███████▌ | 2768/3665 [31:15<09:59, 1.50it/s] 76%|███████▌ | 2769/3665 [31:16<09:48, 1.52it/s] 76%|███████▌ | 2770/3665 [31:16<09:26, 1.58it/s] 76%|███████▌ | 2770/3665 [31:16<09:26, 1.58it/s] 76%|███████▌ | 2771/3665 [31:17<09:24, 1.58it/s] 76%|███████▌ | 2772/3665 [31:18<09:57, 1.49it/s] 76%|███████▌ | 2773/3665 [31:18<09:48, 1.52it/s] 76%|███████▌ | 2774/3665 [31:19<09:41, 1.53it/s] 76%|███████▌ | 2775/3665 [31:20<09:34, 1.55it/s] 76%|███████▌ | 2776/3665 [31:20<09:45, 1.52it/s] 76%|███████▌ | 2777/3665 [31:21<09:32, 1.55it/s] 76%|███████▌ | 2778/3665 [31:22<09:54, 1.49it/s] 76%|███████▌ | 2779/3665 [31:22<09:37, 1.53it/s] 76%|███████▌ | 2780/3665 [31:23<09:29, 1.55it/s] 76%|███████▌ | 2780/3665 [31:23<09:29, 1.55it/s] 76%|███████▌ | 2781/3665 [31:24<09:24, 1.57it/s] 76%|███████▌ | 2782/3665 [31:24<09:20, 1.57it/s] 76%|███████▌ | 2783/3665 [31:25<10:19, 1.42it/s] 76%|███████▌ | 2784/3665 [31:26<09:55, 1.48it/s] 76%|███████▌ | 2785/3665 [31:26<10:13, 1.43it/s] 76%|███████▌ | 2786/3665 [31:27<09:54, 1.48it/s] 76%|███████▌ | 2787/3665 [31:28<09:39, 1.51it/s] 76%|███████▌ | 2788/3665 [31:28<09:18, 1.57it/s] 76%|███████▌ | 2789/3665 [31:29<09:52, 1.48it/s] 76%|███████▌ | 2790/3665 [31:30<09:38, 1.51it/s] 76%|███████▌ | 2790/3665 [31:30<09:38, 1.51it/s] 76%|███████▌ | 2791/3665 [31:30<09:31, 1.53it/s] 76%|███████▌ | 2792/3665 [31:31<09:24, 1.55it/s] 76%|███████▌ | 2793/3665 [31:32<09:53, 1.47it/s] 76%|███████▌ | 2794/3665 [31:32<09:48, 1.48it/s] 76%|███████▋ | 2795/3665 [31:33<09:51, 1.47it/s] 76%|███████▋ | 2796/3665 [31:34<09:37, 1.51it/s] 76%|███████▋ | 2797/3665 [31:34<09:29, 1.52it/s] 76%|███████▋ | 2798/3665 [31:35<09:18, 1.55it/s] 76%|███████▋ | 2799/3665 [31:36<09:01, 1.60it/s] 76%|███████▋ | 2800/3665 [31:36<09:02, 1.59it/s] 76%|███████▋ | 2800/3665 [31:36<09:02, 1.59it/s] 76%|███████▋ | 2801/3665 [31:37<09:47, 1.47it/s] 76%|███████▋ | 2802/3665 [31:38<09:52, 1.46it/s] 76%|███████▋ | 2803/3665 [31:38<09:37, 1.49it/s] 77%|███████▋ | 2804/3665 [31:39<09:27, 1.52it/s] 77%|███████▋ | 2805/3665 [31:40<09:47, 1.46it/s] 77%|███████▋ | 2806/3665 [31:40<09:20, 1.53it/s] 77%|███████▋ | 2807/3665 [31:41<09:41, 1.48it/s] 77%|███████▋ | 2808/3665 [31:42<10:27, 1.37it/s] 77%|███████▋ | 2809/3665 [31:42<09:47, 1.46it/s] 77%|███████▋ | 2810/3665 [31:43<09:31, 1.50it/s] 77%|███████▋ | 2810/3665 [31:43<09:31, 1.50it/s] 77%|███████▋ | 2811/3665 [31:44<10:39, 1.34it/s] 77%|███████▋ | 2812/3665 [31:45<10:06, 1.41it/s] 77%|███████▋ | 2813/3665 [31:45<09:54, 1.43it/s] 77%|███████▋ | 2814/3665 [31:46<09:36, 1.48it/s] 77%|███████▋ | 2815/3665 [31:47<09:38, 1.47it/s] 77%|███████▋ | 2816/3665 [31:47<09:23, 1.51it/s] 77%|███████▋ | 2817/3665 [31:48<09:14, 1.53it/s] 77%|███████▋ | 2818/3665 [31:49<09:52, 1.43it/s] 77%|███████▋ | 2819/3665 [31:49<09:35, 1.47it/s] 77%|███████▋ | 2820/3665 [31:50<09:36, 1.47it/s] 77%|███████▋ | 2820/3665 [31:50<09:36, 1.47it/s] 77%|███████▋ | 2821/3665 [31:51<09:21, 1.50it/s] 77%|███████▋ | 2822/3665 [31:51<08:58, 1.56it/s] 77%|███████▋ | 2823/3665 [31:52<08:51, 1.58it/s] 77%|███████▋ | 2824/3665 [31:52<08:48, 1.59it/s] 77%|███████▋ | 2825/3665 [31:53<08:48, 1.59it/s] 77%|███████▋ | 2826/3665 [31:54<11:15, 1.24it/s] 77%|███████▋ | 2827/3665 [31:55<10:28, 1.33it/s] 77%|███████▋ | 2828/3665 [31:56<09:58, 1.40it/s] 77%|███████▋ | 2829/3665 [31:56<09:35, 1.45it/s] 77%|███████▋ | 2830/3665 [31:57<09:45, 1.43it/s] 77%|███████▋ | 2830/3665 [31:57<09:45, 1.43it/s] 77%|███████▋ | 2831/3665 [31:58<09:57, 1.40it/s] 77%|███████▋ | 2832/3665 [31:58<09:35, 1.45it/s] 77%|███████▋ | 2833/3665 [31:59<09:18, 1.49it/s] 77%|███████▋ | 2834/3665 [32:00<09:05, 1.52it/s] 77%|███████▋ | 2835/3665 [32:00<08:56, 1.55it/s] 77%|███████▋ | 2836/3665 [32:01<09:21, 1.48it/s] 77%|███████▋ | 2837/3665 [32:02<09:22, 1.47it/s] 77%|███████▋ | 2838/3665 [32:02<09:07, 1.51it/s] 77%|███████▋ | 2839/3665 [32:03<09:00, 1.53it/s] 77%|███████▋ | 2840/3665 [32:03<08:53, 1.55it/s] 77%|███████▋ | 2840/3665 [32:03<08:53, 1.55it/s] 78%|███████▊ | 2841/3665 [32:04<08:47, 1.56it/s] 78%|███████▊ | 2842/3665 [32:05<08:53, 1.54it/s] 78%|███████▊ | 2843/3665 [32:05<08:46, 1.56it/s] 78%|███████▊ | 2844/3665 [32:06<08:39, 1.58it/s] 78%|███████▊ | 2845/3665 [32:07<08:55, 1.53it/s] 78%|███████▊ | 2846/3665 [32:07<08:37, 1.58it/s] 78%|███████▊ | 2847/3665 [32:08<08:34, 1.59it/s] 78%|███████▊ | 2848/3665 [32:09<08:42, 1.56it/s] 78%|███████▊ | 2849/3665 [32:09<08:41, 1.57it/s] 78%|███████▊ | 2850/3665 [32:10<08:34, 1.58it/s] 78%|███████▊ | 2850/3665 [32:10<08:34, 1.58it/s] 78%|███████▊ | 2851/3665 [32:11<09:07, 1.49it/s] 78%|███████▊ | 2852/3665 [32:12<11:07, 1.22it/s] 78%|███████▊ | 2853/3665 [32:12<10:19, 1.31it/s] 78%|███████▊ | 2854/3665 [32:13<10:47, 1.25it/s] 78%|███████▊ | 2855/3665 [32:14<10:04, 1.34it/s] 78%|███████▊ | 2856/3665 [32:15<10:04, 1.34it/s] 78%|███████▊ | 2857/3665 [32:15<09:35, 1.41it/s] 78%|███████▊ | 2858/3665 [32:16<09:10, 1.47it/s] 78%|███████▊ | 2859/3665 [32:16<08:52, 1.51it/s] 78%|███████▊ | 2860/3665 [32:17<08:44, 1.53it/s] 78%|███████▊ | 2860/3665 [32:17<08:44, 1.53it/s] 78%|███████▊ | 2861/3665 [32:18<08:40, 1.54it/s] 78%|███████▊ | 2862/3665 [32:18<08:46, 1.52it/s] 78%|███████▊ | 2863/3665 [32:19<08:38, 1.55it/s] 78%|███████▊ | 2864/3665 [32:20<08:35, 1.55it/s] 78%|███████▊ | 2865/3665 [32:20<08:40, 1.54it/s] 78%|███████▊ | 2866/3665 [32:21<09:00, 1.48it/s] 78%|███████▊ | 2867/3665 [32:22<08:48, 1.51it/s] 78%|███████▊ | 2868/3665 [32:22<08:36, 1.54it/s] 78%|███████▊ | 2869/3665 [32:23<08:44, 1.52it/s] 78%|███████▊ | 2870/3665 [32:24<08:33, 1.55it/s] 78%|███████▊ | 2870/3665 [32:24<08:33, 1.55it/s] 78%|███████▊ | 2871/3665 [32:24<08:45, 1.51it/s] 78%|███████▊ | 2872/3665 [32:25<08:35, 1.54it/s] 78%|███████▊ | 2873/3665 [32:26<08:55, 1.48it/s] 78%|███████▊ | 2874/3665 [32:26<08:39, 1.52it/s] 78%|███████▊ | 2875/3665 [32:27<08:30, 1.55it/s] 78%|███████▊ | 2876/3665 [32:28<08:24, 1.56it/s] 78%|███████▊ | 2877/3665 [32:28<08:19, 1.58it/s] 79%|███████▊ | 2878/3665 [32:29<08:25, 1.56it/s] 79%|███████▊ | 2879/3665 [32:29<08:17, 1.58it/s] 79%|███████▊ | 2880/3665 [32:30<08:12, 1.59it/s] 79%|███████▊ | 2880/3665 [32:30<08:12, 1.59it/s] 79%|███████▊ | 2881/3665 [32:31<08:03, 1.62it/s] 79%|███████▊ | 2882/3665 [32:31<08:04, 1.62it/s] 79%|███████▊ | 2883/3665 [32:32<08:07, 1.60it/s] 79%|███████▊ | 2884/3665 [32:33<09:03, 1.44it/s] 79%|███████▊ | 2885/3665 [32:33<08:43, 1.49it/s] 79%|███████▊ | 2886/3665 [32:34<08:41, 1.49it/s] 79%|███████▉ | 2887/3665 [32:35<08:30, 1.53it/s] 79%|███████▉ | 2888/3665 [32:35<08:51, 1.46it/s] 79%|███████▉ | 2889/3665 [32:36<09:04, 1.43it/s] 79%|███████▉ | 2890/3665 [32:37<08:35, 1.50it/s] 79%|███████▉ | 2890/3665 [32:37<08:35, 1.50it/s] 79%|███████▉ | 2891/3665 [32:37<08:51, 1.46it/s] 79%|███████▉ | 2892/3665 [32:38<08:33, 1.51it/s] 79%|███████▉ | 2893/3665 [32:39<08:26, 1.52it/s] 79%|███████▉ | 2894/3665 [32:39<08:21, 1.54it/s] 79%|███████▉ | 2895/3665 [32:40<08:28, 1.52it/s] 79%|███████▉ | 2896/3665 [32:41<08:18, 1.54it/s] 79%|███████▉ | 2897/3665 [32:41<08:22, 1.53it/s] 79%|███████▉ | 2898/3665 [32:42<08:16, 1.54it/s] 79%|███████▉ | 2899/3665 [32:43<08:00, 1.60it/s] 79%|███████▉ | 2900/3665 [32:43<07:59, 1.60it/s] 79%|███████▉ | 2900/3665 [32:43<07:59, 1.60it/s] 79%|███████▉ | 2901/3665 [32:44<07:51, 1.62it/s] 79%|███████▉ | 2902/3665 [32:44<08:06, 1.57it/s] 79%|███████▉ | 2903/3665 [32:45<08:03, 1.58it/s] 79%|███████▉ | 2904/3665 [32:46<08:18, 1.53it/s] 79%|███████▉ | 2905/3665 [32:46<08:01, 1.58it/s] 79%|███████▉ | 2906/3665 [32:47<08:26, 1.50it/s] 79%|███████▉ | 2907/3665 [32:48<08:06, 1.56it/s] 79%|███████▉ | 2908/3665 [32:48<08:02, 1.57it/s] 79%|███████▉ | 2909/3665 [32:49<07:56, 1.59it/s] 79%|███████▉ | 2910/3665 [32:50<07:54, 1.59it/s] 79%|███████▉ | 2910/3665 [32:50<07:54, 1.59it/s] 79%|███████▉ | 2911/3665 [32:50<08:26, 1.49it/s] 79%|███████▉ | 2912/3665 [32:51<08:26, 1.49it/s] 79%|███████▉ | 2913/3665 [32:52<08:43, 1.44it/s] 80%|███████▉ | 2914/3665 [32:52<08:26, 1.48it/s] 80%|███████▉ | 2915/3665 [32:53<09:25, 1.33it/s] 80%|███████▉ | 2916/3665 [32:54<08:55, 1.40it/s] 80%|███████▉ | 2917/3665 [32:55<08:45, 1.42it/s] 80%|███████▉ | 2918/3665 [32:55<08:24, 1.48it/s] 80%|███████▉ | 2919/3665 [32:56<08:23, 1.48it/s] 80%|███████▉ | 2920/3665 [32:57<08:14, 1.51it/s] 80%|███████▉ | 2920/3665 [32:57<08:14, 1.51it/s] 80%|███████▉ | 2921/3665 [32:57<08:11, 1.51it/s] 80%|███████▉ | 2922/3665 [32:58<08:02, 1.54it/s] 80%|███████▉ | 2923/3665 [32:59<08:24, 1.47it/s] 80%|███████▉ | 2924/3665 [32:59<09:05, 1.36it/s] 80%|███████▉ | 2925/3665 [33:00<08:29, 1.45it/s] 80%|███████▉ | 2926/3665 [33:01<08:15, 1.49it/s] 80%|███████▉ | 2927/3665 [33:01<08:04, 1.52it/s] 80%|███████▉ | 2928/3665 [33:02<07:56, 1.55it/s] 80%|███████▉ | 2929/3665 [33:03<07:48, 1.57it/s] 80%|███████▉ | 2930/3665 [33:03<07:42, 1.59it/s] 80%|███████▉ | 2930/3665 [33:03<07:42, 1.59it/s] 80%|███████▉ | 2931/3665 [33:04<08:06, 1.51it/s] 80%|████████ | 2932/3665 [33:05<07:59, 1.53it/s][INFO|trainer.py:3478] 2025-01-05 11:41:47,538 >> Saving model checkpoint to /work/train_output/checkpoint-2932 [INFO|configuration_utils.py:731] 2025-01-05 11:41:47,575 >> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/config.json [INFO|configuration_utils.py:800] 2025-01-05 11:41:47,576 >> Model config LlamaConfig { "architectures": [ "LlamaForCausalLM" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "hidden_act": "silu", "hidden_size": 4096, "initializer_range": 0.02, "intermediate_size": 14336, "max_position_embeddings": 8192, "mlp_bias": false, "model_type": "llama", "num_attention_heads": 32, "num_hidden_layers": 32, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": null, "rope_theta": 500000.0, "tie_word_embeddings": false, "torch_dtype": "bfloat16", "transformers_version": "4.42.4", "use_cache": true, "vocab_size": 128256 } [INFO|tokenization_utils_base.py:2574] 2025-01-05 11:41:48,080 >> tokenizer config file saved in /work/train_output/checkpoint-2932/tokenizer_config.json [INFO|tokenization_utils_base.py:2583] 2025-01-05 11:41:48,083 >> Special tokens file saved in /work/train_output/checkpoint-2932/special_tokens_map.json [INFO|trainer.py:3570] 2025-01-05 11:41:48,249 >> Deleting older checkpoint [/work/train_output/checkpoint-2199] due to args.save_total_limit 80%|████████ | 2933/3665 [33:06<10:38, 1.15it/s] 80%|████████ | 2934/3665 [33:07<09:43, 1.25it/s] 80%|████████ | 2935/3665 [33:07<09:04, 1.34it/s] 80%|████████ | 2936/3665 [33:08<08:39, 1.40it/s] 80%|████████ | 2937/3665 [33:08<08:16, 1.47it/s] 80%|████████ | 2938/3665 [33:09<08:04, 1.50it/s] 80%|████████ | 2939/3665 [33:10<08:03, 1.50it/s] 80%|████████ | 2940/3665 [33:10<07:44, 1.56it/s] 80%|████████ | 2940/3665 [33:10<07:44, 1.56it/s] 80%|████████ | 2941/3665 [33:11<07:44, 1.56it/s] 80%|████████ | 2942/3665 [33:12<07:40, 1.57it/s] 80%|████████ | 2943/3665 [33:12<08:10, 1.47it/s] 80%|████████ | 2944/3665 [33:13<08:06, 1.48it/s] 80%|████████ | 2945/3665 [33:14<08:19, 1.44it/s] 80%|████████ | 2946/3665 [33:14<07:54, 1.52it/s] 80%|████████ | 2947/3665 [33:15<07:46, 1.54it/s] 80%|████████ | 2948/3665 [33:16<07:40, 1.56it/s] 80%|████████ | 2949/3665 [33:16<07:33, 1.58it/s] 80%|████████ | 2950/3665 [33:17<07:32, 1.58it/s] 80%|████████ | 2950/3665 [33:17<07:32, 1.58it/s] 81%|████████ | 2951/3665 [33:17<07:30, 1.59it/s] 81%|████████ | 2952/3665 [33:18<07:26, 1.60it/s] 81%|████████ | 2953/3665 [33:19<07:22, 1.61it/s] 81%|████████ | 2954/3665 [33:19<07:47, 1.52it/s] 81%|████████ | 2955/3665 [33:20<07:49, 1.51it/s] 81%|████████ | 2956/3665 [33:21<07:41, 1.54it/s] 81%|████████ | 2957/3665 [33:21<07:37, 1.55it/s] 81%|████████ | 2958/3665 [33:22<07:29, 1.57it/s] 81%|████████ | 2959/3665 [33:22<07:16, 1.62it/s] 81%|████████ | 2960/3665 [33:23<07:08, 1.65it/s] 81%|████████ | 2960/3665 [33:23<07:08, 1.65it/s] 81%|████████ | 2961/3665 [33:24<07:04, 1.66it/s] 81%|████████ | 2962/3665 [33:24<07:36, 1.54it/s] 81%|████████ | 2963/3665 [33:25<07:47, 1.50it/s] 81%|████████ | 2964/3665 [33:26<07:54, 1.48it/s] 81%|████████ | 2965/3665 [33:27<08:10, 1.43it/s] 81%|████████ | 2966/3665 [33:27<08:06, 1.44it/s] 81%|████████ | 2967/3665 [33:28<07:51, 1.48it/s] 81%|████████ | 2968/3665 [33:29<07:40, 1.51it/s] 81%|████████ | 2969/3665 [33:29<07:32, 1.54it/s] 81%|████████ | 2970/3665 [33:30<07:28, 1.55it/s] 81%|████████ | 2970/3665 [33:30<07:28, 1.55it/s] 81%|████████ | 2971/3665 [33:30<07:23, 1.56it/s] 81%|████████ | 2972/3665 [33:31<07:19, 1.58it/s] 81%|████████ | 2973/3665 [33:32<07:25, 1.55it/s] 81%|████████ | 2974/3665 [33:32<07:37, 1.51it/s] 81%|████████ | 2975/3665 [33:33<07:25, 1.55it/s] 81%|████████ | 2976/3665 [33:34<07:21, 1.56it/s] 81%|████████ | 2977/3665 [33:34<07:15, 1.58it/s] 81%|████████▏ | 2978/3665 [33:35<07:10, 1.59it/s] 81%|████████▏ | 2979/3665 [33:36<07:39, 1.49it/s] 81%|████████▏ | 2980/3665 [33:36<07:40, 1.49it/s] 81%|████████▏ | 2980/3665 [33:36<07:40, 1.49it/s] 81%|████████▏ | 2981/3665 [33:37<08:04, 1.41it/s] 81%|████████▏ | 2982/3665 [33:38<08:34, 1.33it/s] 81%|████████▏ | 2983/3665 [33:39<08:05, 1.41it/s] 81%|████████▏ | 2984/3665 [33:39<07:46, 1.46it/s] 81%|████████▏ | 2985/3665 [33:40<07:44, 1.46it/s] 81%|████████▏ | 2986/3665 [33:41<07:40, 1.48it/s] 82%|████████▏ | 2987/3665 [33:41<07:28, 1.51it/s] 82%|████████▏ | 2988/3665 [33:42<07:45, 1.45it/s] 82%|████████▏ | 2989/3665 [33:43<07:44, 1.46it/s] 82%|████████▏ | 2990/3665 [33:43<07:31, 1.49it/s] 82%|████████▏ | 2990/3665 [33:43<07:31, 1.49it/s] 82%|████████▏ | 2991/3665 [33:44<07:45, 1.45it/s] 82%|████████▏ | 2992/3665 [33:45<07:57, 1.41it/s] 82%|████████▏ | 2993/3665 [33:45<07:38, 1.46it/s] 82%|████████▏ | 2994/3665 [33:46<07:26, 1.50it/s] 82%|████████▏ | 2995/3665 [33:47<07:15, 1.54it/s] 82%|████████▏ | 2996/3665 [33:47<07:06, 1.57it/s] 82%|████████▏ | 2997/3665 [33:48<07:03, 1.58it/s] 82%|████████▏ | 2998/3665 [33:48<06:58, 1.59it/s] 82%|████████▏ | 2999/3665 [33:49<07:09, 1.55it/s] 82%|████████▏ | 3000/3665 [33:50<07:29, 1.48it/s] 82%|████████▏ | 3000/3665 [33:50<07:29, 1.48it/s] 82%|████████▏ | 3001/3665 [33:51<07:19, 1.51it/s] 82%|████████▏ | 3002/3665 [33:51<07:40, 1.44it/s] 82%|████████▏ | 3003/3665 [33:52<08:16, 1.33it/s] 82%|████████▏ | 3004/3665 [33:53<07:50, 1.41it/s] 82%|████████▏ | 3005/3665 [33:53<07:31, 1.46it/s] 82%|████████▏ | 3006/3665 [33:54<07:21, 1.49it/s] 82%|████████▏ | 3007/3665 [33:55<07:20, 1.49it/s] 82%|████████▏ | 3008/3665 [33:55<07:08, 1.53it/s] 82%|████████▏ | 3009/3665 [33:56<08:12, 1.33it/s] 82%|████████▏ | 3010/3665 [33:57<08:32, 1.28it/s] 82%|████████▏ | 3010/3665 [33:57<08:32, 1.28it/s] 82%|████████▏ | 3011/3665 [33:58<08:06, 1.34it/s] 82%|████████▏ | 3012/3665 [33:58<07:42, 1.41it/s] 82%|████████▏ | 3013/3665 [33:59<07:24, 1.47it/s] 82%|████████▏ | 3014/3665 [34:00<07:13, 1.50it/s] 82%|████████▏ | 3015/3665 [34:00<07:02, 1.54it/s] 82%|████████▏ | 3016/3665 [34:01<07:21, 1.47it/s] 82%|████████▏ | 3017/3665 [34:02<07:11, 1.50it/s] 82%|████████▏ | 3018/3665 [34:02<07:14, 1.49it/s] 82%|████████▏ | 3019/3665 [34:03<07:19, 1.47it/s] 82%|████████▏ | 3020/3665 [34:04<07:07, 1.51it/s] 82%|████████▏ | 3020/3665 [34:04<07:07, 1.51it/s] 82%|████████▏ | 3021/3665 [34:04<07:02, 1.52it/s] 82%|████████▏ | 3022/3665 [34:05<06:57, 1.54it/s] 82%|████████▏ | 3023/3665 [34:06<06:52, 1.55it/s] 83%|████████▎ | 3024/3665 [34:06<06:50, 1.56it/s] 83%|████████▎ | 3025/3665 [34:07<07:32, 1.42it/s] 83%|████████▎ | 3026/3665 [34:08<07:13, 1.48it/s] 83%|████████▎ | 3027/3665 [34:08<07:03, 1.51it/s] 83%|████████▎ | 3028/3665 [34:09<06:57, 1.53it/s] 83%|████████▎ | 3029/3665 [34:10<06:50, 1.55it/s] 83%|████████▎ | 3030/3665 [34:10<07:32, 1.40it/s] 83%|████████▎ | 3030/3665 [34:10<07:32, 1.40it/s] 83%|████████▎ | 3031/3665 [34:11<07:18, 1.45it/s] 83%|████████▎ | 3032/3665 [34:12<07:02, 1.50it/s] 83%|████████▎ | 3033/3665 [34:12<06:51, 1.54it/s] 83%|████████▎ | 3034/3665 [34:13<07:05, 1.48it/s] 83%|████████▎ | 3035/3665 [34:14<07:28, 1.40it/s] 83%|████████▎ | 3036/3665 [34:15<07:46, 1.35it/s] 83%|████████▎ | 3037/3665 [34:15<07:23, 1.42it/s] 83%|████████▎ | 3038/3665 [34:16<07:08, 1.46it/s] 83%|████████▎ | 3039/3665 [34:17<07:06, 1.47it/s] 83%|████████▎ | 3040/3665 [34:17<07:15, 1.44it/s] 83%|████████▎ | 3040/3665 [34:17<07:15, 1.44it/s] 83%|████████▎ | 3041/3665 [34:18<07:05, 1.47it/s] 83%|████████▎ | 3042/3665 [34:19<08:27, 1.23it/s] 83%|████████▎ | 3043/3665 [34:20<07:51, 1.32it/s] 83%|████████▎ | 3044/3665 [34:21<08:09, 1.27it/s] 83%|████████▎ | 3045/3665 [34:21<07:39, 1.35it/s] 83%|████████▎ | 3046/3665 [34:22<07:16, 1.42it/s] 83%|████████▎ | 3047/3665 [34:22<07:01, 1.47it/s] 83%|████████▎ | 3048/3665 [34:23<06:47, 1.51it/s] 83%|████████▎ | 3049/3665 [34:24<07:03, 1.45it/s] 83%|████████▎ | 3050/3665 [34:24<06:59, 1.47it/s] 83%|████████▎ | 3050/3665 [34:24<06:59, 1.47it/s] 83%|████████▎ | 3051/3665 [34:25<07:09, 1.43it/s] 83%|████████▎ | 3052/3665 [34:26<06:54, 1.48it/s] 83%|████████▎ | 3053/3665 [34:26<06:44, 1.51it/s] 83%|████████▎ | 3054/3665 [34:27<06:58, 1.46it/s] 83%|████████▎ | 3055/3665 [34:28<07:46, 1.31it/s] 83%|████████▎ | 3056/3665 [34:29<07:19, 1.38it/s] 83%|████████▎ | 3057/3665 [34:29<07:08, 1.42it/s] 83%|████████▎ | 3058/3665 [34:30<07:02, 1.44it/s] 83%|████████▎ | 3059/3665 [34:31<07:07, 1.42it/s] 83%|████████▎ | 3060/3665 [34:31<06:43, 1.50it/s] 83%|████████▎ | 3060/3665 [34:31<06:43, 1.50it/s] 84%|████████▎ | 3061/3665 [34:32<06:38, 1.51it/s] 84%|████████▎ | 3062/3665 [34:33<06:32, 1.54it/s] 84%|████████▎ | 3063/3665 [34:33<06:27, 1.55it/s] 84%|████████▎ | 3064/3665 [34:34<06:23, 1.57it/s] 84%|████████▎ | 3065/3665 [34:35<06:18, 1.59it/s] 84%|████████▎ | 3066/3665 [34:35<06:16, 1.59it/s] 84%|████████▎ | 3067/3665 [34:36<06:14, 1.60it/s] 84%|████████▎ | 3068/3665 [34:36<06:13, 1.60it/s] 84%|████████▎ | 3069/3665 [34:37<06:35, 1.51it/s] 84%|████████▍ | 3070/3665 [34:38<06:28, 1.53it/s] 84%|████████▍ | 3070/3665 [34:38<06:28, 1.53it/s] 84%|████████▍ | 3071/3665 [34:38<06:25, 1.54it/s] 84%|████████▍ | 3072/3665 [34:39<06:20, 1.56it/s] 84%|████████▍ | 3073/3665 [34:40<06:19, 1.56it/s] 84%|████████▍ | 3074/3665 [34:40<06:14, 1.58it/s] 84%|████████▍ | 3075/3665 [34:41<07:14, 1.36it/s] 84%|████████▍ | 3076/3665 [34:42<06:46, 1.45it/s] 84%|████████▍ | 3077/3665 [34:43<06:47, 1.44it/s] 84%|████████▍ | 3078/3665 [34:43<06:53, 1.42it/s] 84%|████████▍ | 3079/3665 [34:44<07:21, 1.33it/s] 84%|████████▍ | 3080/3665 [34:45<07:16, 1.34it/s] 84%|████████▍ | 3080/3665 [34:45<07:16, 1.34it/s] 84%|████████▍ | 3081/3665 [34:46<06:58, 1.40it/s] 84%|████████▍ | 3082/3665 [34:46<06:48, 1.43it/s] 84%|████████▍ | 3083/3665 [34:47<06:32, 1.48it/s] 84%|████████▍ | 3084/3665 [34:48<07:17, 1.33it/s] 84%|████████▍ | 3085/3665 [34:48<07:08, 1.35it/s] 84%|████████▍ | 3086/3665 [34:49<06:47, 1.42it/s] 84%|████████▍ | 3087/3665 [34:50<06:51, 1.41it/s] 84%|████████▍ | 3088/3665 [34:50<06:35, 1.46it/s] 84%|████████▍ | 3089/3665 [34:51<06:22, 1.51it/s] 84%|████████▍ | 3090/3665 [34:52<06:13, 1.54it/s] 84%|████████▍ | 3090/3665 [34:52<06:13, 1.54it/s] 84%|████████▍ | 3091/3665 [34:52<06:10, 1.55it/s] 84%|████████▍ | 3092/3665 [34:53<05:58, 1.60it/s] 84%|████████▍ | 3093/3665 [34:54<06:28, 1.47it/s] 84%|████████▍ | 3094/3665 [34:54<06:28, 1.47it/s] 84%|████████▍ | 3095/3665 [34:55<06:20, 1.50it/s] 84%|████████▍ | 3096/3665 [34:56<06:14, 1.52it/s] 85%|████████▍ | 3097/3665 [34:56<06:09, 1.54it/s] 85%|████████▍ | 3098/3665 [34:57<06:02, 1.56it/s] 85%|████████▍ | 3099/3665 [34:58<06:06, 1.55it/s] 85%|████████▍ | 3100/3665 [34:58<06:02, 1.56it/s] 85%|████████▍ | 3100/3665 [34:58<06:02, 1.56it/s] 85%|████████▍ | 3101/3665 [34:59<06:23, 1.47it/s] 85%|████████▍ | 3102/3665 [35:00<06:15, 1.50it/s] 85%|████████▍ | 3103/3665 [35:00<06:29, 1.44it/s] 85%|████████▍ | 3104/3665 [35:01<06:17, 1.48it/s] 85%|████████▍ | 3105/3665 [35:02<06:31, 1.43it/s] 85%|████████▍ | 3106/3665 [35:03<07:28, 1.25it/s] 85%|████████▍ | 3107/3665 [35:03<06:57, 1.34it/s] 85%|████████▍ | 3108/3665 [35:04<06:35, 1.41it/s] 85%|████████▍ | 3109/3665 [35:05<06:39, 1.39it/s] 85%|████████▍ | 3110/3665 [35:05<06:22, 1.45it/s] 85%|████████▍ | 3110/3665 [35:05<06:22, 1.45it/s] 85%|████████▍ | 3111/3665 [35:06<06:11, 1.49it/s] 85%|████████▍ | 3112/3665 [35:07<06:12, 1.48it/s] 85%|████████▍ | 3113/3665 [35:07<06:16, 1.47it/s] 85%|████████▍ | 3114/3665 [35:08<05:58, 1.54it/s] 85%|████████▍ | 3115/3665 [35:09<05:53, 1.56it/s] 85%|████████▌ | 3116/3665 [35:11<09:58, 1.09s/it] 85%|████████▌ | 3117/3665 [35:11<08:49, 1.04it/s] 85%|████████▌ | 3118/3665 [35:12<08:12, 1.11it/s] 85%|████████▌ | 3119/3665 [35:13<07:26, 1.22it/s] 85%|████████▌ | 3120/3665 [35:14<07:13, 1.26it/s] 85%|████████▌ | 3120/3665 [35:14<07:13, 1.26it/s] 85%|████████▌ | 3121/3665 [35:14<06:45, 1.34it/s] 85%|████████▌ | 3122/3665 [35:15<06:34, 1.38it/s] 85%|████████▌ | 3123/3665 [35:15<06:09, 1.47it/s] 85%|████████▌ | 3124/3665 [35:16<06:16, 1.44it/s] 85%|████████▌ | 3125/3665 [35:17<06:01, 1.49it/s] 85%|████████▌ | 3126/3665 [35:17<05:54, 1.52it/s] 85%|████████▌ | 3127/3665 [35:18<05:46, 1.55it/s] 85%|████████▌ | 3128/3665 [35:19<06:00, 1.49it/s] 85%|████████▌ | 3129/3665 [35:19<06:09, 1.45it/s] 85%|████████▌ | 3130/3665 [35:20<05:56, 1.50it/s] 85%|████████▌ | 3130/3665 [35:20<05:56, 1.50it/s] 85%|████████▌ | 3131/3665 [35:21<05:51, 1.52it/s] 85%|████████▌ | 3132/3665 [35:21<05:38, 1.57it/s] 85%|████████▌ | 3133/3665 [35:22<05:35, 1.59it/s] 86%|████████▌ | 3134/3665 [35:23<05:53, 1.50it/s] 86%|████████▌ | 3135/3665 [35:23<05:54, 1.49it/s] 86%|████████▌ | 3136/3665 [35:24<05:53, 1.50it/s] 86%|████████▌ | 3137/3665 [35:25<05:47, 1.52it/s] 86%|████████▌ | 3138/3665 [35:25<05:39, 1.55it/s] 86%|████████▌ | 3139/3665 [35:26<05:34, 1.57it/s] 86%|████████▌ | 3140/3665 [35:27<05:31, 1.58it/s] 86%|████████▌ | 3140/3665 [35:27<05:31, 1.58it/s] 86%|████████▌ | 3141/3665 [35:27<05:32, 1.58it/s] 86%|████████▌ | 3142/3665 [35:28<05:29, 1.59it/s] 86%|████████▌ | 3143/3665 [35:28<05:35, 1.55it/s] 86%|████████▌ | 3144/3665 [35:29<05:32, 1.57it/s] 86%|████████▌ | 3145/3665 [35:30<05:37, 1.54it/s] 86%|████████▌ | 3146/3665 [35:30<05:44, 1.50it/s] 86%|████████▌ | 3147/3665 [35:31<05:55, 1.46it/s] 86%|████████▌ | 3148/3665 [35:32<05:51, 1.47it/s] 86%|████████▌ | 3149/3665 [35:32<05:44, 1.50it/s] 86%|████████▌ | 3150/3665 [35:33<05:49, 1.48it/s] 86%|████████▌ | 3150/3665 [35:33<05:49, 1.48it/s] 86%|████████▌ | 3151/3665 [35:34<05:42, 1.50it/s] 86%|████████▌ | 3152/3665 [35:35<05:51, 1.46it/s] 86%|████████▌ | 3153/3665 [35:35<05:50, 1.46it/s] 86%|████████▌ | 3154/3665 [35:36<05:38, 1.51it/s] 86%|████████▌ | 3155/3665 [35:36<05:32, 1.53it/s] 86%|████████▌ | 3156/3665 [35:37<05:27, 1.55it/s] 86%|████████▌ | 3157/3665 [35:38<05:25, 1.56it/s] 86%|████████▌ | 3158/3665 [35:38<05:34, 1.51it/s] 86%|████████▌ | 3159/3665 [35:39<05:26, 1.55it/s] 86%|████████▌ | 3160/3665 [35:40<05:34, 1.51it/s] 86%|████████▌ | 3160/3665 [35:40<05:34, 1.51it/s] 86%|████████▌ | 3161/3665 [35:40<05:30, 1.52it/s] 86%|████████▋ | 3162/3665 [35:41<06:00, 1.39it/s] 86%|████████▋ | 3163/3665 [35:42<06:39, 1.26it/s] 86%|████████▋ | 3164/3665 [35:43<06:14, 1.34it/s] 86%|████████▋ | 3165/3665 [35:44<07:10, 1.16it/s] 86%|████████▋ | 3166/3665 [35:45<06:54, 1.20it/s] 86%|████████▋ | 3167/3665 [35:45<06:21, 1.31it/s] 86%|████████▋ | 3168/3665 [35:46<06:06, 1.36it/s] 86%|████████▋ | 3169/3665 [35:47<05:48, 1.42it/s] 86%|████████▋ | 3170/3665 [35:47<05:29, 1.50it/s] 86%|████████▋ | 3170/3665 [35:47<05:29, 1.50it/s] 87%|████████▋ | 3171/3665 [35:48<05:17, 1.55it/s] 87%|████████▋ | 3172/3665 [35:48<05:14, 1.57it/s] 87%|████████▋ | 3173/3665 [35:49<05:33, 1.47it/s] 87%|████████▋ | 3174/3665 [35:50<05:25, 1.51it/s] 87%|████████▋ | 3175/3665 [35:50<05:20, 1.53it/s] 87%|████████▋ | 3176/3665 [35:51<05:17, 1.54it/s] 87%|████████▋ | 3177/3665 [35:52<05:22, 1.51it/s] 87%|████████▋ | 3178/3665 [35:52<05:24, 1.50it/s] 87%|████████▋ | 3179/3665 [35:53<05:17, 1.53it/s] 87%|████████▋ | 3180/3665 [35:54<05:10, 1.56it/s] 87%|████████▋ | 3180/3665 [35:54<05:10, 1.56it/s] 87%|████████▋ | 3181/3665 [35:55<05:30, 1.46it/s] 87%|████████▋ | 3182/3665 [35:55<05:27, 1.47it/s] 87%|████████▋ | 3183/3665 [35:56<05:20, 1.50it/s] 87%|████████▋ | 3184/3665 [35:56<05:12, 1.54it/s] 87%|████████▋ | 3185/3665 [35:57<05:07, 1.56it/s] 87%|████████▋ | 3186/3665 [35:58<05:04, 1.57it/s] 87%|████████▋ | 3187/3665 [35:58<05:09, 1.54it/s] 87%|████████▋ | 3188/3665 [35:59<05:04, 1.57it/s] 87%|████████▋ | 3189/3665 [36:00<05:10, 1.53it/s] 87%|████████▋ | 3190/3665 [36:00<05:16, 1.50it/s] 87%|████████▋ | 3190/3665 [36:00<05:16, 1.50it/s] 87%|████████▋ | 3191/3665 [36:01<05:11, 1.52it/s] 87%|████████▋ | 3192/3665 [36:02<05:14, 1.50it/s] 87%|████████▋ | 3193/3665 [36:02<05:06, 1.54it/s] 87%|████████▋ | 3194/3665 [36:03<05:10, 1.52it/s] 87%|████████▋ | 3195/3665 [36:04<05:05, 1.54it/s] 87%|████████▋ | 3196/3665 [36:05<06:17, 1.24it/s] 87%|████████▋ | 3197/3665 [36:05<05:50, 1.33it/s] 87%|████████▋ | 3198/3665 [36:06<05:32, 1.40it/s] 87%|████████▋ | 3199/3665 [36:07<05:28, 1.42it/s] 87%|████████▋ | 3200/3665 [36:07<05:32, 1.40it/s] 87%|████████▋ | 3200/3665 [36:07<05:32, 1.40it/s] 87%|████████▋ | 3201/3665 [36:08<05:36, 1.38it/s] 87%|████████▋ | 3202/3665 [36:09<05:16, 1.46it/s] 87%|████████▋ | 3203/3665 [36:10<05:25, 1.42it/s] 87%|████████▋ | 3204/3665 [36:10<05:11, 1.48it/s] 87%|████████▋ | 3205/3665 [36:11<05:04, 1.51it/s] 87%|████████▋ | 3206/3665 [36:11<05:05, 1.50it/s] 88%|████████▊ | 3207/3665 [36:12<05:04, 1.50it/s] 88%|████████▊ | 3208/3665 [36:13<05:09, 1.48it/s] 88%|████████▊ | 3209/3665 [36:13<04:59, 1.52it/s] 88%|████████▊ | 3210/3665 [36:14<05:04, 1.49it/s] 88%|████████▊ | 3210/3665 [36:14<05:04, 1.49it/s] 88%|████████▊ | 3211/3665 [36:15<04:58, 1.52it/s] 88%|████████▊ | 3212/3665 [36:15<04:51, 1.56it/s] 88%|████████▊ | 3213/3665 [36:16<05:04, 1.48it/s] 88%|████████▊ | 3214/3665 [36:17<04:56, 1.52it/s] 88%|████████▊ | 3215/3665 [36:17<04:51, 1.54it/s] 88%|████████▊ | 3216/3665 [36:18<04:47, 1.56it/s] 88%|████████▊ | 3217/3665 [36:19<04:43, 1.58it/s] 88%|████████▊ | 3218/3665 [36:20<05:22, 1.38it/s] 88%|████████▊ | 3219/3665 [36:20<05:50, 1.27it/s] 88%|████████▊ | 3220/3665 [36:21<05:43, 1.30it/s] 88%|████████▊ | 3220/3665 [36:21<05:43, 1.30it/s] 88%|████████▊ | 3221/3665 [36:22<05:24, 1.37it/s] 88%|████████▊ | 3222/3665 [36:23<05:17, 1.39it/s] 88%|████████▊ | 3223/3665 [36:23<05:04, 1.45it/s] 88%|████████▊ | 3224/3665 [36:24<05:36, 1.31it/s] 88%|████████▊ | 3225/3665 [36:25<05:17, 1.39it/s] 88%|████████▊ | 3226/3665 [36:25<05:09, 1.42it/s] 88%|████████▊ | 3227/3665 [36:26<04:56, 1.48it/s] 88%|████████▊ | 3228/3665 [36:27<04:49, 1.51it/s] 88%|████████▊ | 3229/3665 [36:27<04:37, 1.57it/s] 88%|████████▊ | 3230/3665 [36:28<04:48, 1.51it/s] 88%|████████▊ | 3230/3665 [36:28<04:48, 1.51it/s] 88%|████████▊ | 3231/3665 [36:29<04:43, 1.53it/s] 88%|████████▊ | 3232/3665 [36:29<04:45, 1.52it/s] 88%|████████▊ | 3233/3665 [36:30<04:50, 1.49it/s] 88%|████████▊ | 3234/3665 [36:31<04:49, 1.49it/s] 88%|████████▊ | 3235/3665 [36:31<04:55, 1.45it/s] 88%|████████▊ | 3236/3665 [36:32<04:48, 1.49it/s] 88%|████████▊ | 3237/3665 [36:33<04:58, 1.43it/s] 88%|████████▊ | 3238/3665 [36:33<04:53, 1.45it/s] 88%|████████▊ | 3239/3665 [36:34<04:43, 1.50it/s] 88%|████████▊ | 3240/3665 [36:35<04:32, 1.56it/s] 88%|████████▊ | 3240/3665 [36:35<04:32, 1.56it/s] 88%|████████▊ | 3241/3665 [36:35<04:46, 1.48it/s] 88%|████████▊ | 3242/3665 [36:36<04:39, 1.51it/s] 88%|████████▊ | 3243/3665 [36:37<04:47, 1.47it/s] 89%|████████▊ | 3244/3665 [36:37<04:46, 1.47it/s] 89%|████████▊ | 3245/3665 [36:38<04:44, 1.48it/s] 89%|████████▊ | 3246/3665 [36:39<04:53, 1.43it/s] 89%|████████▊ | 3247/3665 [36:40<05:06, 1.36it/s] 89%|████████▊ | 3248/3665 [36:40<04:46, 1.45it/s] 89%|████████▊ | 3249/3665 [36:41<04:39, 1.49it/s] 89%|████████▊ | 3250/3665 [36:42<05:11, 1.33it/s] 89%|████████▊ | 3250/3665 [36:42<05:11, 1.33it/s] 89%|████████▊ | 3251/3665 [36:43<05:26, 1.27it/s] 89%|████████▊ | 3252/3665 [36:43<05:05, 1.35it/s] 89%|████████▉ | 3253/3665 [36:44<04:56, 1.39it/s] 89%|████████▉ | 3254/3665 [36:45<04:44, 1.44it/s] 89%|████████▉ | 3255/3665 [36:45<04:41, 1.45it/s] 89%|████████▉ | 3256/3665 [36:46<04:33, 1.50it/s] 89%|████████▉ | 3257/3665 [36:47<05:39, 1.20it/s] 89%|████████▉ | 3258/3665 [36:48<05:22, 1.26it/s] 89%|████████▉ | 3259/3665 [36:48<04:59, 1.35it/s] 89%|████████▉ | 3260/3665 [36:49<04:45, 1.42it/s] 89%|████████▉ | 3260/3665 [36:49<04:45, 1.42it/s] 89%|████████▉ | 3261/3665 [36:50<04:36, 1.46it/s] 89%|████████▉ | 3262/3665 [36:50<04:26, 1.51it/s] 89%|████████▉ | 3263/3665 [36:51<04:26, 1.51it/s] 89%|████████▉ | 3264/3665 [36:52<04:20, 1.54it/s] 89%|████████▉ | 3265/3665 [36:52<04:23, 1.52it/s] 89%|████████▉ | 3266/3665 [36:53<04:16, 1.55it/s] 89%|████████▉ | 3267/3665 [36:53<04:15, 1.56it/s] 89%|████████▉ | 3268/3665 [36:54<04:12, 1.57it/s] 89%|████████▉ | 3269/3665 [36:55<04:12, 1.57it/s] 89%|████████▉ | 3270/3665 [36:55<04:10, 1.58it/s] 89%|████████▉ | 3270/3665 [36:55<04:10, 1.58it/s] 89%|████████▉ | 3271/3665 [36:56<04:16, 1.54it/s] 89%|████████▉ | 3272/3665 [36:57<04:12, 1.56it/s] 89%|████████▉ | 3273/3665 [36:58<05:11, 1.26it/s] 89%|████████▉ | 3274/3665 [36:59<05:06, 1.27it/s] 89%|████████▉ | 3275/3665 [36:59<04:52, 1.33it/s] 89%|████████▉ | 3276/3665 [37:00<05:11, 1.25it/s] 89%|████████▉ | 3277/3665 [37:01<04:49, 1.34it/s] 89%|████████▉ | 3278/3665 [37:01<04:43, 1.36it/s] 89%|████████▉ | 3279/3665 [37:02<04:30, 1.43it/s] 89%|████████▉ | 3280/3665 [37:03<04:21, 1.47it/s] 89%|████████▉ | 3280/3665 [37:03<04:21, 1.47it/s] 90%|████████▉ | 3281/3665 [37:03<04:20, 1.47it/s] 90%|████████▉ | 3282/3665 [37:04<04:27, 1.43it/s] 90%|████████▉ | 3283/3665 [37:05<04:17, 1.49it/s] 90%|████████▉ | 3284/3665 [37:05<04:22, 1.45it/s] 90%|████████▉ | 3285/3665 [37:06<04:15, 1.49it/s] 90%|████████▉ | 3286/3665 [37:07<04:18, 1.47it/s] 90%|████████▉ | 3287/3665 [37:07<04:05, 1.54it/s] 90%|████████▉ | 3288/3665 [37:08<04:02, 1.56it/s] 90%|████████▉ | 3289/3665 [37:09<04:14, 1.47it/s] 90%|████████▉ | 3290/3665 [37:09<04:17, 1.46it/s] 90%|████████▉ | 3290/3665 [37:09<04:17, 1.46it/s] 90%|████████▉ | 3291/3665 [37:10<04:10, 1.49it/s] 90%|████████▉ | 3292/3665 [37:11<04:43, 1.31it/s] 90%|████████▉ | 3293/3665 [37:12<04:28, 1.38it/s] 90%|████████▉ | 3294/3665 [37:12<04:17, 1.44it/s] 90%|████████▉ | 3295/3665 [37:13<04:07, 1.50it/s] 90%|████████▉ | 3296/3665 [37:14<03:56, 1.56it/s] 90%|████████▉ | 3297/3665 [37:14<03:59, 1.53it/s] 90%|████████▉ | 3298/3665 [37:15<04:15, 1.44it/s] 90%|█████████ | 3299/3665 [37:16<04:27, 1.37it/s] 90%|█████████ | 3300/3665 [37:16<04:15, 1.43it/s] 90%|█████████ | 3300/3665 [37:16<04:15, 1.43it/s] 90%|█████████ | 3301/3665 [37:17<04:06, 1.48it/s] 90%|█████████ | 3302/3665 [37:18<04:00, 1.51it/s] 90%|█████████ | 3303/3665 [37:18<04:07, 1.46it/s] 90%|█████████ | 3304/3665 [37:19<04:25, 1.36it/s] 90%|█████████ | 3305/3665 [37:20<04:28, 1.34it/s] 90%|█████████ | 3306/3665 [37:21<04:19, 1.38it/s] 90%|█████████ | 3307/3665 [37:21<04:07, 1.45it/s] 90%|█████████ | 3308/3665 [37:22<03:58, 1.50it/s] 90%|█████████ | 3309/3665 [37:23<03:54, 1.52it/s] 90%|█████████ | 3310/3665 [37:23<03:49, 1.55it/s] 90%|█████████ | 3310/3665 [37:23<03:49, 1.55it/s] 90%|█████████ | 3311/3665 [37:24<03:46, 1.56it/s] 90%|█████████ | 3312/3665 [37:25<03:49, 1.54it/s] 90%|█████████ | 3313/3665 [37:25<03:51, 1.52it/s] 90%|█████████ | 3314/3665 [37:26<03:52, 1.51it/s] 90%|█████████ | 3315/3665 [37:27<04:04, 1.43it/s] 90%|█████████ | 3316/3665 [37:27<03:54, 1.49it/s] 91%|█████████ | 3317/3665 [37:28<03:49, 1.52it/s] 91%|█████████ | 3318/3665 [37:29<03:49, 1.51it/s] 91%|█████████ | 3319/3665 [37:29<03:52, 1.49it/s] 91%|█████████ | 3320/3665 [37:30<03:53, 1.48it/s] 91%|█████████ | 3320/3665 [37:30<03:53, 1.48it/s] 91%|█████████ | 3321/3665 [37:31<03:47, 1.51it/s] 91%|█████████ | 3322/3665 [37:31<03:49, 1.50it/s] 91%|█████████ | 3323/3665 [37:32<03:54, 1.46it/s] 91%|█████████ | 3324/3665 [37:33<03:49, 1.49it/s] 91%|█████████ | 3325/3665 [37:33<03:58, 1.42it/s] 91%|█████████ | 3326/3665 [37:34<04:13, 1.34it/s] 91%|█████████ | 3327/3665 [37:35<04:01, 1.40it/s] 91%|█████████ | 3328/3665 [37:36<03:56, 1.42it/s] 91%|█████████ | 3329/3665 [37:36<03:47, 1.48it/s] 91%|█████████ | 3330/3665 [37:37<03:48, 1.46it/s] 91%|█████████ | 3330/3665 [37:37<03:48, 1.46it/s] 91%|█████████ | 3331/3665 [37:38<03:47, 1.47it/s] 91%|█████████ | 3332/3665 [37:38<03:51, 1.44it/s] 91%|█████████ | 3333/3665 [37:39<03:56, 1.40it/s] 91%|█████████ | 3334/3665 [37:40<03:51, 1.43it/s] 91%|█████████ | 3335/3665 [37:40<03:42, 1.48it/s] 91%|█████████ | 3336/3665 [37:41<03:37, 1.51it/s] 91%|█████████ | 3337/3665 [37:42<04:01, 1.36it/s] 91%|█████████ | 3338/3665 [37:42<03:50, 1.42it/s] 91%|█████████ | 3339/3665 [37:43<03:42, 1.46it/s] 91%|█████████ | 3340/3665 [37:44<03:35, 1.51it/s] 91%|█████████ | 3340/3665 [37:44<03:35, 1.51it/s] 91%|█████████ | 3341/3665 [37:44<03:30, 1.54it/s] 91%|█████████ | 3342/3665 [37:45<03:38, 1.48it/s] 91%|█████████ | 3343/3665 [37:46<03:37, 1.48it/s] 91%|█████████ | 3344/3665 [37:46<03:35, 1.49it/s] 91%|█████████▏| 3345/3665 [37:47<03:26, 1.55it/s] 91%|█████████▏| 3346/3665 [37:48<03:27, 1.54it/s] 91%|█████████▏| 3347/3665 [37:48<03:30, 1.51it/s] 91%|█████████▏| 3348/3665 [37:49<03:26, 1.54it/s] 91%|█████████▏| 3349/3665 [37:50<03:24, 1.55it/s] 91%|█████████▏| 3350/3665 [37:50<03:22, 1.56it/s] 91%|█████████▏| 3350/3665 [37:50<03:22, 1.56it/s] 91%|█████████▏| 3351/3665 [37:51<03:25, 1.53it/s] 91%|█████████▏| 3352/3665 [37:52<03:20, 1.56it/s] 91%|█████████▏| 3353/3665 [37:52<03:18, 1.57it/s] 92%|█████████▏| 3354/3665 [37:53<03:21, 1.55it/s] 92%|█████████▏| 3355/3665 [37:54<03:24, 1.52it/s] 92%|█████████▏| 3356/3665 [37:54<03:20, 1.54it/s] 92%|█████████▏| 3357/3665 [37:55<03:18, 1.55it/s] 92%|█████████▏| 3358/3665 [37:55<03:15, 1.57it/s] 92%|█████████▏| 3359/3665 [37:56<03:14, 1.57it/s] 92%|█████████▏| 3360/3665 [37:57<03:13, 1.58it/s] 92%|█████████▏| 3360/3665 [37:57<03:13, 1.58it/s] 92%|█████████▏| 3361/3665 [37:57<03:13, 1.57it/s] 92%|█████████▏| 3362/3665 [37:58<03:11, 1.58it/s] 92%|█████████▏| 3363/3665 [37:59<03:06, 1.62it/s] 92%|█████████▏| 3364/3665 [37:59<03:19, 1.51it/s] 92%|█████████▏| 3365/3665 [38:00<03:14, 1.54it/s] 92%|█████████▏| 3366/3665 [38:01<03:18, 1.51it/s] 92%|█████████▏| 3367/3665 [38:01<03:18, 1.50it/s] 92%|█████████▏| 3368/3665 [38:02<03:14, 1.53it/s] 92%|█████████▏| 3369/3665 [38:03<03:23, 1.46it/s] 92%|█████████▏| 3370/3665 [38:03<03:26, 1.43it/s] 92%|█████████▏| 3370/3665 [38:03<03:26, 1.43it/s] 92%|█████████▏| 3371/3665 [38:04<03:21, 1.46it/s] 92%|█████████▏| 3372/3665 [38:05<04:15, 1.15it/s] 92%|█████████▏| 3373/3665 [38:06<04:03, 1.20it/s] 92%|█████████▏| 3374/3665 [38:07<03:43, 1.30it/s] 92%|█████████▏| 3375/3665 [38:07<03:29, 1.39it/s] 92%|█████████▏| 3376/3665 [38:08<03:20, 1.44it/s] 92%|█████████▏| 3377/3665 [38:09<03:13, 1.49it/s] 92%|█████████▏| 3378/3665 [38:09<03:12, 1.49it/s] 92%|█████████▏| 3379/3665 [38:10<03:07, 1.52it/s] 92%|█████████▏| 3380/3665 [38:11<03:14, 1.47it/s] 92%|█████████▏| 3380/3665 [38:11<03:14, 1.47it/s] 92%|█████████▏| 3381/3665 [38:11<03:14, 1.46it/s] 92%|█████████▏| 3382/3665 [38:12<03:19, 1.42it/s] 92%|█████████▏| 3383/3665 [38:13<03:11, 1.47it/s] 92%|█████████▏| 3384/3665 [38:13<03:10, 1.48it/s] 92%|█████████▏| 3385/3665 [38:14<03:06, 1.50it/s] 92%|█████████▏| 3386/3665 [38:15<02:58, 1.56it/s] 92%|█████████▏| 3387/3665 [38:15<02:56, 1.57it/s] 92%|█████████▏| 3388/3665 [38:16<02:55, 1.58it/s] 92%|█████████▏| 3389/3665 [38:16<02:54, 1.58it/s] 92%|█████████▏| 3390/3665 [38:17<02:52, 1.60it/s] 92%|█████████▏| 3390/3665 [38:17<02:52, 1.60it/s] 93%|█████████▎| 3391/3665 [38:18<02:48, 1.62it/s] 93%|█████████▎| 3392/3665 [38:18<02:48, 1.62it/s] 93%|█████████▎| 3393/3665 [38:19<02:48, 1.61it/s] 93%|█████████▎| 3394/3665 [38:19<02:47, 1.62it/s] 93%|█████████▎| 3395/3665 [38:20<02:52, 1.57it/s] 93%|█████████▎| 3396/3665 [38:21<02:53, 1.55it/s] 93%|█████████▎| 3397/3665 [38:21<02:50, 1.57it/s] 93%|█████████▎| 3398/3665 [38:22<02:57, 1.51it/s] 93%|█████████▎| 3399/3665 [38:23<02:53, 1.53it/s] 93%|█████████▎| 3400/3665 [38:24<03:30, 1.26it/s] 93%|█████████▎| 3400/3665 [38:24<03:30, 1.26it/s] 93%|█████████▎| 3401/3665 [38:25<03:17, 1.34it/s] 93%|█████████▎| 3402/3665 [38:25<03:06, 1.41it/s] 93%|█████████▎| 3403/3665 [38:26<02:59, 1.46it/s] 93%|█████████▎| 3404/3665 [38:26<02:53, 1.51it/s] 93%|█████████▎| 3405/3665 [38:27<02:49, 1.53it/s] 93%|█████████▎| 3406/3665 [38:28<02:48, 1.54it/s] 93%|█████████▎| 3407/3665 [38:28<02:57, 1.45it/s] 93%|█████████▎| 3408/3665 [38:29<02:52, 1.49it/s] 93%|█████████▎| 3409/3665 [38:30<02:46, 1.53it/s] 93%|█████████▎| 3410/3665 [38:30<02:44, 1.55it/s] 93%|█████████▎| 3410/3665 [38:30<02:44, 1.55it/s] 93%|█████████▎| 3411/3665 [38:31<02:43, 1.55it/s] 93%|█████████▎| 3412/3665 [38:32<02:51, 1.48it/s] 93%|█████████▎| 3413/3665 [38:32<02:51, 1.47it/s] 93%|█████████▎| 3414/3665 [38:33<02:51, 1.47it/s] 93%|█████████▎| 3415/3665 [38:34<02:54, 1.43it/s] 93%|█████████▎| 3416/3665 [38:35<02:57, 1.40it/s] 93%|█████████▎| 3417/3665 [38:35<02:54, 1.42it/s] 93%|█████████▎| 3418/3665 [38:36<02:47, 1.47it/s] 93%|█████████▎| 3419/3665 [38:37<02:43, 1.50it/s] 93%|█████████▎| 3420/3665 [38:37<02:43, 1.50it/s] 93%|█████████▎| 3420/3665 [38:37<02:43, 1.50it/s] 93%|█████████▎| 3421/3665 [38:38<02:39, 1.53it/s] 93%|█████████▎| 3422/3665 [38:39<02:41, 1.51it/s] 93%|█████████▎| 3423/3665 [38:39<02:42, 1.49it/s] 93%|█████████▎| 3424/3665 [38:40<02:51, 1.41it/s] 93%|█████████▎| 3425/3665 [38:41<02:47, 1.43it/s] 93%|█████████▎| 3426/3665 [38:41<02:41, 1.48it/s] 94%|█████████▎| 3427/3665 [38:42<02:37, 1.51it/s] 94%|█████████▎| 3428/3665 [38:43<02:33, 1.55it/s] 94%|█████████▎| 3429/3665 [38:43<02:38, 1.49it/s] 94%|█████████▎| 3430/3665 [38:44<02:34, 1.52it/s] 94%|█████████▎| 3430/3665 [38:44<02:34, 1.52it/s] 94%|█████████▎| 3431/3665 [38:45<02:32, 1.53it/s] 94%|█████████▎| 3432/3665 [38:45<02:35, 1.50it/s] 94%|█████████▎| 3433/3665 [38:46<02:39, 1.46it/s] 94%|█████████▎| 3434/3665 [38:47<02:31, 1.53it/s] 94%|█████████▎| 3435/3665 [38:47<02:25, 1.58it/s] 94%|█████████▍| 3436/3665 [38:48<02:27, 1.56it/s] 94%|█████████▍| 3437/3665 [38:48<02:23, 1.58it/s] 94%|█████████▍| 3438/3665 [38:49<02:19, 1.62it/s] 94%|█████████▍| 3439/3665 [38:50<02:23, 1.57it/s] 94%|█████████▍| 3440/3665 [38:50<02:19, 1.61it/s] 94%|█████████▍| 3440/3665 [38:50<02:19, 1.61it/s] 94%|█████████▍| 3441/3665 [38:51<02:20, 1.59it/s] 94%|█████████▍| 3442/3665 [38:51<02:16, 1.63it/s] 94%|█████████▍| 3443/3665 [38:52<02:22, 1.56it/s] 94%|█████████▍| 3444/3665 [38:53<02:20, 1.57it/s] 94%|█████████▍| 3445/3665 [38:53<02:19, 1.58it/s] 94%|█████████▍| 3446/3665 [38:54<02:19, 1.58it/s] 94%|█████████▍| 3447/3665 [38:55<02:16, 1.59it/s] 94%|█████████▍| 3448/3665 [38:55<02:19, 1.55it/s] 94%|█████████▍| 3449/3665 [38:56<02:18, 1.57it/s] 94%|█████████▍| 3450/3665 [38:57<02:23, 1.50it/s] 94%|█████████▍| 3450/3665 [38:57<02:23, 1.50it/s] 94%|█████████▍| 3451/3665 [38:57<02:29, 1.43it/s] 94%|█████████▍| 3452/3665 [38:58<02:26, 1.45it/s] 94%|█████████▍| 3453/3665 [38:59<02:25, 1.45it/s] 94%|█████████▍| 3454/3665 [38:59<02:20, 1.50it/s] 94%|█████████▍| 3455/3665 [39:00<02:17, 1.53it/s] 94%|█████████▍| 3456/3665 [39:01<02:15, 1.55it/s] 94%|█████████▍| 3457/3665 [39:02<03:00, 1.15it/s] 94%|█████████▍| 3458/3665 [39:03<02:48, 1.23it/s] 94%|█████████▍| 3459/3665 [39:03<02:33, 1.34it/s] 94%|█████████▍| 3460/3665 [39:04<02:42, 1.26it/s] 94%|█████████▍| 3460/3665 [39:04<02:42, 1.26it/s] 94%|█████████▍| 3461/3665 [39:05<02:36, 1.30it/s] 94%|█████████▍| 3462/3665 [39:06<02:36, 1.30it/s] 94%|█████████▍| 3463/3665 [39:06<02:30, 1.34it/s] 95%|█████████▍| 3464/3665 [39:07<02:21, 1.42it/s] 95%|█████████▍| 3465/3665 [39:08<02:20, 1.42it/s] 95%|█████████▍| 3466/3665 [39:08<02:21, 1.41it/s] 95%|█████████▍| 3467/3665 [39:09<02:15, 1.46it/s] 95%|█████████▍| 3468/3665 [39:10<02:18, 1.43it/s] 95%|█████████▍| 3469/3665 [39:10<02:13, 1.47it/s] 95%|█████████▍| 3470/3665 [39:11<02:09, 1.50it/s] 95%|█████████▍| 3470/3665 [39:11<02:09, 1.50it/s] 95%|█████████▍| 3471/3665 [39:12<02:06, 1.53it/s] 95%|█████████▍| 3472/3665 [39:12<02:07, 1.52it/s] 95%|█████████▍| 3473/3665 [39:13<02:12, 1.45it/s] 95%|█████████▍| 3474/3665 [39:14<02:07, 1.49it/s] 95%|█████████▍| 3475/3665 [39:14<02:07, 1.49it/s] 95%|█████████▍| 3476/3665 [39:15<02:03, 1.53it/s] 95%|█████████▍| 3477/3665 [39:16<02:01, 1.55it/s] 95%|█████████▍| 3478/3665 [39:16<01:58, 1.58it/s] 95%|█████████▍| 3479/3665 [39:17<02:00, 1.55it/s] 95%|█████████▍| 3480/3665 [39:18<02:04, 1.48it/s] 95%|█████████▍| 3480/3665 [39:18<02:04, 1.48it/s] 95%|█████████▍| 3481/3665 [39:18<02:06, 1.46it/s] 95%|█████████▌| 3482/3665 [39:19<02:08, 1.42it/s] 95%|█████████▌| 3483/3665 [39:20<02:01, 1.50it/s] 95%|█████████▌| 3484/3665 [39:20<01:57, 1.54it/s] 95%|█████████▌| 3485/3665 [39:21<02:01, 1.49it/s] 95%|█████████▌| 3486/3665 [39:22<01:58, 1.52it/s] 95%|█████████▌| 3487/3665 [39:22<01:55, 1.54it/s] 95%|█████████▌| 3488/3665 [39:23<01:51, 1.59it/s] 95%|█████████▌| 3489/3665 [39:24<01:53, 1.56it/s] 95%|█████████▌| 3490/3665 [39:24<01:53, 1.54it/s] 95%|█████████▌| 3490/3665 [39:24<01:53, 1.54it/s] 95%|█████████▌| 3491/3665 [39:25<01:51, 1.56it/s] 95%|█████████▌| 3492/3665 [39:26<01:53, 1.53it/s] 95%|█████████▌| 3493/3665 [39:26<01:51, 1.54it/s] 95%|█████████▌| 3494/3665 [39:27<01:49, 1.56it/s] 95%|█████████▌| 3495/3665 [39:28<01:53, 1.50it/s] 95%|█████████▌| 3496/3665 [39:28<01:50, 1.53it/s] 95%|█████████▌| 3497/3665 [39:29<02:01, 1.38it/s] 95%|█████████▌| 3498/3665 [39:30<01:56, 1.44it/s] 95%|█████████▌| 3499/3665 [39:30<01:57, 1.42it/s] 95%|█████████▌| 3500/3665 [39:31<01:59, 1.38it/s] 95%|█████████▌| 3500/3665 [39:31<01:59, 1.38it/s] 96%|█████████▌| 3501/3665 [39:32<01:56, 1.41it/s] 96%|█████████▌| 3502/3665 [39:33<01:55, 1.41it/s] 96%|█████████▌| 3503/3665 [39:33<01:50, 1.46it/s] 96%|█████████▌| 3504/3665 [39:34<01:52, 1.43it/s] 96%|█████████▌| 3505/3665 [39:35<01:53, 1.41it/s] 96%|█████████▌| 3506/3665 [39:35<01:48, 1.47it/s] 96%|█████████▌| 3507/3665 [39:36<01:44, 1.52it/s] 96%|█████████▌| 3508/3665 [39:37<01:45, 1.49it/s] 96%|█████████▌| 3509/3665 [39:37<01:43, 1.51it/s] 96%|█████████▌| 3510/3665 [39:38<01:39, 1.56it/s] 96%|█████████▌| 3510/3665 [39:38<01:39, 1.56it/s] 96%|█████████▌| 3511/3665 [39:38<01:36, 1.59it/s] 96%|█████████▌| 3512/3665 [39:39<01:36, 1.59it/s] 96%|█████████▌| 3513/3665 [39:40<01:35, 1.59it/s] 96%|█████████▌| 3514/3665 [39:40<01:34, 1.60it/s] 96%|█████████▌| 3515/3665 [39:41<01:33, 1.61it/s] 96%|█████████▌| 3516/3665 [39:42<01:30, 1.64it/s] 96%|█████████▌| 3517/3665 [39:42<01:30, 1.63it/s] 96%|█████████▌| 3518/3665 [39:43<01:32, 1.59it/s] 96%|█████████▌| 3519/3665 [39:43<01:32, 1.59it/s] 96%|█████████▌| 3520/3665 [39:44<01:31, 1.59it/s] 96%|█████████▌| 3520/3665 [39:44<01:31, 1.59it/s] 96%|█████████▌| 3521/3665 [39:45<01:39, 1.45it/s] 96%|█████████▌| 3522/3665 [39:46<01:35, 1.50it/s] 96%|█████████▌| 3523/3665 [39:46<01:32, 1.53it/s] 96%|█████████▌| 3524/3665 [39:47<01:32, 1.52it/s] 96%|█████████▌| 3525/3665 [39:47<01:30, 1.55it/s] 96%|█████████▌| 3526/3665 [39:48<01:27, 1.59it/s] 96%|█████████▌| 3527/3665 [39:49<01:28, 1.57it/s] 96%|█████████▋| 3528/3665 [39:49<01:26, 1.58it/s] 96%|█████████▋| 3529/3665 [39:50<01:25, 1.59it/s] 96%|█████████▋| 3530/3665 [39:51<01:28, 1.52it/s] 96%|█████████▋| 3530/3665 [39:51<01:28, 1.52it/s] 96%|█████████▋| 3531/3665 [39:51<01:27, 1.54it/s] 96%|█████████▋| 3532/3665 [39:52<01:29, 1.48it/s] 96%|█████████▋| 3533/3665 [39:53<01:27, 1.51it/s] 96%|█████████▋| 3534/3665 [39:53<01:24, 1.54it/s] 96%|█████████▋| 3535/3665 [39:54<01:22, 1.57it/s] 96%|█████████▋| 3536/3665 [39:55<01:31, 1.40it/s] 97%|█████████▋| 3537/3665 [39:55<01:28, 1.45it/s] 97%|█████████▋| 3538/3665 [39:56<01:25, 1.49it/s] 97%|█████████▋| 3539/3665 [39:57<01:21, 1.55it/s] 97%|█████████▋| 3540/3665 [39:57<01:19, 1.56it/s] 97%|█████████▋| 3540/3665 [39:57<01:19, 1.56it/s] 97%|█████████▋| 3541/3665 [39:58<01:17, 1.60it/s] 97%|█████████▋| 3542/3665 [39:58<01:17, 1.60it/s] 97%|█████████▋| 3543/3665 [39:59<01:16, 1.59it/s] 97%|█████████▋| 3544/3665 [40:00<01:18, 1.55it/s] 97%|█████████▋| 3545/3665 [40:00<01:20, 1.48it/s] 97%|█████████▋| 3546/3665 [40:01<01:22, 1.45it/s] 97%|█████████▋| 3547/3665 [40:02<01:21, 1.44it/s] 97%|█████████▋| 3548/3665 [40:03<01:18, 1.48it/s] 97%|█████████▋| 3549/3665 [40:03<01:15, 1.55it/s] 97%|█████████▋| 3550/3665 [40:04<01:15, 1.53it/s] 97%|█████████▋| 3550/3665 [40:04<01:15, 1.53it/s] 97%|█████████▋| 3551/3665 [40:04<01:13, 1.55it/s] 97%|█████████▋| 3552/3665 [40:05<01:12, 1.56it/s] 97%|█████████▋| 3553/3665 [40:06<01:11, 1.57it/s] 97%|█████████▋| 3554/3665 [40:06<01:10, 1.58it/s] 97%|█████████▋| 3555/3665 [40:07<01:09, 1.58it/s] 97%|█████████▋| 3556/3665 [40:08<01:08, 1.59it/s] 97%|█████████▋| 3557/3665 [40:08<01:06, 1.63it/s] 97%|█████████▋| 3558/3665 [40:09<01:05, 1.63it/s] 97%|█████████▋| 3559/3665 [40:09<01:05, 1.62it/s] 97%|█████████▋| 3560/3665 [40:10<01:04, 1.62it/s] 97%|█████████▋| 3560/3665 [40:10<01:04, 1.62it/s] 97%|█████████▋| 3561/3665 [40:11<01:08, 1.52it/s] 97%|█████████▋| 3562/3665 [40:11<01:06, 1.54it/s] 97%|█████████▋| 3563/3665 [40:12<01:08, 1.49it/s] 97%|█████████▋| 3564/3665 [40:13<01:06, 1.52it/s] 97%|█████████▋| 3565/3665 [40:13<01:06, 1.50it/s] 97%|█████████▋| 3566/3665 [40:14<01:04, 1.53it/s] 97%|█████████▋| 3567/3665 [40:15<01:06, 1.47it/s] 97%|█████████▋| 3568/3665 [40:16<01:07, 1.44it/s] 97%|█████████▋| 3569/3665 [40:16<01:04, 1.48it/s] 97%|█████████▋| 3570/3665 [40:17<01:02, 1.53it/s] 97%|█████████▋| 3570/3665 [40:17<01:02, 1.53it/s] 97%|█████████▋| 3571/3665 [40:18<01:04, 1.46it/s] 97%|█████████▋| 3572/3665 [40:18<01:03, 1.47it/s] 97%|█████████▋| 3573/3665 [40:19<01:02, 1.47it/s] 98%|█████████▊| 3574/3665 [40:19<01:00, 1.51it/s] 98%|█████████▊| 3575/3665 [40:20<01:00, 1.48it/s] 98%|█████████▊| 3576/3665 [40:21<01:01, 1.44it/s] 98%|█████████▊| 3577/3665 [40:22<00:58, 1.52it/s] 98%|█████████▊| 3578/3665 [40:22<00:56, 1.53it/s] 98%|█████████▊| 3579/3665 [40:23<01:00, 1.43it/s] 98%|█████████▊| 3580/3665 [40:24<00:56, 1.51it/s] 98%|█████████▊| 3580/3665 [40:24<00:56, 1.51it/s] 98%|█████████▊| 3581/3665 [40:24<00:55, 1.52it/s] 98%|█████████▊| 3582/3665 [40:25<00:53, 1.54it/s] 98%|█████████▊| 3583/3665 [40:26<00:55, 1.48it/s] 98%|█████████▊| 3584/3665 [40:26<00:56, 1.43it/s] 98%|█████████▊| 3585/3665 [40:27<00:53, 1.49it/s] 98%|█████████▊| 3586/3665 [40:28<00:52, 1.52it/s] 98%|█████████▊| 3587/3665 [40:28<00:52, 1.49it/s] 98%|█████████▊| 3588/3665 [40:29<00:53, 1.44it/s] 98%|█████████▊| 3589/3665 [40:30<00:50, 1.52it/s] 98%|█████████▊| 3590/3665 [40:30<00:48, 1.55it/s] 98%|█████████▊| 3590/3665 [40:30<00:48, 1.55it/s] 98%|█████████▊| 3591/3665 [40:31<00:47, 1.55it/s] 98%|█████████▊| 3592/3665 [40:31<00:47, 1.54it/s] 98%|█████████▊| 3593/3665 [40:32<00:46, 1.55it/s] 98%|█████████▊| 3594/3665 [40:33<00:45, 1.57it/s] 98%|█████████▊| 3595/3665 [40:33<00:44, 1.57it/s] 98%|█████████▊| 3596/3665 [40:34<00:43, 1.59it/s] 98%|█████████▊| 3597/3665 [40:35<00:42, 1.60it/s] 98%|█████████▊| 3598/3665 [40:35<00:42, 1.59it/s] 98%|█████████▊| 3599/3665 [40:36<00:47, 1.38it/s] 98%|█████████▊| 3600/3665 [40:37<00:46, 1.41it/s] 98%|█████████▊| 3600/3665 [40:37<00:46, 1.41it/s] 98%|█████████▊| 3601/3665 [40:38<00:48, 1.31it/s] 98%|█████████▊| 3602/3665 [40:38<00:46, 1.35it/s] 98%|█████████▊| 3603/3665 [40:39<00:43, 1.41it/s] 98%|█████████▊| 3604/3665 [40:40<00:41, 1.46it/s] 98%|█████████▊| 3605/3665 [40:40<00:39, 1.51it/s] 98%|█████████▊| 3606/3665 [40:41<00:38, 1.55it/s] 98%|█████████▊| 3607/3665 [40:42<00:37, 1.56it/s] 98%|█████████▊| 3608/3665 [40:42<00:35, 1.61it/s] 98%|█████████▊| 3609/3665 [40:43<00:34, 1.61it/s] 98%|█████████▊| 3610/3665 [40:43<00:33, 1.64it/s] 98%|█████████▊| 3610/3665 [40:43<00:33, 1.64it/s] 99%|█████████▊| 3611/3665 [40:44<00:38, 1.42it/s] 99%|█████████▊| 3612/3665 [40:45<00:36, 1.47it/s] 99%|█████████▊| 3613/3665 [40:46<00:34, 1.50it/s] 99%|█████████▊| 3614/3665 [40:46<00:33, 1.54it/s] 99%|█████████▊| 3615/3665 [40:47<00:31, 1.59it/s] 99%|█████████▊| 3616/3665 [40:47<00:30, 1.62it/s] 99%|█████████▊| 3617/3665 [40:48<00:30, 1.58it/s] 99%|█████████▊| 3618/3665 [40:49<00:32, 1.46it/s] 99%|█████████▊| 3619/3665 [40:49<00:30, 1.50it/s] 99%|█████████▉| 3620/3665 [40:50<00:28, 1.56it/s] 99%|█████████▉| 3620/3665 [40:50<00:28, 1.56it/s] 99%|█████████▉| 3621/3665 [40:51<00:29, 1.47it/s] 99%|█████████▉| 3622/3665 [40:51<00:28, 1.51it/s] 99%|█████████▉| 3623/3665 [40:52<00:27, 1.53it/s] 99%|█████████▉| 3624/3665 [40:53<00:26, 1.54it/s] 99%|█████████▉| 3625/3665 [40:53<00:26, 1.53it/s] 99%|█████████▉| 3626/3665 [40:54<00:25, 1.51it/s] 99%|█████████▉| 3627/3665 [40:55<00:24, 1.53it/s] 99%|█████████▉| 3628/3665 [40:56<00:28, 1.29it/s] 99%|█████████▉| 3629/3665 [40:56<00:26, 1.37it/s] 99%|█████████▉| 3630/3665 [40:57<00:24, 1.41it/s] 99%|█████████▉| 3630/3665 [40:57<00:24, 1.41it/s] 99%|█████████▉| 3631/3665 [40:58<00:23, 1.45it/s] 99%|█████████▉| 3632/3665 [40:58<00:22, 1.49it/s] 99%|█████████▉| 3633/3665 [40:59<00:24, 1.31it/s] 99%|█████████▉| 3634/3665 [41:00<00:22, 1.36it/s] 99%|█████████▉| 3635/3665 [41:01<00:21, 1.42it/s] 99%|█████████▉| 3636/3665 [41:01<00:20, 1.39it/s] 99%|█████████▉| 3637/3665 [41:02<00:20, 1.38it/s] 99%|█████████▉| 3638/3665 [41:03<00:21, 1.28it/s] 99%|█████████▉| 3639/3665 [41:04<00:19, 1.34it/s] 99%|█████████▉| 3640/3665 [41:04<00:18, 1.35it/s] 99%|█████████▉| 3640/3665 [41:04<00:18, 1.35it/s] 99%|█████████▉| 3641/3665 [41:05<00:17, 1.41it/s] 99%|█████████▉| 3642/3665 [41:06<00:18, 1.27it/s] 99%|█████████▉| 3643/3665 [41:07<00:16, 1.33it/s] 99%|█████████▉| 3644/3665 [41:07<00:14, 1.41it/s] 99%|█████████▉| 3645/3665 [41:08<00:13, 1.47it/s] 99%|█████████▉| 3646/3665 [41:08<00:12, 1.50it/s] 100%|█████████▉| 3647/3665 [41:09<00:11, 1.56it/s] 100%|█████████▉| 3648/3665 [41:10<00:11, 1.52it/s] 100%|█████████▉| 3649/3665 [41:10<00:11, 1.45it/s] 100%|█████████▉| 3650/3665 [41:11<00:10, 1.48it/s] 100%|█████████▉| 3650/3665 [41:11<00:10, 1.48it/s] 100%|█████████▉| 3651/3665 [41:12<00:09, 1.52it/s] 100%|█████████▉| 3652/3665 [41:12<00:08, 1.55it/s] 100%|█████████▉| 3653/3665 [41:13<00:07, 1.52it/s] 100%|█████████▉| 3654/3665 [41:14<00:07, 1.50it/s] 100%|█████████▉| 3655/3665 [41:14<00:06, 1.50it/s] 100%|█████████▉| 3656/3665 [41:15<00:06, 1.50it/s] 100%|█████████▉| 3657/3665 [41:16<00:05, 1.53it/s] 100%|█████████▉| 3658/3665 [41:16<00:04, 1.47it/s] 100%|█████████▉| 3659/3665 [41:17<00:03, 1.52it/s] 100%|█████████▉| 3660/3665 [41:18<00:03, 1.55it/s] 100%|█████████▉| 3660/3665 [41:18<00:03, 1.55it/s] 100%|█████████▉| 3661/3665 [41:18<00:02, 1.56it/s] 100%|█████████▉| 3662/3665 [41:19<00:01, 1.60it/s] 100%|█████████▉| 3663/3665 [41:20<00:01, 1.57it/s] 100%|█████████▉| 3664/3665 [41:20<00:00, 1.59it/s] 100%|██████████| 3665/3665 [41:21<00:00, 1.60it/s][INFO|trainer.py:3478] 2025-01-05 11:50:03,895 >> Saving model checkpoint to /work/train_output/checkpoint-3665 [INFO|configuration_utils.py:731] 2025-01-05 11:50:03,936 >> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/config.json [INFO|configuration_utils.py:800] 2025-01-05 11:50:03,937 >> Model config LlamaConfig { "architectures": [ "LlamaForCausalLM" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "hidden_act": "silu", "hidden_size": 4096, "initializer_range": 0.02, "intermediate_size": 14336, "max_position_embeddings": 8192, "mlp_bias": false, "model_type": "llama", "num_attention_heads": 32, "num_hidden_layers": 32, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": null, "rope_theta": 500000.0, "tie_word_embeddings": false, "torch_dtype": "bfloat16", "transformers_version": "4.42.4", "use_cache": true, "vocab_size": 128256 } [INFO|tokenization_utils_base.py:2574] 2025-01-05 11:50:04,453 >> tokenizer config file saved in /work/train_output/checkpoint-3665/tokenizer_config.json [INFO|tokenization_utils_base.py:2583] 2025-01-05 11:50:04,455 >> Special tokens file saved in /work/train_output/checkpoint-3665/special_tokens_map.json [INFO|trainer.py:3570] 2025-01-05 11:50:04,619 >> Deleting older checkpoint [/work/train_output/checkpoint-2932] due to args.save_total_limit [INFO|trainer.py:3478] 2025-01-05 11:50:04,656 >> Saving model checkpoint to /work/train_output/checkpoint-3665 [INFO|configuration_utils.py:731] 2025-01-05 11:50:04,684 >> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/config.json [INFO|configuration_utils.py:800] 2025-01-05 11:50:04,684 >> Model config LlamaConfig { "architectures": [ "LlamaForCausalLM" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "hidden_act": "silu", "hidden_size": 4096, "initializer_range": 0.02, "intermediate_size": 14336, "max_position_embeddings": 8192, "mlp_bias": false, "model_type": "llama", "num_attention_heads": 32, "num_hidden_layers": 32, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": null, "rope_theta": 500000.0, "tie_word_embeddings": false, "torch_dtype": "bfloat16", "transformers_version": "4.42.4", "use_cache": true, "vocab_size": 128256 } [INFO|tokenization_utils_base.py:2574] 2025-01-05 11:50:05,163 >> tokenizer config file saved in /work/train_output/checkpoint-3665/tokenizer_config.json [INFO|tokenization_utils_base.py:2583] 2025-01-05 11:50:05,165 >> Special tokens file saved in /work/train_output/checkpoint-3665/special_tokens_map.json [INFO|trainer.py:2383] 2025-01-05 11:50:05,336 >> Training completed. Do not forget to share your model on huggingface.co/models =) 100%|██████████| 3665/3665 [41:22<00:00, 1.60it/s] 100%|██████████| 3665/3665 [41:22<00:00, 1.48it/s] [INFO|trainer.py:3478] 2025-01-05 11:50:05,357 >> Saving model checkpoint to /work/train_output/ [INFO|configuration_utils.py:731] 2025-01-05 11:50:05,388 >> loading configuration file /home/.atp/models/llama3_cn_8b_instruct/config.json [INFO|configuration_utils.py:800] 2025-01-05 11:50:05,389 >> Model config LlamaConfig { "architectures": [ "LlamaForCausalLM" ], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "hidden_act": "silu", "hidden_size": 4096, "initializer_range": 0.02, "intermediate_size": 14336, "max_position_embeddings": 8192, "mlp_bias": false, "model_type": "llama", "num_attention_heads": 32, "num_hidden_layers": 32, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": null, "rope_theta": 500000.0, "tie_word_embeddings": false, "torch_dtype": "bfloat16", "transformers_version": "4.42.4", "use_cache": true, "vocab_size": 128256 } [INFO|tokenization_utils_base.py:2574] 2025-01-05 11:50:05,829 >> tokenizer config file saved in /work/train_output/tokenizer_config.json [INFO|tokenization_utils_base.py:2583] 2025-01-05 11:50:05,831 >> Special tokens file saved in /work/train_output/special_tokens_map.json [INFO|trainer.py:3788] 2025-01-05 11:50:06,181 >> ***** Running Prediction ***** [INFO|trainer.py:3790] 2025-01-05 11:50:06,181 >> Num examples = 586 [INFO|trainer.py:3793] 2025-01-05 11:50:06,181 >> Batch size = 4 0%| | 0/147 [00:00> Dropping the following result as it does not have all the necessary fields: {'task': {'name': 'Causal Language Modeling', 'type': 'text-generation'}} huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks... To disable this warning, you can either: - Avoid using `tokenizers` before the fork if possible - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false) huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks... To disable this warning, you can either: - Avoid using `tokenizers` before the fork if possible - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false) huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks... To disable this warning, you can either: - Avoid using `tokenizers` before the fork if possible - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false) huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks... To disable this warning, you can either: - Avoid using `tokenizers` before the fork if possible - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)