--- license: apache-2.0 base_model: distilbert-base-uncased tags: - generated_from_trainer datasets: - sembr2023 metrics: - precision - recall - f1 - accuracy model-index: - name: sembr2023-distilbert-base-uncased results: - task: name: Token Classification type: token-classification dataset: name: sembr2023 type: sembr2023 config: sembr2023 split: test args: sembr2023 metrics: - name: Precision type: precision value: 0.7620265497503349 - name: Recall type: recall value: 0.8264430062078986 - name: F1 type: f1 value: 0.7929286528957039 - name: Accuracy type: accuracy value: 0.9618085989084832 --- # sembr2023-distilbert-base-uncased This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the sembr2023 dataset. It achieves the following results on the evaluation set: - Loss: 0.4067 - Precision: 0.7620 - Recall: 0.8264 - F1: 0.7929 - Iou: 0.6569 - Accuracy: 0.9618 - Balanced Accuracy: 0.9007 - Overall Accuracy: 0.9491 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0001 - train_batch_size: 64 - eval_batch_size: 128 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: cosine - training_steps: 5000 ### Training results | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Iou | Accuracy | Balanced Accuracy | Overall Accuracy | |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:------:|:--------:|:-----------------:|:----------------:| | 0.4044 | 0.07 | 10 | 0.3985 | 0 | 0.0 | 0.0 | 0.0 | 0.9115 | 0.5 | 0.9115 | | 0.3812 | 0.14 | 20 | 0.3805 | 0 | 0.0 | 0.0 | 0.0 | 0.9115 | 0.5 | 0.9115 | | 0.3625 | 0.21 | 30 | 0.3230 | 0.9048 | 0.0025 | 0.0050 | 0.0025 | 0.9117 | 0.5012 | 0.9117 | | 0.26 | 0.28 | 40 | 0.2489 | 0.8689 | 0.2993 | 0.4452 | 0.2864 | 0.9340 | 0.6475 | 0.9306 | | 0.2189 | 0.35 | 50 | 0.2131 | 0.7638 | 0.6234 | 0.6865 | 0.5226 | 0.9496 | 0.8024 | 0.9369 | | 0.1858 | 0.42 | 60 | 0.1959 | 0.7855 | 0.6977 | 0.7390 | 0.5860 | 0.9564 | 0.8396 | 0.9411 | | 0.1814 | 0.49 | 70 | 0.2147 | 0.6614 | 0.8093 | 0.7279 | 0.5722 | 0.9465 | 0.8845 | 0.9256 | | 0.1546 | 0.56 | 80 | 0.1806 | 0.7952 | 0.7364 | 0.7646 | 0.6190 | 0.9599 | 0.8590 | 0.9422 | | 0.1348 | 0.62 | 90 | 0.1702 | 0.7701 | 0.7685 | 0.7693 | 0.6251 | 0.9592 | 0.8731 | 0.9418 | | 0.1233 | 0.69 | 100 | 0.1692 | 0.8123 | 0.7440 | 0.7766 | 0.6348 | 0.9621 | 0.8637 | 0.9468 | | 0.1175 | 0.76 | 110 | 0.1745 | 0.8160 | 0.7430 | 0.7778 | 0.6364 | 0.9624 | 0.8634 | 0.9449 | | 0.1251 | 0.83 | 120 | 0.1897 | 0.7078 | 0.8260 | 0.7624 | 0.6160 | 0.9544 | 0.8965 | 0.9368 | | 0.0936 | 0.9 | 130 | 0.1635 | 0.7832 | 0.7912 | 0.7872 | 0.6490 | 0.9621 | 0.8850 | 0.9443 | | 0.0816 | 0.97 | 140 | 0.1713 | 0.7883 | 0.7852 | 0.7867 | 0.6485 | 0.9623 | 0.8824 | 0.9451 | | 0.0804 | 1.04 | 150 | 0.1615 | 0.7769 | 0.8132 | 0.7947 | 0.6593 | 0.9628 | 0.8953 | 0.9475 | | 0.0719 | 1.11 | 160 | 0.1560 | 0.7848 | 0.8058 | 0.7952 | 0.6600 | 0.9633 | 0.8922 | 0.9482 | | 0.0662 | 1.18 | 170 | 0.1867 | 0.7452 | 0.8212 | 0.7813 | 0.6411 | 0.9593 | 0.8970 | 0.9431 | | 0.0736 | 1.25 | 180 | 0.1560 | 0.8034 | 0.7920 | 0.7977 | 0.6634 | 0.9644 | 0.8866 | 0.9519 | | 0.079 | 1.32 | 190 | 0.1875 | 0.7420 | 0.8287 | 0.7829 | 0.6433 | 0.9593 | 0.9004 | 0.9439 | | 0.0756 | 1.39 | 200 | 0.1659 | 0.7833 | 0.8039 | 0.7934 | 0.6576 | 0.9630 | 0.8911 | 0.9476 | | 0.0657 | 1.46 | 210 | 0.1715 | 0.7907 | 0.8015 | 0.7961 | 0.6612 | 0.9637 | 0.8904 | 0.9478 | | 0.0576 | 1.53 | 220 | 0.1929 | 0.7594 | 0.8177 | 0.7875 | 0.6495 | 0.9610 | 0.8963 | 0.9433 | | 0.0582 | 1.6 | 230 | 0.1563 | 0.8275 | 0.7591 | 0.7918 | 0.6554 | 0.9647 | 0.8719 | 0.9526 | | 0.0572 | 1.67 | 240 | 0.1882 | 0.7681 | 0.8148 | 0.7907 | 0.6539 | 0.9618 | 0.8955 | 0.9457 | | 0.0651 | 1.74 | 250 | 0.1674 | 0.7762 | 0.8081 | 0.7918 | 0.6554 | 0.9624 | 0.8927 | 0.9495 | | 0.0537 | 1.81 | 260 | 0.1659 | 0.7770 | 0.8083 | 0.7924 | 0.6562 | 0.9625 | 0.8929 | 0.9480 | | 0.0541 | 1.88 | 270 | 0.1689 | 0.7543 | 0.8222 | 0.7868 | 0.6485 | 0.9606 | 0.8981 | 0.9471 | | 0.0582 | 1.94 | 280 | 0.1609 | 0.7774 | 0.8167 | 0.7966 | 0.6619 | 0.9631 | 0.8970 | 0.9528 | | 0.0471 | 2.01 | 290 | 0.1887 | 0.7562 | 0.8279 | 0.7904 | 0.6535 | 0.9612 | 0.9010 | 0.9460 | | 0.0372 | 2.08 | 300 | 0.1692 | 0.7662 | 0.8188 | 0.7916 | 0.6551 | 0.9619 | 0.8973 | 0.9493 | | 0.0416 | 2.15 | 310 | 0.2022 | 0.7540 | 0.8221 | 0.7866 | 0.6482 | 0.9605 | 0.8980 | 0.9463 | | 0.0411 | 2.22 | 320 | 0.2024 | 0.7574 | 0.8243 | 0.7895 | 0.6521 | 0.9611 | 0.8994 | 0.9468 | | 0.0424 | 2.29 | 330 | 0.1850 | 0.7730 | 0.8152 | 0.7936 | 0.6578 | 0.9625 | 0.8960 | 0.9498 | | 0.0438 | 2.36 | 340 | 0.1888 | 0.7715 | 0.8140 | 0.7922 | 0.6559 | 0.9622 | 0.8953 | 0.9490 | | 0.0342 | 2.43 | 350 | 0.1905 | 0.7734 | 0.8167 | 0.7944 | 0.6590 | 0.9626 | 0.8967 | 0.9478 | | 0.0302 | 2.5 | 360 | 0.1734 | 0.8042 | 0.7954 | 0.7998 | 0.6664 | 0.9648 | 0.8883 | 0.9528 | | 0.0325 | 2.57 | 370 | 0.1770 | 0.7926 | 0.7969 | 0.7947 | 0.6593 | 0.9636 | 0.8883 | 0.9521 | | 0.0349 | 2.64 | 380 | 0.1968 | 0.7564 | 0.8251 | 0.7893 | 0.6519 | 0.9610 | 0.8997 | 0.9475 | | 0.0416 | 2.71 | 390 | 0.1859 | 0.7648 | 0.8167 | 0.7899 | 0.6528 | 0.9616 | 0.8961 | 0.9467 | | 0.0329 | 2.78 | 400 | 0.1908 | 0.7643 | 0.8231 | 0.7926 | 0.6565 | 0.9619 | 0.8992 | 0.9495 | | 0.0295 | 2.85 | 410 | 0.1853 | 0.8073 | 0.7856 | 0.7963 | 0.6616 | 0.9644 | 0.8837 | 0.9519 | | 0.0323 | 2.92 | 420 | 0.2054 | 0.7354 | 0.8389 | 0.7837 | 0.6444 | 0.9590 | 0.9048 | 0.9453 | | 0.0243 | 2.99 | 430 | 0.1907 | 0.7679 | 0.8179 | 0.7921 | 0.6557 | 0.9620 | 0.8969 | 0.9495 | | 0.0335 | 3.06 | 440 | 0.2236 | 0.7619 | 0.8237 | 0.7916 | 0.6550 | 0.9616 | 0.8993 | 0.9473 | | 0.0253 | 3.12 | 450 | 0.1981 | 0.7736 | 0.8011 | 0.7871 | 0.6489 | 0.9617 | 0.8892 | 0.9506 | | 0.0303 | 3.19 | 460 | 0.2123 | 0.7755 | 0.8167 | 0.7955 | 0.6605 | 0.9629 | 0.8969 | 0.9501 | | 0.0239 | 3.26 | 470 | 0.2166 | 0.7530 | 0.8196 | 0.7849 | 0.6460 | 0.9603 | 0.8967 | 0.9470 | | 0.0229 | 3.33 | 480 | 0.2032 | 0.7565 | 0.8204 | 0.7871 | 0.6490 | 0.9607 | 0.8974 | 0.9498 | | 0.0178 | 3.4 | 490 | 0.2072 | 0.7636 | 0.8193 | 0.7905 | 0.6536 | 0.9616 | 0.8973 | 0.9492 | | 0.0188 | 3.47 | 500 | 0.2136 | 0.7554 | 0.8241 | 0.7883 | 0.6505 | 0.9608 | 0.8991 | 0.9476 | | 0.0211 | 3.54 | 510 | 0.2295 | 0.7346 | 0.8383 | 0.7830 | 0.6435 | 0.9589 | 0.9045 | 0.9455 | | 0.0169 | 3.61 | 520 | 0.2142 | 0.7645 | 0.8226 | 0.7925 | 0.6563 | 0.9619 | 0.8990 | 0.9487 | | 0.0189 | 3.68 | 530 | 0.2160 | 0.7708 | 0.8113 | 0.7905 | 0.6536 | 0.9620 | 0.8939 | 0.9497 | | 0.0191 | 3.75 | 540 | 0.2227 | 0.7790 | 0.8087 | 0.7936 | 0.6578 | 0.9628 | 0.8932 | 0.9498 | | 0.02 | 3.82 | 550 | 0.2276 | 0.7388 | 0.8367 | 0.7847 | 0.6457 | 0.9594 | 0.9040 | 0.9456 | | 0.0213 | 3.89 | 560 | 0.2201 | 0.7586 | 0.8138 | 0.7852 | 0.6463 | 0.9606 | 0.8943 | 0.9476 | | 0.0155 | 3.96 | 570 | 0.2211 | 0.7269 | 0.8407 | 0.7797 | 0.6389 | 0.9580 | 0.9050 | 0.9470 | | 0.0146 | 4.03 | 580 | 0.2247 | 0.7587 | 0.8160 | 0.7863 | 0.6479 | 0.9608 | 0.8954 | 0.9477 | | 0.0147 | 4.1 | 590 | 0.2316 | 0.7644 | 0.8132 | 0.7880 | 0.6502 | 0.9613 | 0.8945 | 0.9483 | | 0.0156 | 4.17 | 600 | 0.2323 | 0.7639 | 0.8214 | 0.7916 | 0.6551 | 0.9617 | 0.8984 | 0.9506 | | 0.0132 | 4.24 | 610 | 0.2471 | 0.7413 | 0.8350 | 0.7854 | 0.6466 | 0.9596 | 0.9034 | 0.9469 | | 0.0167 | 4.31 | 620 | 0.2340 | 0.7784 | 0.7992 | 0.7887 | 0.6511 | 0.9621 | 0.8886 | 0.9486 | | 0.0155 | 4.38 | 630 | 0.2316 | 0.7337 | 0.8344 | 0.7808 | 0.6404 | 0.9585 | 0.9025 | 0.9477 | | 0.0178 | 4.44 | 640 | 0.2227 | 0.7834 | 0.8025 | 0.7928 | 0.6568 | 0.9629 | 0.8905 | 0.9501 | | 0.0161 | 4.51 | 650 | 0.2466 | 0.7292 | 0.8393 | 0.7804 | 0.6398 | 0.9582 | 0.9045 | 0.9456 | | 0.0139 | 4.58 | 660 | 0.2617 | 0.7376 | 0.8217 | 0.7774 | 0.6358 | 0.9584 | 0.8967 | 0.9441 | | 0.0141 | 4.65 | 670 | 0.2386 | 0.7556 | 0.8196 | 0.7863 | 0.6478 | 0.9606 | 0.8969 | 0.9476 | | 0.0136 | 4.72 | 680 | 0.2414 | 0.7530 | 0.8223 | 0.7862 | 0.6477 | 0.9604 | 0.8981 | 0.9472 | | 0.0121 | 4.79 | 690 | 0.2413 | 0.7499 | 0.8267 | 0.7865 | 0.6481 | 0.9603 | 0.9000 | 0.9470 | | 0.011 | 4.86 | 700 | 0.2447 | 0.7672 | 0.8095 | 0.7878 | 0.6499 | 0.9614 | 0.8928 | 0.9482 | | 0.0167 | 4.93 | 710 | 0.2438 | 0.7629 | 0.8087 | 0.7852 | 0.6463 | 0.9608 | 0.8922 | 0.9485 | | 0.0132 | 5.0 | 720 | 0.2583 | 0.7353 | 0.8340 | 0.7815 | 0.6414 | 0.9587 | 0.9024 | 0.9472 | | 0.0111 | 5.07 | 730 | 0.2514 | 0.7654 | 0.8131 | 0.7885 | 0.6509 | 0.9614 | 0.8945 | 0.9507 | | 0.0091 | 5.14 | 740 | 0.2417 | 0.7553 | 0.8196 | 0.7861 | 0.6476 | 0.9605 | 0.8969 | 0.9500 | | 0.0093 | 5.21 | 750 | 0.2570 | 0.7454 | 0.8231 | 0.7823 | 0.6425 | 0.9595 | 0.8979 | 0.9466 | | 0.0108 | 5.28 | 760 | 0.2699 | 0.7632 | 0.8094 | 0.7856 | 0.6470 | 0.9609 | 0.8925 | 0.9478 | | 0.0113 | 5.35 | 770 | 0.2447 | 0.7684 | 0.8013 | 0.7845 | 0.6454 | 0.9610 | 0.8889 | 0.9486 | | 0.0095 | 5.42 | 780 | 0.2600 | 0.7651 | 0.8148 | 0.7892 | 0.6518 | 0.9615 | 0.8953 | 0.9492 | | 0.0102 | 5.49 | 790 | 0.2526 | 0.7461 | 0.8301 | 0.7859 | 0.6473 | 0.9600 | 0.9014 | 0.9492 | | 0.0074 | 5.56 | 800 | 0.2671 | 0.7471 | 0.8251 | 0.7842 | 0.6450 | 0.9598 | 0.8990 | 0.9483 | | 0.013 | 5.62 | 810 | 0.2597 | 0.7337 | 0.8357 | 0.7814 | 0.6412 | 0.9586 | 0.9031 | 0.9488 | | 0.009 | 5.69 | 820 | 0.2585 | 0.7793 | 0.8002 | 0.7896 | 0.6523 | 0.9623 | 0.8891 | 0.9503 | | 0.0083 | 5.76 | 830 | 0.2455 | 0.7634 | 0.8204 | 0.7909 | 0.6541 | 0.9616 | 0.8978 | 0.9506 | | 0.0131 | 5.83 | 840 | 0.2434 | 0.7678 | 0.8123 | 0.7894 | 0.6521 | 0.9617 | 0.8942 | 0.9498 | | 0.0096 | 5.9 | 850 | 0.2683 | 0.7468 | 0.8274 | 0.7850 | 0.6461 | 0.9599 | 0.9001 | 0.9474 | | 0.0089 | 5.97 | 860 | 0.2687 | 0.7326 | 0.8391 | 0.7822 | 0.6424 | 0.9587 | 0.9047 | 0.9462 | | 0.0065 | 6.04 | 870 | 0.3050 | 0.7296 | 0.8404 | 0.7811 | 0.6409 | 0.9583 | 0.9051 | 0.9456 | | 0.0064 | 6.11 | 880 | 0.2895 | 0.7431 | 0.8299 | 0.7841 | 0.6449 | 0.9596 | 0.9010 | 0.9474 | | 0.0057 | 6.18 | 890 | 0.2819 | 0.7631 | 0.8049 | 0.7834 | 0.6440 | 0.9606 | 0.8903 | 0.9480 | | 0.008 | 6.25 | 900 | 0.2882 | 0.7539 | 0.8234 | 0.7871 | 0.6490 | 0.9606 | 0.8987 | 0.9489 | | 0.01 | 6.32 | 910 | 0.2661 | 0.7397 | 0.8263 | 0.7806 | 0.6401 | 0.9589 | 0.8990 | 0.9481 | | 0.009 | 6.39 | 920 | 0.2615 | 0.7526 | 0.8202 | 0.7850 | 0.6461 | 0.9602 | 0.8970 | 0.9493 | | 0.0075 | 6.46 | 930 | 0.2813 | 0.7466 | 0.8185 | 0.7809 | 0.6406 | 0.9594 | 0.8958 | 0.9460 | | 0.0087 | 6.53 | 940 | 0.2920 | 0.7187 | 0.8435 | 0.7761 | 0.6341 | 0.9569 | 0.9057 | 0.9434 | | 0.01 | 6.6 | 950 | 0.3029 | 0.7336 | 0.8362 | 0.7816 | 0.6414 | 0.9586 | 0.9034 | 0.9465 | | 0.0097 | 6.67 | 960 | 0.2884 | 0.7340 | 0.8379 | 0.7825 | 0.6428 | 0.9588 | 0.9042 | 0.9439 | | 0.0085 | 6.74 | 970 | 0.2585 | 0.7882 | 0.7961 | 0.7921 | 0.6558 | 0.9630 | 0.8876 | 0.9513 | | 0.0108 | 6.81 | 980 | 0.2473 | 0.7426 | 0.8311 | 0.7843 | 0.6452 | 0.9596 | 0.9016 | 0.9481 | | 0.0069 | 6.88 | 990 | 0.3008 | 0.7397 | 0.8395 | 0.7864 | 0.6480 | 0.9597 | 0.9054 | 0.9452 | | 0.0065 | 6.94 | 1000 | 0.2674 | 0.7489 | 0.8253 | 0.7852 | 0.6464 | 0.9601 | 0.8992 | 0.9476 | | 0.0073 | 7.01 | 1010 | 0.2632 | 0.7700 | 0.8097 | 0.7893 | 0.6520 | 0.9618 | 0.8931 | 0.9494 | | 0.0065 | 7.08 | 1020 | 0.2967 | 0.7702 | 0.8119 | 0.7905 | 0.6536 | 0.9619 | 0.8942 | 0.9496 | | 0.006 | 7.15 | 1030 | 0.2652 | 0.7758 | 0.8029 | 0.7891 | 0.6517 | 0.9620 | 0.8902 | 0.9510 | | 0.0057 | 7.22 | 1040 | 0.2660 | 0.7752 | 0.8090 | 0.7918 | 0.6553 | 0.9623 | 0.8931 | 0.9505 | | 0.0083 | 7.29 | 1050 | 0.2830 | 0.7505 | 0.8222 | 0.7847 | 0.6457 | 0.9601 | 0.8978 | 0.9477 | | 0.0037 | 7.36 | 1060 | 0.2928 | 0.7778 | 0.8046 | 0.7910 | 0.6543 | 0.9624 | 0.8912 | 0.9509 | | 0.0067 | 7.43 | 1070 | 0.2678 | 0.7534 | 0.8198 | 0.7852 | 0.6464 | 0.9603 | 0.8969 | 0.9487 | | 0.0081 | 7.5 | 1080 | 0.2849 | 0.7718 | 0.8147 | 0.7926 | 0.6565 | 0.9623 | 0.8957 | 0.9499 | | 0.0049 | 7.57 | 1090 | 0.2787 | 0.7351 | 0.8272 | 0.7784 | 0.6373 | 0.9583 | 0.8991 | 0.9457 | | 0.0061 | 7.64 | 1100 | 0.3090 | 0.7580 | 0.8164 | 0.7861 | 0.6476 | 0.9607 | 0.8956 | 0.9476 | | 0.0061 | 7.71 | 1110 | 0.2962 | 0.7565 | 0.8180 | 0.7861 | 0.6475 | 0.9606 | 0.8962 | 0.9477 | | 0.0058 | 7.78 | 1120 | 0.3089 | 0.7612 | 0.8209 | 0.7899 | 0.6528 | 0.9614 | 0.8979 | 0.9481 | | 0.0056 | 7.85 | 1130 | 0.2688 | 0.7565 | 0.8109 | 0.7827 | 0.6430 | 0.9602 | 0.8928 | 0.9477 | | 0.0076 | 7.92 | 1140 | 0.2946 | 0.7531 | 0.8164 | 0.7835 | 0.6441 | 0.9601 | 0.8952 | 0.9474 | | 0.0056 | 7.99 | 1150 | 0.2830 | 0.7620 | 0.8093 | 0.7849 | 0.6460 | 0.9608 | 0.8924 | 0.9490 | | 0.0043 | 8.06 | 1160 | 0.2700 | 0.7501 | 0.8278 | 0.7870 | 0.6488 | 0.9604 | 0.9005 | 0.9495 | | 0.0064 | 8.12 | 1170 | 0.2852 | 0.7476 | 0.8330 | 0.7880 | 0.6502 | 0.9603 | 0.9029 | 0.9481 | | 0.0043 | 8.19 | 1180 | 0.3124 | 0.7422 | 0.8337 | 0.7853 | 0.6465 | 0.9597 | 0.9028 | 0.9479 | | 0.0059 | 8.26 | 1190 | 0.3273 | 0.7572 | 0.8242 | 0.7893 | 0.6519 | 0.9611 | 0.8993 | 0.9466 | | 0.0055 | 8.33 | 1200 | 0.3113 | 0.7606 | 0.8193 | 0.7889 | 0.6514 | 0.9612 | 0.8971 | 0.9468 | | 0.0076 | 8.4 | 1210 | 0.3085 | 0.7655 | 0.8139 | 0.7889 | 0.6514 | 0.9615 | 0.8948 | 0.9486 | | 0.0064 | 8.47 | 1220 | 0.3107 | 0.7436 | 0.8143 | 0.7773 | 0.6358 | 0.9587 | 0.8935 | 0.9454 | | 0.0067 | 8.54 | 1230 | 0.2876 | 0.7760 | 0.7996 | 0.7876 | 0.6496 | 0.9618 | 0.8886 | 0.9497 | | 0.0056 | 8.61 | 1240 | 0.2885 | 0.7477 | 0.8185 | 0.7815 | 0.6414 | 0.9595 | 0.8959 | 0.9475 | | 0.0055 | 8.68 | 1250 | 0.2806 | 0.7596 | 0.8124 | 0.7851 | 0.6462 | 0.9607 | 0.8937 | 0.9486 | | 0.0042 | 8.75 | 1260 | 0.3050 | 0.7629 | 0.8094 | 0.7854 | 0.6467 | 0.9609 | 0.8925 | 0.9489 | | 0.0036 | 8.82 | 1270 | 0.3332 | 0.7343 | 0.8268 | 0.7778 | 0.6364 | 0.9582 | 0.8989 | 0.9449 | | 0.0052 | 8.89 | 1280 | 0.3299 | 0.7200 | 0.8340 | 0.7728 | 0.6298 | 0.9566 | 0.9012 | 0.9444 | | 0.0059 | 8.96 | 1290 | 0.3039 | 0.7459 | 0.8220 | 0.7821 | 0.6421 | 0.9595 | 0.8974 | 0.9467 | | 0.006 | 9.03 | 1300 | 0.2971 | 0.7554 | 0.8249 | 0.7886 | 0.6510 | 0.9609 | 0.8995 | 0.9496 | | 0.0044 | 9.1 | 1310 | 0.2904 | 0.7627 | 0.8111 | 0.7861 | 0.6476 | 0.9610 | 0.8933 | 0.9489 | | 0.0025 | 9.17 | 1320 | 0.3074 | 0.7595 | 0.8218 | 0.7894 | 0.6521 | 0.9612 | 0.8983 | 0.9490 | | 0.0036 | 9.24 | 1330 | 0.3025 | 0.7517 | 0.8251 | 0.7867 | 0.6484 | 0.9604 | 0.8993 | 0.9473 | | 0.0045 | 9.31 | 1340 | 0.3297 | 0.7543 | 0.8208 | 0.7861 | 0.6476 | 0.9605 | 0.8974 | 0.9463 | | 0.0045 | 9.38 | 1350 | 0.3389 | 0.7446 | 0.8246 | 0.7826 | 0.6428 | 0.9595 | 0.8986 | 0.9455 | | 0.0044 | 9.44 | 1360 | 0.3234 | 0.7570 | 0.8183 | 0.7864 | 0.6480 | 0.9607 | 0.8964 | 0.9468 | | 0.004 | 9.51 | 1370 | 0.2960 | 0.7552 | 0.8124 | 0.7828 | 0.6431 | 0.9601 | 0.8934 | 0.9484 | | 0.0034 | 9.58 | 1380 | 0.3135 | 0.7355 | 0.8300 | 0.7799 | 0.6392 | 0.9585 | 0.9005 | 0.9454 | | 0.0037 | 9.65 | 1390 | 0.3199 | 0.7599 | 0.8167 | 0.7872 | 0.6491 | 0.9609 | 0.8958 | 0.9483 | | 0.0031 | 9.72 | 1400 | 0.2958 | 0.7707 | 0.8045 | 0.7873 | 0.6492 | 0.9615 | 0.8906 | 0.9497 | | 0.0056 | 9.79 | 1410 | 0.2923 | 0.7875 | 0.8033 | 0.7953 | 0.6602 | 0.9634 | 0.8911 | 0.9524 | | 0.0041 | 9.86 | 1420 | 0.3007 | 0.7853 | 0.8033 | 0.7942 | 0.6587 | 0.9632 | 0.8910 | 0.9493 | | 0.0045 | 9.93 | 1430 | 0.2946 | 0.7739 | 0.8122 | 0.7926 | 0.6565 | 0.9624 | 0.8946 | 0.9497 | | 0.0038 | 10.0 | 1440 | 0.2966 | 0.7665 | 0.8239 | 0.7942 | 0.6586 | 0.9622 | 0.8998 | 0.9506 | | 0.0034 | 10.07 | 1450 | 0.3444 | 0.7657 | 0.8296 | 0.7964 | 0.6616 | 0.9625 | 0.9025 | 0.9491 | | 0.0039 | 10.14 | 1460 | 0.3293 | 0.7460 | 0.8367 | 0.7888 | 0.6512 | 0.9603 | 0.9045 | 0.9476 | | 0.0037 | 10.21 | 1470 | 0.3170 | 0.7692 | 0.8241 | 0.7957 | 0.6607 | 0.9626 | 0.9000 | 0.9488 | | 0.0026 | 10.28 | 1480 | 0.2905 | 0.7707 | 0.8225 | 0.7957 | 0.6608 | 0.9626 | 0.8994 | 0.9501 | | 0.0022 | 10.35 | 1490 | 0.3046 | 0.7745 | 0.8135 | 0.7935 | 0.6577 | 0.9625 | 0.8953 | 0.9497 | | 0.002 | 10.42 | 1500 | 0.3164 | 0.7673 | 0.8226 | 0.7940 | 0.6584 | 0.9622 | 0.8992 | 0.9495 | | 0.0027 | 10.49 | 1510 | 0.3068 | 0.7515 | 0.8365 | 0.7917 | 0.6553 | 0.9611 | 0.9048 | 0.9485 | | 0.0028 | 10.56 | 1520 | 0.3090 | 0.7674 | 0.8235 | 0.7945 | 0.6590 | 0.9623 | 0.8997 | 0.9497 | | 0.0035 | 10.62 | 1530 | 0.3240 | 0.7685 | 0.8123 | 0.7898 | 0.6526 | 0.9617 | 0.8943 | 0.9493 | | 0.0029 | 10.69 | 1540 | 0.3074 | 0.7807 | 0.8083 | 0.7943 | 0.6588 | 0.9630 | 0.8932 | 0.9499 | | 0.0031 | 10.76 | 1550 | 0.3121 | 0.7636 | 0.8239 | 0.7926 | 0.6565 | 0.9619 | 0.8996 | 0.9515 | | 0.0029 | 10.83 | 1560 | 0.3198 | 0.7565 | 0.8304 | 0.7917 | 0.6552 | 0.9613 | 0.9022 | 0.9489 | | 0.003 | 10.9 | 1570 | 0.3207 | 0.7681 | 0.8208 | 0.7936 | 0.6578 | 0.9622 | 0.8984 | 0.9498 | | 0.0022 | 10.97 | 1580 | 0.3139 | 0.7792 | 0.8103 | 0.7945 | 0.6590 | 0.9629 | 0.8940 | 0.9511 | | 0.0022 | 11.04 | 1590 | 0.3254 | 0.7658 | 0.8177 | 0.7909 | 0.6542 | 0.9618 | 0.8967 | 0.9489 | | 0.0026 | 11.11 | 1600 | 0.3404 | 0.7626 | 0.8246 | 0.7924 | 0.6561 | 0.9618 | 0.8998 | 0.9498 | | 0.0033 | 11.18 | 1610 | 0.3316 | 0.7423 | 0.8391 | 0.7878 | 0.6499 | 0.9600 | 0.9054 | 0.9469 | | 0.0019 | 11.25 | 1620 | 0.3167 | 0.7522 | 0.8270 | 0.7878 | 0.6499 | 0.9606 | 0.9003 | 0.9475 | | 0.0041 | 11.32 | 1630 | 0.3387 | 0.7567 | 0.8276 | 0.7906 | 0.6537 | 0.9612 | 0.9009 | 0.9483 | | 0.0028 | 11.39 | 1640 | 0.3365 | 0.7490 | 0.8332 | 0.7888 | 0.6513 | 0.9605 | 0.9030 | 0.9478 | | 0.0033 | 11.46 | 1650 | 0.3313 | 0.7512 | 0.8254 | 0.7865 | 0.6482 | 0.9604 | 0.8994 | 0.9481 | | 0.0041 | 11.53 | 1660 | 0.3290 | 0.7667 | 0.8214 | 0.7931 | 0.6572 | 0.9621 | 0.8986 | 0.9497 | | 0.0026 | 11.6 | 1670 | 0.3249 | 0.7623 | 0.8177 | 0.7890 | 0.6515 | 0.9613 | 0.8965 | 0.9490 | | 0.0029 | 11.67 | 1680 | 0.3270 | 0.7617 | 0.8276 | 0.7933 | 0.6574 | 0.9618 | 0.9013 | 0.9490 | | 0.003 | 11.74 | 1690 | 0.3220 | 0.7553 | 0.8316 | 0.7916 | 0.6551 | 0.9613 | 0.9027 | 0.9489 | | 0.0022 | 11.81 | 1700 | 0.3279 | 0.7474 | 0.8393 | 0.7906 | 0.6538 | 0.9607 | 0.9059 | 0.9481 | | 0.0038 | 11.88 | 1710 | 0.3338 | 0.7481 | 0.8315 | 0.7876 | 0.6496 | 0.9603 | 0.9021 | 0.9476 | | 0.0021 | 11.94 | 1720 | 0.3371 | 0.7608 | 0.8262 | 0.7921 | 0.6558 | 0.9616 | 0.9005 | 0.9488 | | 0.0034 | 12.01 | 1730 | 0.2970 | 0.7611 | 0.8231 | 0.7909 | 0.6541 | 0.9615 | 0.8990 | 0.9496 | | 0.0026 | 12.08 | 1740 | 0.3286 | 0.7646 | 0.8263 | 0.7943 | 0.6587 | 0.9621 | 0.9008 | 0.9486 | | 0.0028 | 12.15 | 1750 | 0.3328 | 0.7537 | 0.8381 | 0.7936 | 0.6579 | 0.9614 | 0.9057 | 0.9493 | | 0.0027 | 12.22 | 1760 | 0.3360 | 0.7660 | 0.8292 | 0.7963 | 0.6616 | 0.9625 | 0.9023 | 0.9486 | | 0.0011 | 12.29 | 1770 | 0.3393 | 0.7689 | 0.8194 | 0.7934 | 0.6575 | 0.9622 | 0.8978 | 0.9486 | | 0.0022 | 12.36 | 1780 | 0.3074 | 0.7634 | 0.8242 | 0.7926 | 0.6565 | 0.9618 | 0.8997 | 0.9497 | | 0.0034 | 12.43 | 1790 | 0.2978 | 0.7716 | 0.8168 | 0.7935 | 0.6577 | 0.9624 | 0.8967 | 0.9515 | | 0.0022 | 12.5 | 1800 | 0.3406 | 0.7615 | 0.8296 | 0.7941 | 0.6585 | 0.9619 | 0.9022 | 0.9474 | | 0.0027 | 12.57 | 1810 | 0.3015 | 0.7722 | 0.8185 | 0.7947 | 0.6593 | 0.9626 | 0.8975 | 0.9517 | | 0.0027 | 12.64 | 1820 | 0.3410 | 0.7726 | 0.8086 | 0.7902 | 0.6532 | 0.9620 | 0.8928 | 0.9495 | | 0.0029 | 12.71 | 1830 | 0.3502 | 0.7596 | 0.8209 | 0.7891 | 0.6516 | 0.9612 | 0.8978 | 0.9488 | | 0.002 | 12.78 | 1840 | 0.3431 | 0.7423 | 0.8275 | 0.7826 | 0.6428 | 0.9593 | 0.8998 | 0.9470 | | 0.0026 | 12.85 | 1850 | 0.3509 | 0.7199 | 0.8449 | 0.7774 | 0.6359 | 0.9572 | 0.9065 | 0.9442 | | 0.0037 | 12.92 | 1860 | 0.3322 | 0.7559 | 0.8181 | 0.7858 | 0.6472 | 0.9605 | 0.8962 | 0.9474 | | 0.0037 | 12.99 | 1870 | 0.3351 | 0.7566 | 0.8160 | 0.7852 | 0.6464 | 0.9605 | 0.8953 | 0.9473 | | 0.0022 | 13.06 | 1880 | 0.3241 | 0.7744 | 0.8086 | 0.7912 | 0.6545 | 0.9622 | 0.8929 | 0.9498 | | 0.0042 | 13.12 | 1890 | 0.3370 | 0.7561 | 0.8193 | 0.7864 | 0.6480 | 0.9606 | 0.8968 | 0.9478 | | 0.0023 | 13.19 | 1900 | 0.3372 | 0.7390 | 0.8250 | 0.7796 | 0.6388 | 0.9587 | 0.8984 | 0.9464 | | 0.0032 | 13.26 | 1910 | 0.3448 | 0.7727 | 0.8091 | 0.7905 | 0.6536 | 0.9621 | 0.8930 | 0.9478 | | 0.0021 | 13.33 | 1920 | 0.3529 | 0.7616 | 0.8176 | 0.7886 | 0.6510 | 0.9612 | 0.8964 | 0.9481 | | 0.0021 | 13.4 | 1930 | 0.3332 | 0.7527 | 0.8280 | 0.7886 | 0.6509 | 0.9607 | 0.9008 | 0.9496 | | 0.0025 | 13.47 | 1940 | 0.3456 | 0.7485 | 0.8274 | 0.7859 | 0.6474 | 0.9601 | 0.9002 | 0.9471 | | 0.0014 | 13.54 | 1950 | 0.3375 | 0.7540 | 0.8262 | 0.7884 | 0.6507 | 0.9608 | 0.9000 | 0.9488 | | 0.0029 | 13.61 | 1960 | 0.3187 | 0.7791 | 0.8106 | 0.7945 | 0.6591 | 0.9629 | 0.8941 | 0.9517 | | 0.0016 | 13.68 | 1970 | 0.3296 | 0.7663 | 0.8205 | 0.7925 | 0.6563 | 0.9620 | 0.8981 | 0.9498 | | 0.0016 | 13.75 | 1980 | 0.3524 | 0.7574 | 0.8251 | 0.7898 | 0.6526 | 0.9611 | 0.8997 | 0.9467 | | 0.0026 | 13.82 | 1990 | 0.3295 | 0.7560 | 0.8243 | 0.7887 | 0.6511 | 0.9609 | 0.8993 | 0.9494 | | 0.0021 | 13.89 | 2000 | 0.3474 | 0.7544 | 0.8234 | 0.7874 | 0.6493 | 0.9607 | 0.8987 | 0.9477 | | 0.002 | 13.96 | 2010 | 0.3723 | 0.7484 | 0.8229 | 0.7839 | 0.6446 | 0.9599 | 0.8980 | 0.9450 | | 0.0016 | 14.03 | 2020 | 0.3514 | 0.7628 | 0.8192 | 0.7900 | 0.6528 | 0.9615 | 0.8972 | 0.9481 | | 0.0013 | 14.1 | 2030 | 0.3403 | 0.7777 | 0.8115 | 0.7943 | 0.6587 | 0.9628 | 0.8945 | 0.9498 | | 0.0024 | 14.17 | 2040 | 0.3612 | 0.7582 | 0.8239 | 0.7897 | 0.6525 | 0.9612 | 0.8992 | 0.9472 | | 0.0027 | 14.24 | 2050 | 0.3539 | 0.7610 | 0.8296 | 0.7938 | 0.6581 | 0.9619 | 0.9022 | 0.9481 | | 0.0015 | 14.31 | 2060 | 0.3567 | 0.7473 | 0.8291 | 0.7860 | 0.6475 | 0.9601 | 0.9009 | 0.9464 | | 0.0021 | 14.38 | 2070 | 0.3313 | 0.7698 | 0.8136 | 0.7911 | 0.6544 | 0.9620 | 0.8950 | 0.9497 | | 0.0014 | 14.44 | 2080 | 0.3261 | 0.7591 | 0.8218 | 0.7892 | 0.6518 | 0.9612 | 0.8982 | 0.9490 | | 0.001 | 14.51 | 2090 | 0.3227 | 0.7571 | 0.8250 | 0.7896 | 0.6523 | 0.9611 | 0.8996 | 0.9483 | | 0.0013 | 14.58 | 2100 | 0.3590 | 0.7459 | 0.8324 | 0.7868 | 0.6485 | 0.9601 | 0.9024 | 0.9466 | | 0.0011 | 14.65 | 2110 | 0.3553 | 0.7536 | 0.8234 | 0.7870 | 0.6488 | 0.9606 | 0.8986 | 0.9475 | | 0.0018 | 14.72 | 2120 | 0.3418 | 0.7661 | 0.8222 | 0.7931 | 0.6572 | 0.9621 | 0.8989 | 0.9497 | | 0.0015 | 14.79 | 2130 | 0.3744 | 0.7604 | 0.8231 | 0.7905 | 0.6536 | 0.9614 | 0.8990 | 0.9480 | | 0.0013 | 14.86 | 2140 | 0.3617 | 0.7616 | 0.8213 | 0.7903 | 0.6534 | 0.9614 | 0.8982 | 0.9480 | | 0.0027 | 14.93 | 2150 | 0.3696 | 0.7576 | 0.8247 | 0.7897 | 0.6525 | 0.9611 | 0.8996 | 0.9476 | | 0.0015 | 15.0 | 2160 | 0.3678 | 0.7474 | 0.8239 | 0.7838 | 0.6445 | 0.9598 | 0.8985 | 0.9468 | | 0.002 | 15.07 | 2170 | 0.3781 | 0.7522 | 0.8263 | 0.7875 | 0.6495 | 0.9605 | 0.8999 | 0.9469 | | 0.0034 | 15.14 | 2180 | 0.3841 | 0.7388 | 0.8346 | 0.7838 | 0.6445 | 0.9593 | 0.9030 | 0.9464 | | 0.0016 | 15.21 | 2190 | 0.3352 | 0.7560 | 0.8241 | 0.7885 | 0.6509 | 0.9609 | 0.8991 | 0.9485 | | 0.0017 | 15.28 | 2200 | 0.3612 | 0.7524 | 0.8250 | 0.7870 | 0.6489 | 0.9605 | 0.8993 | 0.9470 | | 0.0023 | 15.35 | 2210 | 0.3486 | 0.7726 | 0.8119 | 0.7918 | 0.6553 | 0.9622 | 0.8944 | 0.9489 | | 0.0025 | 15.42 | 2220 | 0.3504 | 0.7478 | 0.8263 | 0.7851 | 0.6462 | 0.9600 | 0.8996 | 0.9474 | | 0.0021 | 15.49 | 2230 | 0.3382 | 0.7642 | 0.8153 | 0.7889 | 0.6514 | 0.9614 | 0.8955 | 0.9485 | | 0.0018 | 15.56 | 2240 | 0.3561 | 0.7576 | 0.8275 | 0.7910 | 0.6542 | 0.9613 | 0.9009 | 0.9485 | | 0.0013 | 15.62 | 2250 | 0.3649 | 0.7603 | 0.8214 | 0.7897 | 0.6524 | 0.9613 | 0.8981 | 0.9478 | | 0.0011 | 15.69 | 2260 | 0.3601 | 0.7446 | 0.8282 | 0.7841 | 0.6449 | 0.9597 | 0.9003 | 0.9463 | | 0.0016 | 15.76 | 2270 | 0.3623 | 0.7574 | 0.8175 | 0.7863 | 0.6479 | 0.9607 | 0.8960 | 0.9478 | | 0.0022 | 15.83 | 2280 | 0.3911 | 0.7487 | 0.8342 | 0.7892 | 0.6517 | 0.9606 | 0.9035 | 0.9463 | | 0.0012 | 15.9 | 2290 | 0.3762 | 0.7497 | 0.8311 | 0.7883 | 0.6505 | 0.9605 | 0.9021 | 0.9470 | | 0.0011 | 15.97 | 2300 | 0.3721 | 0.7401 | 0.8320 | 0.7834 | 0.6439 | 0.9593 | 0.9018 | 0.9460 | | 0.0011 | 16.04 | 2310 | 0.3569 | 0.7613 | 0.8200 | 0.7895 | 0.6522 | 0.9613 | 0.8975 | 0.9488 | | 0.0017 | 16.11 | 2320 | 0.3845 | 0.7393 | 0.8381 | 0.7856 | 0.6469 | 0.9595 | 0.9047 | 0.9460 | | 0.0016 | 16.18 | 2330 | 0.3753 | 0.7417 | 0.8346 | 0.7854 | 0.6466 | 0.9596 | 0.9032 | 0.9469 | | 0.0008 | 16.25 | 2340 | 0.3564 | 0.7636 | 0.8246 | 0.7929 | 0.6569 | 0.9619 | 0.8999 | 0.9488 | | 0.0006 | 16.32 | 2350 | 0.3696 | 0.7617 | 0.8282 | 0.7935 | 0.6577 | 0.9619 | 0.9015 | 0.9488 | | 0.0019 | 16.39 | 2360 | 0.3732 | 0.7611 | 0.8249 | 0.7917 | 0.6552 | 0.9616 | 0.8999 | 0.9483 | | 0.0017 | 16.46 | 2370 | 0.3586 | 0.7543 | 0.8287 | 0.7897 | 0.6525 | 0.9610 | 0.9012 | 0.9482 | | 0.002 | 16.53 | 2380 | 0.3660 | 0.7548 | 0.8295 | 0.7904 | 0.6534 | 0.9611 | 0.9017 | 0.9481 | | 0.0009 | 16.6 | 2390 | 0.3637 | 0.7561 | 0.8271 | 0.7900 | 0.6529 | 0.9611 | 0.9006 | 0.9478 | | 0.0015 | 16.67 | 2400 | 0.3894 | 0.7456 | 0.8356 | 0.7880 | 0.6502 | 0.9602 | 0.9039 | 0.9469 | | 0.0012 | 16.74 | 2410 | 0.3621 | 0.7737 | 0.8176 | 0.7950 | 0.6598 | 0.9627 | 0.8972 | 0.9497 | | 0.0008 | 16.81 | 2420 | 0.3579 | 0.7618 | 0.8263 | 0.7928 | 0.6567 | 0.9618 | 0.9006 | 0.9486 | | 0.0015 | 16.88 | 2430 | 0.3312 | 0.7693 | 0.8250 | 0.7962 | 0.6614 | 0.9626 | 0.9005 | 0.9509 | | 0.001 | 16.94 | 2440 | 0.3385 | 0.7770 | 0.8179 | 0.7969 | 0.6624 | 0.9631 | 0.8975 | 0.9518 | | 0.0013 | 17.01 | 2450 | 0.3606 | 0.7574 | 0.8288 | 0.7915 | 0.6549 | 0.9614 | 0.9015 | 0.9488 | | 0.001 | 17.08 | 2460 | 0.3395 | 0.7701 | 0.8181 | 0.7934 | 0.6575 | 0.9623 | 0.8972 | 0.9521 | | 0.0011 | 17.15 | 2470 | 0.3755 | 0.7608 | 0.8243 | 0.7913 | 0.6547 | 0.9615 | 0.8996 | 0.9486 | | 0.0009 | 17.22 | 2480 | 0.3700 | 0.7740 | 0.8122 | 0.7927 | 0.6565 | 0.9624 | 0.8946 | 0.9499 | | 0.0015 | 17.29 | 2490 | 0.3767 | 0.7632 | 0.8231 | 0.7920 | 0.6557 | 0.9618 | 0.8992 | 0.9487 | | 0.0014 | 17.36 | 2500 | 0.3732 | 0.7611 | 0.8233 | 0.7909 | 0.6542 | 0.9615 | 0.8991 | 0.9488 | | 0.001 | 17.43 | 2510 | 0.3604 | 0.7670 | 0.8171 | 0.7913 | 0.6546 | 0.9619 | 0.8965 | 0.9493 | | 0.0012 | 17.5 | 2520 | 0.3745 | 0.7458 | 0.8303 | 0.7857 | 0.6471 | 0.9599 | 0.9014 | 0.9475 | | 0.002 | 17.57 | 2530 | 0.3699 | 0.7475 | 0.8296 | 0.7864 | 0.6480 | 0.9601 | 0.9012 | 0.9471 | | 0.0012 | 17.64 | 2540 | 0.3655 | 0.7698 | 0.8168 | 0.7926 | 0.6565 | 0.9622 | 0.8965 | 0.9492 | | 0.002 | 17.71 | 2550 | 0.3797 | 0.7504 | 0.8363 | 0.7911 | 0.6543 | 0.9609 | 0.9047 | 0.9470 | | 0.0017 | 17.78 | 2560 | 0.3572 | 0.7719 | 0.8212 | 0.7958 | 0.6608 | 0.9627 | 0.8988 | 0.9500 | | 0.0004 | 17.85 | 2570 | 0.3714 | 0.7559 | 0.8251 | 0.7890 | 0.6515 | 0.9610 | 0.8996 | 0.9481 | | 0.0015 | 17.92 | 2580 | 0.3860 | 0.7484 | 0.8336 | 0.7887 | 0.6511 | 0.9605 | 0.9032 | 0.9470 | | 0.0016 | 17.99 | 2590 | 0.3769 | 0.7729 | 0.8164 | 0.7941 | 0.6585 | 0.9625 | 0.8966 | 0.9488 | | 0.0012 | 18.06 | 2600 | 0.3571 | 0.7686 | 0.8187 | 0.7928 | 0.6568 | 0.9621 | 0.8974 | 0.9506 | | 0.0012 | 18.12 | 2610 | 0.3859 | 0.7526 | 0.8254 | 0.7873 | 0.6492 | 0.9605 | 0.8995 | 0.9481 | | 0.0011 | 18.19 | 2620 | 0.3586 | 0.7840 | 0.8037 | 0.7938 | 0.6581 | 0.9630 | 0.8911 | 0.9504 | | 0.0009 | 18.26 | 2630 | 0.3939 | 0.7498 | 0.8286 | 0.7872 | 0.6491 | 0.9604 | 0.9009 | 0.9472 | | 0.001 | 18.33 | 2640 | 0.3741 | 0.7763 | 0.8147 | 0.7951 | 0.6598 | 0.9628 | 0.8960 | 0.9502 | | 0.0006 | 18.4 | 2650 | 0.3940 | 0.7564 | 0.8295 | 0.7912 | 0.6546 | 0.9613 | 0.9018 | 0.9477 | | 0.0012 | 18.47 | 2660 | 0.3584 | 0.7600 | 0.8286 | 0.7928 | 0.6567 | 0.9617 | 0.9016 | 0.9499 | | 0.0024 | 18.54 | 2670 | 0.3707 | 0.7627 | 0.8303 | 0.7950 | 0.6598 | 0.9621 | 0.9026 | 0.9490 | | 0.0007 | 18.61 | 2680 | 0.3716 | 0.7544 | 0.8329 | 0.7917 | 0.6552 | 0.9612 | 0.9033 | 0.9484 | | 0.0002 | 18.68 | 2690 | 0.3727 | 0.7649 | 0.8247 | 0.7937 | 0.6580 | 0.9621 | 0.9001 | 0.9493 | | 0.0015 | 18.75 | 2700 | 0.3965 | 0.7497 | 0.8330 | 0.7892 | 0.6518 | 0.9606 | 0.9030 | 0.9468 | | 0.0015 | 18.82 | 2710 | 0.3857 | 0.7701 | 0.8163 | 0.7925 | 0.6563 | 0.9622 | 0.8963 | 0.9485 | | 0.0011 | 18.89 | 2720 | 0.3919 | 0.7414 | 0.8295 | 0.7830 | 0.6434 | 0.9593 | 0.9007 | 0.9456 | | 0.001 | 18.96 | 2730 | 0.3731 | 0.7622 | 0.8110 | 0.7858 | 0.6472 | 0.9609 | 0.8932 | 0.9478 | | 0.0007 | 19.03 | 2740 | 0.3790 | 0.7493 | 0.8254 | 0.7855 | 0.6468 | 0.9601 | 0.8993 | 0.9467 | | 0.0013 | 19.1 | 2750 | 0.3736 | 0.7565 | 0.8229 | 0.7883 | 0.6506 | 0.9609 | 0.8986 | 0.9481 | | 0.0016 | 19.17 | 2760 | 0.3724 | 0.7602 | 0.8230 | 0.7903 | 0.6534 | 0.9614 | 0.8989 | 0.9479 | | 0.0008 | 19.24 | 2770 | 0.3552 | 0.7610 | 0.8251 | 0.7918 | 0.6553 | 0.9616 | 0.9000 | 0.9498 | | 0.0003 | 19.31 | 2780 | 0.3826 | 0.7620 | 0.8209 | 0.7904 | 0.6534 | 0.9615 | 0.8980 | 0.9481 | | 0.0004 | 19.38 | 2790 | 0.3750 | 0.7560 | 0.8259 | 0.7894 | 0.6521 | 0.9610 | 0.9000 | 0.9481 | | 0.0015 | 19.44 | 2800 | 0.3716 | 0.7502 | 0.8262 | 0.7863 | 0.6479 | 0.9603 | 0.8997 | 0.9474 | | 0.0007 | 19.51 | 2810 | 0.3620 | 0.7643 | 0.8204 | 0.7914 | 0.6548 | 0.9617 | 0.8979 | 0.9499 | | 0.0011 | 19.58 | 2820 | 0.3664 | 0.7539 | 0.8279 | 0.7892 | 0.6518 | 0.9609 | 0.9008 | 0.9486 | | 0.0011 | 19.65 | 2830 | 0.3937 | 0.7507 | 0.8279 | 0.7874 | 0.6494 | 0.9605 | 0.9006 | 0.9469 | | 0.0007 | 19.72 | 2840 | 0.3805 | 0.7591 | 0.8270 | 0.7916 | 0.6551 | 0.9615 | 0.9007 | 0.9485 | | 0.0004 | 19.79 | 2850 | 0.3837 | 0.7564 | 0.8280 | 0.7906 | 0.6537 | 0.9612 | 0.9011 | 0.9476 | | 0.0005 | 19.86 | 2860 | 0.3765 | 0.7523 | 0.8266 | 0.7877 | 0.6498 | 0.9606 | 0.9001 | 0.9478 | | 0.0006 | 19.93 | 2870 | 0.3685 | 0.7537 | 0.8247 | 0.7876 | 0.6497 | 0.9607 | 0.8993 | 0.9478 | | 0.0008 | 20.0 | 2880 | 0.3648 | 0.7666 | 0.8155 | 0.7903 | 0.6533 | 0.9617 | 0.8957 | 0.9496 | | 0.0008 | 20.07 | 2890 | 0.3824 | 0.7611 | 0.8200 | 0.7894 | 0.6521 | 0.9613 | 0.8975 | 0.9487 | | 0.0012 | 20.14 | 2900 | 0.3940 | 0.7522 | 0.8280 | 0.7883 | 0.6506 | 0.9607 | 0.9008 | 0.9473 | | 0.0012 | 20.21 | 2910 | 0.3789 | 0.7665 | 0.8173 | 0.7911 | 0.6544 | 0.9618 | 0.8966 | 0.9496 | | 0.0006 | 20.28 | 2920 | 0.3859 | 0.7559 | 0.8283 | 0.7904 | 0.6535 | 0.9611 | 0.9012 | 0.9485 | | 0.001 | 20.35 | 2930 | 0.3871 | 0.7712 | 0.8172 | 0.7935 | 0.6577 | 0.9624 | 0.8968 | 0.9494 | | 0.0005 | 20.42 | 2940 | 0.3897 | 0.7556 | 0.8300 | 0.7910 | 0.6543 | 0.9612 | 0.9020 | 0.9483 | | 0.0009 | 20.49 | 2950 | 0.4065 | 0.7456 | 0.8319 | 0.7864 | 0.6479 | 0.9600 | 0.9022 | 0.9469 | | 0.0008 | 20.56 | 2960 | 0.3785 | 0.7704 | 0.8172 | 0.7931 | 0.6571 | 0.9623 | 0.8968 | 0.9498 | | 0.0005 | 20.62 | 2970 | 0.4003 | 0.7561 | 0.8242 | 0.7887 | 0.6511 | 0.9609 | 0.8992 | 0.9479 | | 0.0007 | 20.69 | 2980 | 0.3964 | 0.7725 | 0.8131 | 0.7923 | 0.6560 | 0.9623 | 0.8949 | 0.9487 | | 0.0003 | 20.76 | 2990 | 0.3927 | 0.7515 | 0.8315 | 0.7894 | 0.6521 | 0.9608 | 0.9024 | 0.9474 | | 0.0005 | 20.83 | 3000 | 0.3626 | 0.7785 | 0.8107 | 0.7943 | 0.6588 | 0.9628 | 0.8942 | 0.9512 | | 0.0006 | 20.9 | 3010 | 0.3946 | 0.7568 | 0.8283 | 0.7909 | 0.6542 | 0.9613 | 0.9012 | 0.9482 | | 0.0008 | 20.97 | 3020 | 0.3895 | 0.7730 | 0.8175 | 0.7946 | 0.6592 | 0.9626 | 0.8971 | 0.9491 | | 0.0006 | 21.04 | 3030 | 0.3750 | 0.7601 | 0.8279 | 0.7926 | 0.6564 | 0.9617 | 0.9013 | 0.9486 | | 0.0008 | 21.11 | 3040 | 0.3803 | 0.7693 | 0.8184 | 0.7931 | 0.6571 | 0.9622 | 0.8973 | 0.9488 | | 0.0003 | 21.18 | 3050 | 0.3911 | 0.7649 | 0.8201 | 0.7916 | 0.6550 | 0.9618 | 0.8978 | 0.9482 | | 0.0008 | 21.25 | 3060 | 0.3972 | 0.7565 | 0.8319 | 0.7924 | 0.6562 | 0.9614 | 0.9029 | 0.9480 | | 0.0012 | 21.32 | 3070 | 0.4029 | 0.7561 | 0.8290 | 0.7908 | 0.6540 | 0.9612 | 0.9015 | 0.9472 | | 0.001 | 21.39 | 3080 | 0.3945 | 0.7513 | 0.8327 | 0.7899 | 0.6527 | 0.9608 | 0.9029 | 0.9473 | | 0.0004 | 21.46 | 3090 | 0.3875 | 0.7587 | 0.8290 | 0.7923 | 0.6560 | 0.9615 | 0.9017 | 0.9482 | | 0.0007 | 21.53 | 3100 | 0.4054 | 0.7558 | 0.8293 | 0.7909 | 0.6541 | 0.9612 | 0.9017 | 0.9475 | | 0.0003 | 21.6 | 3110 | 0.3798 | 0.7629 | 0.8234 | 0.7920 | 0.6557 | 0.9617 | 0.8993 | 0.9492 | | 0.001 | 21.67 | 3120 | 0.4012 | 0.7498 | 0.8332 | 0.7893 | 0.6519 | 0.9606 | 0.9031 | 0.9472 | | 0.0007 | 21.74 | 3130 | 0.3827 | 0.7700 | 0.8135 | 0.7911 | 0.6544 | 0.9620 | 0.8950 | 0.9492 | | 0.0009 | 21.81 | 3140 | 0.3879 | 0.7575 | 0.8237 | 0.7892 | 0.6518 | 0.9611 | 0.8990 | 0.9482 | | 0.0004 | 21.88 | 3150 | 0.3863 | 0.7678 | 0.8169 | 0.7916 | 0.6551 | 0.9619 | 0.8965 | 0.9487 | | 0.0004 | 21.94 | 3160 | 0.3952 | 0.7460 | 0.8320 | 0.7866 | 0.6483 | 0.9601 | 0.9022 | 0.9465 | | 0.0006 | 22.01 | 3170 | 0.3841 | 0.7597 | 0.8259 | 0.7914 | 0.6548 | 0.9615 | 0.9003 | 0.9485 | | 0.0006 | 22.08 | 3180 | 0.4018 | 0.7642 | 0.8233 | 0.7926 | 0.6565 | 0.9619 | 0.8993 | 0.9483 | | 0.0006 | 22.15 | 3190 | 0.3931 | 0.7544 | 0.8291 | 0.7900 | 0.6529 | 0.9610 | 0.9014 | 0.9483 | | 0.0005 | 22.22 | 3200 | 0.3803 | 0.7577 | 0.8263 | 0.7905 | 0.6536 | 0.9612 | 0.9003 | 0.9487 | | 0.0002 | 22.29 | 3210 | 0.3846 | 0.7544 | 0.8280 | 0.7895 | 0.6522 | 0.9609 | 0.9009 | 0.9479 | | 0.0012 | 22.36 | 3220 | 0.3975 | 0.7512 | 0.8295 | 0.7884 | 0.6507 | 0.9606 | 0.9014 | 0.9467 | | 0.0006 | 22.43 | 3230 | 0.3687 | 0.7764 | 0.8131 | 0.7943 | 0.6588 | 0.9627 | 0.8952 | 0.9497 | | 0.0005 | 22.5 | 3240 | 0.3863 | 0.7623 | 0.8251 | 0.7925 | 0.6563 | 0.9618 | 0.9001 | 0.9489 | | 0.0004 | 22.57 | 3250 | 0.4062 | 0.7553 | 0.8263 | 0.7892 | 0.6518 | 0.9609 | 0.9002 | 0.9479 | | 0.0008 | 22.64 | 3260 | 0.4026 | 0.7596 | 0.8268 | 0.7918 | 0.6554 | 0.9615 | 0.9007 | 0.9484 | | 0.0006 | 22.71 | 3270 | 0.4057 | 0.7526 | 0.8291 | 0.7890 | 0.6515 | 0.9608 | 0.9013 | 0.9480 | | 0.0006 | 22.78 | 3280 | 0.3985 | 0.7673 | 0.8229 | 0.7941 | 0.6586 | 0.9623 | 0.8993 | 0.9490 | | 0.0004 | 22.85 | 3290 | 0.3911 | 0.7647 | 0.8278 | 0.7950 | 0.6598 | 0.9622 | 0.9015 | 0.9490 | | 0.0008 | 22.92 | 3300 | 0.3828 | 0.7714 | 0.8233 | 0.7965 | 0.6618 | 0.9628 | 0.8998 | 0.9499 | | 0.0005 | 22.99 | 3310 | 0.4088 | 0.7498 | 0.8330 | 0.7892 | 0.6518 | 0.9606 | 0.9030 | 0.9470 | | 0.0008 | 23.06 | 3320 | 0.3973 | 0.7539 | 0.8316 | 0.7909 | 0.6541 | 0.9611 | 0.9026 | 0.9478 | | 0.0008 | 23.12 | 3330 | 0.3820 | 0.7749 | 0.8190 | 0.7964 | 0.6617 | 0.9629 | 0.8980 | 0.9501 | | 0.0008 | 23.19 | 3340 | 0.3839 | 0.7713 | 0.8192 | 0.7945 | 0.6591 | 0.9625 | 0.8978 | 0.9499 | | 0.001 | 23.26 | 3350 | 0.3861 | 0.7576 | 0.8290 | 0.7917 | 0.6552 | 0.9614 | 0.9016 | 0.9488 | | 0.0006 | 23.33 | 3360 | 0.4031 | 0.7496 | 0.8329 | 0.7891 | 0.6516 | 0.9606 | 0.9030 | 0.9474 | | 0.0007 | 23.4 | 3370 | 0.3906 | 0.7648 | 0.8221 | 0.7924 | 0.6562 | 0.9619 | 0.8988 | 0.9491 | | 0.0007 | 23.47 | 3380 | 0.3793 | 0.7586 | 0.8272 | 0.7914 | 0.6549 | 0.9614 | 0.9008 | 0.9495 | | 0.0002 | 23.54 | 3390 | 0.3765 | 0.7569 | 0.8243 | 0.7892 | 0.6518 | 0.9610 | 0.8993 | 0.9492 | | 0.0005 | 23.61 | 3400 | 0.3716 | 0.7639 | 0.8201 | 0.7910 | 0.6543 | 0.9617 | 0.8977 | 0.9496 | | 0.0008 | 23.68 | 3410 | 0.3701 | 0.7690 | 0.8204 | 0.7938 | 0.6582 | 0.9623 | 0.8982 | 0.9501 | | 0.0003 | 23.75 | 3420 | 0.3863 | 0.7656 | 0.8264 | 0.7948 | 0.6595 | 0.9623 | 0.9009 | 0.9497 | | 0.0011 | 23.82 | 3430 | 0.3907 | 0.7656 | 0.8263 | 0.7948 | 0.6595 | 0.9623 | 0.9009 | 0.9496 | | 0.0003 | 23.89 | 3440 | 0.3847 | 0.7708 | 0.8234 | 0.7962 | 0.6614 | 0.9627 | 0.8998 | 0.9500 | | 0.0004 | 23.96 | 3450 | 0.3850 | 0.7678 | 0.8251 | 0.7954 | 0.6604 | 0.9625 | 0.9005 | 0.9500 | | 0.0004 | 24.03 | 3460 | 0.3917 | 0.7640 | 0.8260 | 0.7938 | 0.6581 | 0.9620 | 0.9006 | 0.9493 | | 0.0004 | 24.1 | 3470 | 0.3972 | 0.7613 | 0.8253 | 0.7920 | 0.6556 | 0.9616 | 0.9001 | 0.9487 | | 0.0005 | 24.17 | 3480 | 0.3947 | 0.7519 | 0.8319 | 0.7899 | 0.6527 | 0.9608 | 0.9026 | 0.9481 | | 0.0004 | 24.24 | 3490 | 0.3777 | 0.7570 | 0.8307 | 0.7921 | 0.6558 | 0.9614 | 0.9024 | 0.9501 | | 0.0004 | 24.31 | 3500 | 0.3893 | 0.7678 | 0.8226 | 0.7943 | 0.6588 | 0.9623 | 0.8992 | 0.9503 | | 0.0002 | 24.38 | 3510 | 0.3987 | 0.7576 | 0.8283 | 0.7913 | 0.6547 | 0.9614 | 0.9013 | 0.9488 | | 0.0006 | 24.44 | 3520 | 0.4019 | 0.7548 | 0.8296 | 0.7905 | 0.6535 | 0.9611 | 0.9017 | 0.9485 | | 0.0007 | 24.51 | 3530 | 0.3940 | 0.7629 | 0.8225 | 0.7916 | 0.6551 | 0.9617 | 0.8988 | 0.9493 | | 0.0002 | 24.58 | 3540 | 0.4015 | 0.7592 | 0.8251 | 0.7908 | 0.6540 | 0.9614 | 0.8999 | 0.9485 | | 0.0004 | 24.65 | 3550 | 0.4048 | 0.7525 | 0.8295 | 0.7891 | 0.6517 | 0.9608 | 0.9015 | 0.9478 | | 0.0011 | 24.72 | 3560 | 0.3947 | 0.7637 | 0.8230 | 0.7922 | 0.6560 | 0.9618 | 0.8991 | 0.9490 | | 0.0009 | 24.79 | 3570 | 0.3920 | 0.7559 | 0.8276 | 0.7902 | 0.6531 | 0.9611 | 0.9008 | 0.9487 | | 0.0006 | 24.86 | 3580 | 0.3964 | 0.7583 | 0.8270 | 0.7911 | 0.6544 | 0.9614 | 0.9007 | 0.9488 | | 0.0008 | 24.93 | 3590 | 0.3969 | 0.7577 | 0.8284 | 0.7915 | 0.6549 | 0.9614 | 0.9014 | 0.9489 | | 0.0004 | 25.0 | 3600 | 0.3893 | 0.7599 | 0.8293 | 0.7931 | 0.6571 | 0.9617 | 0.9020 | 0.9493 | | 0.0002 | 25.07 | 3610 | 0.3893 | 0.7595 | 0.8279 | 0.7922 | 0.6559 | 0.9616 | 0.9012 | 0.9492 | | 0.0003 | 25.14 | 3620 | 0.3895 | 0.7657 | 0.8238 | 0.7937 | 0.6580 | 0.9621 | 0.8997 | 0.9498 | | 0.0002 | 25.21 | 3630 | 0.4032 | 0.7529 | 0.8319 | 0.7904 | 0.6535 | 0.9610 | 0.9027 | 0.9487 | | 0.0004 | 25.28 | 3640 | 0.4006 | 0.7523 | 0.8336 | 0.7909 | 0.6541 | 0.9610 | 0.9035 | 0.9491 | | 0.0007 | 25.35 | 3650 | 0.3961 | 0.7543 | 0.8338 | 0.7921 | 0.6558 | 0.9613 | 0.9037 | 0.9491 | | 0.0005 | 25.42 | 3660 | 0.3899 | 0.7670 | 0.8225 | 0.7938 | 0.6580 | 0.9622 | 0.8991 | 0.9501 | | 0.0005 | 25.49 | 3670 | 0.3908 | 0.7642 | 0.8241 | 0.7930 | 0.6570 | 0.9619 | 0.8997 | 0.9501 | | 0.0007 | 25.56 | 3680 | 0.3955 | 0.7527 | 0.8308 | 0.7898 | 0.6526 | 0.9609 | 0.9022 | 0.9493 | | 0.0002 | 25.62 | 3690 | 0.3988 | 0.7544 | 0.8295 | 0.7901 | 0.6531 | 0.9610 | 0.9016 | 0.9493 | | 0.0004 | 25.69 | 3700 | 0.3983 | 0.7703 | 0.8206 | 0.7947 | 0.6593 | 0.9625 | 0.8984 | 0.9503 | | 0.0007 | 25.76 | 3710 | 0.4074 | 0.7587 | 0.8259 | 0.7909 | 0.6541 | 0.9614 | 0.9002 | 0.9488 | | 0.0004 | 25.83 | 3720 | 0.4113 | 0.7575 | 0.8268 | 0.7907 | 0.6538 | 0.9613 | 0.9006 | 0.9483 | | 0.0006 | 25.9 | 3730 | 0.3985 | 0.7679 | 0.8208 | 0.7935 | 0.6576 | 0.9622 | 0.8983 | 0.9497 | | 0.0006 | 25.97 | 3740 | 0.3902 | 0.7656 | 0.8231 | 0.7933 | 0.6575 | 0.9621 | 0.8993 | 0.9500 | | 0.0004 | 26.04 | 3750 | 0.3937 | 0.7573 | 0.8303 | 0.7921 | 0.6558 | 0.9614 | 0.9022 | 0.9494 | | 0.0006 | 26.11 | 3760 | 0.3979 | 0.7524 | 0.8316 | 0.7900 | 0.6529 | 0.9609 | 0.9025 | 0.9489 | | 0.0003 | 26.18 | 3770 | 0.3914 | 0.7645 | 0.8239 | 0.7931 | 0.6571 | 0.9620 | 0.8996 | 0.9504 | | 0.001 | 26.25 | 3780 | 0.3939 | 0.7621 | 0.8246 | 0.7921 | 0.6558 | 0.9617 | 0.8998 | 0.9501 | | 0.0011 | 26.32 | 3790 | 0.4015 | 0.7536 | 0.8313 | 0.7906 | 0.6537 | 0.9610 | 0.9025 | 0.9489 | | 0.0004 | 26.39 | 3800 | 0.3952 | 0.7592 | 0.8274 | 0.7918 | 0.6554 | 0.9615 | 0.9009 | 0.9495 | | 0.0002 | 26.46 | 3810 | 0.3864 | 0.7700 | 0.8200 | 0.7942 | 0.6587 | 0.9624 | 0.8981 | 0.9505 | | 0.0004 | 26.53 | 3820 | 0.3897 | 0.7644 | 0.8249 | 0.7935 | 0.6576 | 0.9620 | 0.9001 | 0.9499 | | 0.0005 | 26.6 | 3830 | 0.3912 | 0.7640 | 0.8260 | 0.7938 | 0.6581 | 0.9620 | 0.9006 | 0.9498 | | 0.0006 | 26.67 | 3840 | 0.3896 | 0.7609 | 0.8271 | 0.7926 | 0.6565 | 0.9617 | 0.9009 | 0.9495 | | 0.0004 | 26.74 | 3850 | 0.3896 | 0.7651 | 0.8227 | 0.7929 | 0.6569 | 0.9620 | 0.8991 | 0.9496 | | 0.0005 | 26.81 | 3860 | 0.3891 | 0.7703 | 0.8180 | 0.7934 | 0.6576 | 0.9623 | 0.8972 | 0.9502 | | 0.0006 | 26.88 | 3870 | 0.3914 | 0.7645 | 0.8216 | 0.7920 | 0.6556 | 0.9618 | 0.8985 | 0.9497 | | 0.0001 | 26.94 | 3880 | 0.3925 | 0.7595 | 0.8249 | 0.7908 | 0.6540 | 0.9614 | 0.8997 | 0.9492 | | 0.0009 | 27.01 | 3890 | 0.3876 | 0.7705 | 0.8198 | 0.7944 | 0.6589 | 0.9625 | 0.8981 | 0.9504 | | 0.0008 | 27.08 | 3900 | 0.3928 | 0.7683 | 0.8204 | 0.7935 | 0.6577 | 0.9622 | 0.8982 | 0.9499 | | 0.0004 | 27.15 | 3910 | 0.4046 | 0.7614 | 0.8264 | 0.7926 | 0.6564 | 0.9617 | 0.9007 | 0.9490 | | 0.0001 | 27.22 | 3920 | 0.4051 | 0.7637 | 0.8253 | 0.7933 | 0.6574 | 0.9619 | 0.9002 | 0.9489 | | 0.0009 | 27.29 | 3930 | 0.4008 | 0.7658 | 0.8231 | 0.7934 | 0.6576 | 0.9621 | 0.8994 | 0.9495 | | 0.0004 | 27.36 | 3940 | 0.3989 | 0.7645 | 0.8242 | 0.7932 | 0.6573 | 0.9620 | 0.8998 | 0.9497 | | 0.0003 | 27.43 | 3950 | 0.4018 | 0.7614 | 0.8263 | 0.7926 | 0.6564 | 0.9617 | 0.9006 | 0.9494 | | 0.0006 | 27.5 | 3960 | 0.4048 | 0.7603 | 0.8274 | 0.7924 | 0.6562 | 0.9616 | 0.9010 | 0.9491 | | 0.0005 | 27.57 | 3970 | 0.4018 | 0.7631 | 0.8262 | 0.7934 | 0.6575 | 0.9619 | 0.9006 | 0.9495 | | 0.0009 | 27.64 | 3980 | 0.3989 | 0.7622 | 0.8253 | 0.7925 | 0.6563 | 0.9618 | 0.9001 | 0.9497 | | 0.0001 | 27.71 | 3990 | 0.4047 | 0.7657 | 0.8237 | 0.7936 | 0.6579 | 0.9621 | 0.8996 | 0.9495 | | 0.0004 | 27.78 | 4000 | 0.4064 | 0.7649 | 0.8246 | 0.7936 | 0.6579 | 0.9621 | 0.9000 | 0.9493 | | 0.0004 | 27.85 | 4010 | 0.4100 | 0.7610 | 0.8276 | 0.7929 | 0.6569 | 0.9618 | 0.9012 | 0.9491 | | 0.0002 | 27.92 | 4020 | 0.4093 | 0.7623 | 0.8266 | 0.7932 | 0.6572 | 0.9619 | 0.9008 | 0.9496 | | 0.0006 | 27.99 | 4030 | 0.4012 | 0.7711 | 0.8194 | 0.7945 | 0.6591 | 0.9625 | 0.8979 | 0.9504 | | 0.0003 | 28.06 | 4040 | 0.4017 | 0.7726 | 0.8172 | 0.7943 | 0.6588 | 0.9625 | 0.8969 | 0.9503 | | 0.0002 | 28.12 | 4050 | 0.4142 | 0.7593 | 0.8278 | 0.7920 | 0.6557 | 0.9615 | 0.9011 | 0.9488 | | 0.0002 | 28.19 | 4060 | 0.4203 | 0.7526 | 0.8313 | 0.7900 | 0.6529 | 0.9609 | 0.9024 | 0.9480 | | 0.0001 | 28.26 | 4070 | 0.4261 | 0.7501 | 0.8336 | 0.7896 | 0.6524 | 0.9607 | 0.9033 | 0.9476 | | 0.0001 | 28.33 | 4080 | 0.4191 | 0.7526 | 0.8328 | 0.7906 | 0.6538 | 0.9610 | 0.9031 | 0.9482 | | 0.0003 | 28.4 | 4090 | 0.4087 | 0.7633 | 0.8271 | 0.7939 | 0.6583 | 0.9620 | 0.9011 | 0.9496 | | 0.0003 | 28.47 | 4100 | 0.4021 | 0.7673 | 0.8217 | 0.7935 | 0.6578 | 0.9622 | 0.8987 | 0.9499 | | 0.0002 | 28.54 | 4110 | 0.4031 | 0.7649 | 0.8238 | 0.7933 | 0.6574 | 0.9620 | 0.8996 | 0.9500 | | 0.0008 | 28.61 | 4120 | 0.4051 | 0.7626 | 0.8247 | 0.7924 | 0.6562 | 0.9618 | 0.8999 | 0.9496 | | 0.0005 | 28.68 | 4130 | 0.4058 | 0.7603 | 0.8270 | 0.7922 | 0.6559 | 0.9616 | 0.9008 | 0.9495 | | 0.0006 | 28.75 | 4140 | 0.4036 | 0.7616 | 0.8272 | 0.7931 | 0.6571 | 0.9618 | 0.9011 | 0.9497 | | 0.0003 | 28.82 | 4150 | 0.4002 | 0.7648 | 0.8263 | 0.7944 | 0.6589 | 0.9621 | 0.9008 | 0.9498 | | 0.0005 | 28.89 | 4160 | 0.3991 | 0.7652 | 0.8251 | 0.7940 | 0.6584 | 0.9621 | 0.9003 | 0.9497 | | 0.0002 | 28.96 | 4170 | 0.3976 | 0.7677 | 0.8222 | 0.7940 | 0.6584 | 0.9623 | 0.8990 | 0.9499 | | 0.0006 | 29.03 | 4180 | 0.3978 | 0.7691 | 0.8217 | 0.7945 | 0.6591 | 0.9624 | 0.8989 | 0.9501 | | 0.0002 | 29.1 | 4190 | 0.3961 | 0.7722 | 0.8196 | 0.7952 | 0.6600 | 0.9626 | 0.8980 | 0.9505 | | 0.0004 | 29.17 | 4200 | 0.3967 | 0.7704 | 0.8223 | 0.7956 | 0.6605 | 0.9626 | 0.8993 | 0.9504 | | 0.0004 | 29.24 | 4210 | 0.4029 | 0.7642 | 0.8259 | 0.7939 | 0.6582 | 0.9621 | 0.9006 | 0.9495 | | 0.0001 | 29.31 | 4220 | 0.4032 | 0.7638 | 0.8263 | 0.7938 | 0.6581 | 0.9620 | 0.9008 | 0.9494 | | 0.0003 | 29.38 | 4230 | 0.4010 | 0.7657 | 0.8251 | 0.7943 | 0.6588 | 0.9622 | 0.9003 | 0.9497 | | 0.0002 | 29.44 | 4240 | 0.4002 | 0.7684 | 0.8246 | 0.7955 | 0.6604 | 0.9625 | 0.9002 | 0.9500 | | 0.0002 | 29.51 | 4250 | 0.4060 | 0.7588 | 0.8283 | 0.7920 | 0.6557 | 0.9615 | 0.9014 | 0.9490 | | 0.0002 | 29.58 | 4260 | 0.4083 | 0.7586 | 0.8283 | 0.7919 | 0.6556 | 0.9615 | 0.9014 | 0.9490 | | 0.0005 | 29.65 | 4270 | 0.4146 | 0.7565 | 0.8283 | 0.7907 | 0.6539 | 0.9612 | 0.9012 | 0.9485 | | 0.0002 | 29.72 | 4280 | 0.4140 | 0.7604 | 0.8260 | 0.7918 | 0.6554 | 0.9616 | 0.9004 | 0.9488 | | 0.0005 | 29.79 | 4290 | 0.4117 | 0.7663 | 0.8225 | 0.7934 | 0.6576 | 0.9621 | 0.8991 | 0.9494 | | 0.0006 | 29.86 | 4300 | 0.4104 | 0.7689 | 0.8216 | 0.7944 | 0.6589 | 0.9624 | 0.8988 | 0.9497 | | 0.0004 | 29.93 | 4310 | 0.4084 | 0.7696 | 0.8218 | 0.7948 | 0.6595 | 0.9625 | 0.8990 | 0.9500 | | 0.0005 | 30.0 | 4320 | 0.4107 | 0.7633 | 0.8251 | 0.7930 | 0.6570 | 0.9619 | 0.9001 | 0.9494 | | 0.0004 | 30.07 | 4330 | 0.4120 | 0.7571 | 0.8295 | 0.7916 | 0.6551 | 0.9614 | 0.9018 | 0.9488 | | 0.0002 | 30.14 | 4340 | 0.4107 | 0.7581 | 0.8286 | 0.7917 | 0.6553 | 0.9614 | 0.9014 | 0.9489 | | 0.0005 | 30.21 | 4350 | 0.4097 | 0.7591 | 0.8286 | 0.7923 | 0.6560 | 0.9616 | 0.9015 | 0.9490 | | 0.0002 | 30.28 | 4360 | 0.4113 | 0.7578 | 0.8283 | 0.7915 | 0.6549 | 0.9614 | 0.9013 | 0.9487 | | 0.0003 | 30.35 | 4370 | 0.4092 | 0.7620 | 0.8268 | 0.7931 | 0.6571 | 0.9618 | 0.9009 | 0.9491 | | 0.0002 | 30.42 | 4380 | 0.4082 | 0.7630 | 0.8257 | 0.7931 | 0.6571 | 0.9619 | 0.9004 | 0.9493 | | 0.0005 | 30.49 | 4390 | 0.4064 | 0.7646 | 0.8255 | 0.7939 | 0.6582 | 0.9621 | 0.9004 | 0.9495 | | 0.0008 | 30.56 | 4400 | 0.4046 | 0.7661 | 0.8247 | 0.7944 | 0.6589 | 0.9622 | 0.9001 | 0.9497 | | 0.0004 | 30.62 | 4410 | 0.4033 | 0.7669 | 0.8241 | 0.7945 | 0.6590 | 0.9623 | 0.8999 | 0.9498 | | 0.0002 | 30.69 | 4420 | 0.4064 | 0.7647 | 0.8247 | 0.7936 | 0.6578 | 0.9620 | 0.9000 | 0.9496 | | 0.0006 | 30.76 | 4430 | 0.4078 | 0.7625 | 0.8251 | 0.7926 | 0.6564 | 0.9618 | 0.9001 | 0.9493 | | 0.0002 | 30.83 | 4440 | 0.4085 | 0.7605 | 0.8257 | 0.7917 | 0.6552 | 0.9616 | 0.9002 | 0.9491 | | 0.0008 | 30.9 | 4450 | 0.4091 | 0.7595 | 0.8264 | 0.7916 | 0.6550 | 0.9615 | 0.9005 | 0.9490 | | 0.0002 | 30.97 | 4460 | 0.4085 | 0.76 | 0.8257 | 0.7915 | 0.6549 | 0.9615 | 0.9002 | 0.9490 | | 0.0001 | 31.04 | 4470 | 0.4076 | 0.7604 | 0.8251 | 0.7915 | 0.6549 | 0.9615 | 0.8999 | 0.9491 | | 0.0007 | 31.11 | 4480 | 0.4071 | 0.7615 | 0.8251 | 0.7920 | 0.6556 | 0.9617 | 0.9000 | 0.9493 | | 0.0002 | 31.18 | 4490 | 0.4047 | 0.7630 | 0.8243 | 0.7925 | 0.6563 | 0.9618 | 0.8997 | 0.9495 | | 0.0005 | 31.25 | 4500 | 0.4029 | 0.7652 | 0.8237 | 0.7934 | 0.6575 | 0.9620 | 0.8996 | 0.9498 | | 0.0005 | 31.32 | 4510 | 0.4042 | 0.7635 | 0.8241 | 0.7926 | 0.6565 | 0.9618 | 0.8996 | 0.9495 | | 0.0002 | 31.39 | 4520 | 0.4068 | 0.7608 | 0.8250 | 0.7916 | 0.6551 | 0.9616 | 0.8999 | 0.9491 | | 0.0003 | 31.46 | 4530 | 0.4079 | 0.7601 | 0.8264 | 0.7919 | 0.6555 | 0.9616 | 0.9006 | 0.9490 | | 0.0001 | 31.53 | 4540 | 0.4085 | 0.7588 | 0.8278 | 0.7918 | 0.6553 | 0.9615 | 0.9011 | 0.9489 | | 0.0004 | 31.6 | 4550 | 0.4075 | 0.7596 | 0.8270 | 0.7919 | 0.6555 | 0.9615 | 0.9008 | 0.9490 | | 0.0003 | 31.67 | 4560 | 0.4051 | 0.7622 | 0.8254 | 0.7925 | 0.6563 | 0.9618 | 0.9002 | 0.9492 | | 0.0002 | 31.74 | 4570 | 0.4042 | 0.7626 | 0.8253 | 0.7927 | 0.6566 | 0.9618 | 0.9002 | 0.9493 | | 0.0006 | 31.81 | 4580 | 0.4069 | 0.7615 | 0.8259 | 0.7924 | 0.6562 | 0.9617 | 0.9004 | 0.9491 | | 0.0009 | 31.88 | 4590 | 0.4087 | 0.7609 | 0.8259 | 0.7921 | 0.6557 | 0.9616 | 0.9004 | 0.9490 | | 0.0004 | 31.94 | 4600 | 0.4095 | 0.7603 | 0.8263 | 0.7919 | 0.6556 | 0.9616 | 0.9005 | 0.9488 | | 0.0001 | 32.01 | 4610 | 0.4077 | 0.7604 | 0.8264 | 0.7920 | 0.6557 | 0.9616 | 0.9006 | 0.9489 | | 0.0003 | 32.08 | 4620 | 0.4067 | 0.7612 | 0.8260 | 0.7923 | 0.6560 | 0.9617 | 0.9004 | 0.9490 | | 0.0001 | 32.15 | 4630 | 0.4062 | 0.7616 | 0.8258 | 0.7924 | 0.6562 | 0.9617 | 0.9003 | 0.9491 | | 0.0004 | 32.22 | 4640 | 0.4059 | 0.7615 | 0.8255 | 0.7922 | 0.6559 | 0.9617 | 0.9002 | 0.9491 | | 0.0002 | 32.29 | 4650 | 0.4048 | 0.7617 | 0.8257 | 0.7924 | 0.6561 | 0.9617 | 0.9003 | 0.9492 | | 0.0004 | 32.36 | 4660 | 0.4046 | 0.7614 | 0.8262 | 0.7925 | 0.6563 | 0.9617 | 0.9005 | 0.9492 | | 0.0002 | 32.43 | 4670 | 0.4044 | 0.7616 | 0.8263 | 0.7927 | 0.6565 | 0.9618 | 0.9006 | 0.9492 | | 0.0003 | 32.5 | 4680 | 0.4044 | 0.7614 | 0.8262 | 0.7925 | 0.6563 | 0.9617 | 0.9005 | 0.9492 | | 0.0005 | 32.57 | 4690 | 0.4051 | 0.7607 | 0.8266 | 0.7923 | 0.6560 | 0.9616 | 0.9007 | 0.9491 | | 0.0002 | 32.64 | 4700 | 0.4054 | 0.7606 | 0.8264 | 0.7922 | 0.6559 | 0.9616 | 0.9006 | 0.9490 | | 0.0004 | 32.71 | 4710 | 0.4058 | 0.7607 | 0.8266 | 0.7923 | 0.6560 | 0.9616 | 0.9007 | 0.9490 | | 0.0008 | 32.78 | 4720 | 0.4059 | 0.7610 | 0.8259 | 0.7921 | 0.6558 | 0.9616 | 0.9004 | 0.9490 | | 0.0001 | 32.85 | 4730 | 0.4059 | 0.7610 | 0.8262 | 0.7923 | 0.6560 | 0.9617 | 0.9005 | 0.9491 | | 0.0002 | 32.92 | 4740 | 0.4063 | 0.7609 | 0.8264 | 0.7923 | 0.6561 | 0.9617 | 0.9006 | 0.9490 | | 0.0005 | 32.99 | 4750 | 0.4068 | 0.7609 | 0.8263 | 0.7922 | 0.6560 | 0.9617 | 0.9006 | 0.9490 | | 0.0001 | 33.06 | 4760 | 0.4068 | 0.7607 | 0.8260 | 0.7920 | 0.6557 | 0.9616 | 0.9004 | 0.9490 | | 0.0006 | 33.12 | 4770 | 0.4061 | 0.7615 | 0.8257 | 0.7923 | 0.6560 | 0.9617 | 0.9003 | 0.9490 | | 0.0002 | 33.19 | 4780 | 0.4057 | 0.7620 | 0.8255 | 0.7925 | 0.6563 | 0.9618 | 0.9002 | 0.9491 | | 0.0001 | 33.26 | 4790 | 0.4056 | 0.7625 | 0.8253 | 0.7926 | 0.6565 | 0.9618 | 0.9002 | 0.9491 | | 0.0003 | 33.33 | 4800 | 0.4058 | 0.7625 | 0.8253 | 0.7926 | 0.6565 | 0.9618 | 0.9002 | 0.9491 | | 0.0002 | 33.4 | 4810 | 0.4063 | 0.7622 | 0.8259 | 0.7928 | 0.6567 | 0.9618 | 0.9005 | 0.9490 | | 0.0005 | 33.47 | 4820 | 0.4067 | 0.7618 | 0.8263 | 0.7928 | 0.6567 | 0.9618 | 0.9006 | 0.9490 | | 0.0003 | 33.54 | 4830 | 0.4069 | 0.7619 | 0.8263 | 0.7928 | 0.6567 | 0.9618 | 0.9006 | 0.9490 | | 0.0004 | 33.61 | 4840 | 0.4070 | 0.7618 | 0.8263 | 0.7928 | 0.6567 | 0.9618 | 0.9006 | 0.9490 | | 0.0004 | 33.68 | 4850 | 0.4069 | 0.7619 | 0.8263 | 0.7928 | 0.6567 | 0.9618 | 0.9006 | 0.9490 | | 0.0001 | 33.75 | 4860 | 0.4067 | 0.7620 | 0.8263 | 0.7929 | 0.6568 | 0.9618 | 0.9006 | 0.9490 | | 0.0003 | 33.82 | 4870 | 0.4066 | 0.7621 | 0.8264 | 0.7930 | 0.6570 | 0.9618 | 0.9007 | 0.9490 | | 0.0001 | 33.89 | 4880 | 0.4067 | 0.7619 | 0.8266 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9490 | | 0.0004 | 33.96 | 4890 | 0.4066 | 0.7619 | 0.8264 | 0.7929 | 0.6568 | 0.9618 | 0.9007 | 0.9491 | | 0.0002 | 34.03 | 4900 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0003 | 34.1 | 4910 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0001 | 34.17 | 4920 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0002 | 34.24 | 4930 | 0.4066 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0002 | 34.31 | 4940 | 0.4066 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0005 | 34.38 | 4950 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0008 | 34.44 | 4960 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0004 | 34.51 | 4970 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0001 | 34.58 | 4980 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0005 | 34.65 | 4990 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | | 0.0005 | 34.72 | 5000 | 0.4067 | 0.7620 | 0.8264 | 0.7929 | 0.6569 | 0.9618 | 0.9007 | 0.9491 | ### Framework versions - Transformers 4.34.1 - Pytorch 2.0.1 - Datasets 2.14.6 - Tokenizers 0.14.1