sembr2023-bert-mini / README.md

End of training

8f52968 12 months ago

15.6 kB

	---
	license: mit
	base_model: prajjwal1/bert-mini
	tags:
	- generated_from_trainer
	metrics:
	- precision
	- recall
	- f1
	- accuracy
	model-index:
	- name: sembr2023-bert-mini
	results: []
	---

	<!-- This model card has been generated automatically according to the information the Trainer had access to. You
	should probably proofread and complete it, then remove this comment. -->

	# sembr2023-bert-mini

	This model is a fine-tuned version of [prajjwal1/bert-mini](https://huggingface.co/prajjwal1/bert-mini) on an unknown dataset.
	It achieves the following results on the evaluation set:
	- Loss: 0.1844
	- Precision: 0.7925
	- Recall: 0.7950
	- F1: 0.7938
	- Iou: 0.6581
	- Accuracy: 0.9620
	- Balanced Accuracy: 0.8870
	- Overall Accuracy: 0.9443

	## Model description

	More information needed

	## Intended uses & limitations

	More information needed

	## Training and evaluation data

	More information needed

	## Training procedure

	### Training hyperparameters

	The following hyperparameters were used during training:
	- learning_rate: 0.0001
	- train_batch_size: 64
	- eval_batch_size: 128
	- seed: 42
	- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
	- lr_scheduler_type: cosine
	- training_steps: 1000

	### Training results

	\| Training Loss \| Epoch \| Step \| Validation Loss \| Precision \| Recall \| F1 \| Iou \| Accuracy \| Balanced Accuracy \| Overall Accuracy \|
	\|:-------------:\|:-----:\|:----:\|:---------------:\|:---------:\|:------:\|:------:\|:------:\|:--------:\|:-----------------:\|:----------------:\|
	\| 0.5028 \| 0.06 \| 10 \| 0.5036 \| 0 \| 0.0 \| 0.0 \| 0.0 \| 0.9080 \| 0.5 \| 0.9080 \|
	\| 0.417 \| 0.12 \| 20 \| 0.4416 \| 0 \| 0.0 \| 0.0 \| 0.0 \| 0.9080 \| 0.5 \| 0.9080 \|
	\| 0.4292 \| 0.18 \| 30 \| 0.4298 \| 0 \| 0.0 \| 0.0 \| 0.0 \| 0.9080 \| 0.5 \| 0.9080 \|
	\| 0.3964 \| 0.24 \| 40 \| 0.4121 \| 0 \| 0.0 \| 0.0 \| 0.0 \| 0.9080 \| 0.5 \| 0.9080 \|
	\| 0.3611 \| 0.3 \| 50 \| 0.3619 \| 0.5833 \| 0.0080 \| 0.0158 \| 0.0080 \| 0.9082 \| 0.5037 \| 0.9081 \|
	\| 0.3201 \| 0.36 \| 60 \| 0.3103 \| 0.6414 \| 0.5085 \| 0.5673 \| 0.3960 \| 0.9287 \| 0.7399 \| 0.9146 \|
	\| 0.2983 \| 0.42 \| 70 \| 0.2575 \| 0.7866 \| 0.6423 \| 0.7072 \| 0.5470 \| 0.9511 \| 0.8123 \| 0.9333 \|
	\| 0.2621 \| 0.48 \| 80 \| 0.2402 \| 0.7879 \| 0.6824 \| 0.7314 \| 0.5765 \| 0.9539 \| 0.8319 \| 0.9354 \|
	\| 0.2464 \| 0.55 \| 90 \| 0.2262 \| 0.8304 \| 0.6660 \| 0.7391 \| 0.5862 \| 0.9568 \| 0.8261 \| 0.9384 \|
	\| 0.21 \| 0.61 \| 100 \| 0.2186 \| 0.7990 \| 0.7131 \| 0.7536 \| 0.6047 \| 0.9571 \| 0.8475 \| 0.9382 \|
	\| 0.2238 \| 0.67 \| 110 \| 0.2042 \| 0.8242 \| 0.6860 \| 0.7487 \| 0.5984 \| 0.9577 \| 0.8356 \| 0.9408 \|
	\| 0.1849 \| 0.73 \| 120 \| 0.1990 \| 0.8799 \| 0.6422 \| 0.7425 \| 0.5904 \| 0.9590 \| 0.8166 \| 0.9432 \|
	\| 0.1702 \| 0.79 \| 130 \| 0.1959 \| 0.7862 \| 0.7436 \| 0.7643 \| 0.6185 \| 0.9578 \| 0.8615 \| 0.9392 \|
	\| 0.2033 \| 0.85 \| 140 \| 0.1939 \| 0.7996 \| 0.7414 \| 0.7694 \| 0.6252 \| 0.9591 \| 0.8613 \| 0.9404 \|
	\| 0.1686 \| 0.91 \| 150 \| 0.1916 \| 0.7982 \| 0.7437 \| 0.7700 \| 0.6260 \| 0.9591 \| 0.8623 \| 0.9410 \|
	\| 0.1484 \| 0.97 \| 160 \| 0.1855 \| 0.7898 \| 0.7597 \| 0.7745 \| 0.6320 \| 0.9593 \| 0.8696 \| 0.9408 \|
	\| 0.1717 \| 1.03 \| 170 \| 0.1864 \| 0.8231 \| 0.7301 \| 0.7738 \| 0.6310 \| 0.9607 \| 0.8571 \| 0.9434 \|
	\| 0.1584 \| 1.09 \| 180 \| 0.1844 \| 0.7919 \| 0.7676 \| 0.7796 \| 0.6388 \| 0.9601 \| 0.8736 \| 0.9414 \|
	\| 0.1455 \| 1.15 \| 190 \| 0.1807 \| 0.8255 \| 0.7496 \| 0.7857 \| 0.6470 \| 0.9624 \| 0.8668 \| 0.9437 \|
	\| 0.1521 \| 1.21 \| 200 \| 0.1746 \| 0.8277 \| 0.7428 \| 0.7829 \| 0.6433 \| 0.9621 \| 0.8636 \| 0.9450 \|
	\| 0.1385 \| 1.27 \| 210 \| 0.1833 \| 0.8099 \| 0.7573 \| 0.7828 \| 0.6431 \| 0.9613 \| 0.8697 \| 0.9430 \|
	\| 0.1246 \| 1.33 \| 220 \| 0.1857 \| 0.7400 \| 0.8164 \| 0.7763 \| 0.6344 \| 0.9567 \| 0.8937 \| 0.9366 \|
	\| 0.1312 \| 1.39 \| 230 \| 0.1738 \| 0.8345 \| 0.7441 \| 0.7867 \| 0.6484 \| 0.9629 \| 0.8646 \| 0.9458 \|
	\| 0.1139 \| 1.45 \| 240 \| 0.1750 \| 0.7964 \| 0.7861 \| 0.7912 \| 0.6545 \| 0.9618 \| 0.8829 \| 0.9428 \|
	\| 0.1181 \| 1.52 \| 250 \| 0.1728 \| 0.8201 \| 0.7578 \| 0.7877 \| 0.6498 \| 0.9624 \| 0.8705 \| 0.9448 \|
	\| 0.1248 \| 1.58 \| 260 \| 0.1774 \| 0.8148 \| 0.7727 \| 0.7932 \| 0.6573 \| 0.9629 \| 0.8775 \| 0.9441 \|
	\| 0.1384 \| 1.64 \| 270 \| 0.1748 \| 0.7840 \| 0.7925 \| 0.7882 \| 0.6505 \| 0.9608 \| 0.8852 \| 0.9418 \|
	\| 0.1068 \| 1.7 \| 280 \| 0.1744 \| 0.7943 \| 0.7950 \| 0.7947 \| 0.6593 \| 0.9622 \| 0.8871 \| 0.9430 \|
	\| 0.114 \| 1.76 \| 290 \| 0.1749 \| 0.7916 \| 0.7904 \| 0.7910 \| 0.6543 \| 0.9616 \| 0.8847 \| 0.9428 \|
	\| 0.1214 \| 1.82 \| 300 \| 0.1778 \| 0.7551 \| 0.8233 \| 0.7877 \| 0.6498 \| 0.9592 \| 0.8981 \| 0.9392 \|
	\| 0.1139 \| 1.88 \| 310 \| 0.1764 \| 0.7897 \| 0.7839 \| 0.7868 \| 0.6485 \| 0.9609 \| 0.8814 \| 0.9425 \|
	\| 0.1254 \| 1.94 \| 320 \| 0.1771 \| 0.7908 \| 0.7925 \| 0.7916 \| 0.6551 \| 0.9616 \| 0.8856 \| 0.9427 \|
	\| 0.1001 \| 2.0 \| 330 \| 0.1715 \| 0.8057 \| 0.7829 \| 0.7942 \| 0.6586 \| 0.9627 \| 0.8819 \| 0.9445 \|
	\| 0.0989 \| 2.06 \| 340 \| 0.1705 \| 0.8099 \| 0.7803 \| 0.7948 \| 0.6595 \| 0.9629 \| 0.8809 \| 0.9446 \|
	\| 0.1222 \| 2.12 \| 350 \| 0.1761 \| 0.7843 \| 0.7991 \| 0.7916 \| 0.6551 \| 0.9613 \| 0.8884 \| 0.9422 \|
	\| 0.1032 \| 2.18 \| 360 \| 0.1754 \| 0.7961 \| 0.7864 \| 0.7912 \| 0.6545 \| 0.9618 \| 0.8830 \| 0.9432 \|
	\| 0.0799 \| 2.24 \| 370 \| 0.1753 \| 0.7867 \| 0.7879 \| 0.7873 \| 0.6492 \| 0.9608 \| 0.8831 \| 0.9432 \|
	\| 0.099 \| 2.3 \| 380 \| 0.1751 \| 0.8101 \| 0.7738 \| 0.7915 \| 0.6549 \| 0.9625 \| 0.8777 \| 0.9451 \|
	\| 0.0993 \| 2.36 \| 390 \| 0.1699 \| 0.8073 \| 0.7791 \| 0.7929 \| 0.6569 \| 0.9626 \| 0.8801 \| 0.9454 \|
	\| 0.1025 \| 2.42 \| 400 \| 0.1662 \| 0.8203 \| 0.7764 \| 0.7978 \| 0.6636 \| 0.9638 \| 0.8796 \| 0.9465 \|
	\| 0.1081 \| 2.48 \| 410 \| 0.1762 \| 0.8005 \| 0.7893 \| 0.7949 \| 0.6596 \| 0.9625 \| 0.8847 \| 0.9444 \|
	\| 0.1118 \| 2.55 \| 420 \| 0.1720 \| 0.8130 \| 0.7755 \| 0.7938 \| 0.6582 \| 0.9630 \| 0.8787 \| 0.9458 \|
	\| 0.0779 \| 2.61 \| 430 \| 0.1712 \| 0.8131 \| 0.7797 \| 0.7961 \| 0.6612 \| 0.9633 \| 0.8808 \| 0.9454 \|
	\| 0.0944 \| 2.67 \| 440 \| 0.1788 \| 0.7754 \| 0.8094 \| 0.7921 \| 0.6557 \| 0.9609 \| 0.8928 \| 0.9419 \|
	\| 0.1053 \| 2.73 \| 450 \| 0.1696 \| 0.7980 \| 0.7901 \| 0.7940 \| 0.6584 \| 0.9623 \| 0.8849 \| 0.9450 \|
	\| 0.0889 \| 2.79 \| 460 \| 0.1719 \| 0.8215 \| 0.7736 \| 0.7968 \| 0.6623 \| 0.9637 \| 0.8783 \| 0.9465 \|
	\| 0.0879 \| 2.85 \| 470 \| 0.1712 \| 0.8091 \| 0.7828 \| 0.7957 \| 0.6608 \| 0.9630 \| 0.8820 \| 0.9457 \|
	\| 0.0867 \| 2.91 \| 480 \| 0.1769 \| 0.8021 \| 0.78 \| 0.7909 \| 0.6541 \| 0.9621 \| 0.8803 \| 0.9447 \|
	\| 0.0787 \| 2.97 \| 490 \| 0.1788 \| 0.8044 \| 0.7831 \| 0.7936 \| 0.6578 \| 0.9625 \| 0.8819 \| 0.9447 \|
	\| 0.0945 \| 3.03 \| 500 \| 0.1736 \| 0.8055 \| 0.7820 \| 0.7936 \| 0.6578 \| 0.9626 \| 0.8815 \| 0.9445 \|
	\| 0.1011 \| 3.09 \| 510 \| 0.1823 \| 0.7881 \| 0.7962 \| 0.7921 \| 0.6558 \| 0.9616 \| 0.8873 \| 0.9432 \|
	\| 0.0914 \| 3.15 \| 520 \| 0.1819 \| 0.7958 \| 0.7939 \| 0.7948 \| 0.6595 \| 0.9623 \| 0.8866 \| 0.9438 \|
	\| 0.0837 \| 3.21 \| 530 \| 0.1738 \| 0.8129 \| 0.7857 \| 0.7991 \| 0.6654 \| 0.9637 \| 0.8837 \| 0.9460 \|
	\| 0.0776 \| 3.27 \| 540 \| 0.1828 \| 0.7921 \| 0.7961 \| 0.7941 \| 0.6585 \| 0.9620 \| 0.8874 \| 0.9437 \|
	\| 0.0916 \| 3.33 \| 550 \| 0.1776 \| 0.7835 \| 0.7994 \| 0.7913 \| 0.6547 \| 0.9612 \| 0.8885 \| 0.9433 \|
	\| 0.081 \| 3.39 \| 560 \| 0.1784 \| 0.7784 \| 0.8033 \| 0.7907 \| 0.6538 \| 0.9609 \| 0.8901 \| 0.9428 \|
	\| 0.0867 \| 3.45 \| 570 \| 0.1793 \| 0.7728 \| 0.8074 \| 0.7897 \| 0.6525 \| 0.9605 \| 0.8917 \| 0.9425 \|
	\| 0.0816 \| 3.52 \| 580 \| 0.1789 \| 0.7829 \| 0.8017 \| 0.7922 \| 0.6559 \| 0.9613 \| 0.8896 \| 0.9433 \|
	\| 0.0808 \| 3.58 \| 590 \| 0.1791 \| 0.7890 \| 0.7941 \| 0.7916 \| 0.6550 \| 0.9615 \| 0.8863 \| 0.9435 \|
	\| 0.07 \| 3.64 \| 600 \| 0.1844 \| 0.7697 \| 0.8071 \| 0.7880 \| 0.6501 \| 0.9600 \| 0.8913 \| 0.9420 \|
	\| 0.0775 \| 3.7 \| 610 \| 0.1795 \| 0.7849 \| 0.7957 \| 0.7902 \| 0.6532 \| 0.9612 \| 0.8868 \| 0.9433 \|
	\| 0.0722 \| 3.76 \| 620 \| 0.1772 \| 0.7993 \| 0.7814 \| 0.7903 \| 0.6532 \| 0.9619 \| 0.8808 \| 0.9449 \|
	\| 0.0786 \| 3.82 \| 630 \| 0.1775 \| 0.8159 \| 0.7763 \| 0.7956 \| 0.6606 \| 0.9633 \| 0.8793 \| 0.9457 \|
	\| 0.0768 \| 3.88 \| 640 \| 0.1823 \| 0.8015 \| 0.7848 \| 0.7931 \| 0.6571 \| 0.9623 \| 0.8826 \| 0.9442 \|
	\| 0.0728 \| 3.94 \| 650 \| 0.1806 \| 0.7918 \| 0.7885 \| 0.7901 \| 0.6531 \| 0.9615 \| 0.8838 \| 0.9438 \|
	\| 0.0762 \| 4.0 \| 660 \| 0.1831 \| 0.7881 \| 0.7935 \| 0.7908 \| 0.6540 \| 0.9614 \| 0.8859 \| 0.9435 \|
	\| 0.0776 \| 4.06 \| 670 \| 0.1788 \| 0.8015 \| 0.7847 \| 0.7930 \| 0.6570 \| 0.9623 \| 0.8825 \| 0.9453 \|
	\| 0.0843 \| 4.12 \| 680 \| 0.1824 \| 0.8009 \| 0.7876 \| 0.7942 \| 0.6587 \| 0.9625 \| 0.8839 \| 0.9445 \|
	\| 0.066 \| 4.18 \| 690 \| 0.1843 \| 0.7921 \| 0.7918 \| 0.7920 \| 0.6556 \| 0.9617 \| 0.8854 \| 0.9440 \|
	\| 0.0832 \| 4.24 \| 700 \| 0.1781 \| 0.7957 \| 0.7893 \| 0.7925 \| 0.6563 \| 0.9620 \| 0.8844 \| 0.9447 \|
	\| 0.0761 \| 4.3 \| 710 \| 0.1871 \| 0.7817 \| 0.8017 \| 0.7916 \| 0.6550 \| 0.9612 \| 0.8895 \| 0.9428 \|
	\| 0.0696 \| 4.36 \| 720 \| 0.1813 \| 0.7957 \| 0.7924 \| 0.7940 \| 0.6584 \| 0.9622 \| 0.8859 \| 0.9446 \|
	\| 0.0734 \| 4.42 \| 730 \| 0.1827 \| 0.7934 \| 0.7938 \| 0.7936 \| 0.6578 \| 0.9620 \| 0.8864 \| 0.9444 \|
	\| 0.0823 \| 4.48 \| 740 \| 0.1856 \| 0.7956 \| 0.7913 \| 0.7935 \| 0.6576 \| 0.9621 \| 0.8854 \| 0.9443 \|
	\| 0.0662 \| 4.55 \| 750 \| 0.1790 \| 0.7890 \| 0.7952 \| 0.7921 \| 0.6557 \| 0.9616 \| 0.8868 \| 0.9444 \|
	\| 0.0775 \| 4.61 \| 760 \| 0.1858 \| 0.7899 \| 0.7953 \| 0.7926 \| 0.6564 \| 0.9617 \| 0.8869 \| 0.9439 \|
	\| 0.0764 \| 4.67 \| 770 \| 0.1853 \| 0.7852 \| 0.8011 \| 0.7931 \| 0.6572 \| 0.9616 \| 0.8895 \| 0.9436 \|
	\| 0.0689 \| 4.73 \| 780 \| 0.1804 \| 0.7964 \| 0.7924 \| 0.7944 \| 0.6589 \| 0.9623 \| 0.8859 \| 0.9445 \|
	\| 0.0785 \| 4.79 \| 790 \| 0.1817 \| 0.7937 \| 0.7921 \| 0.7929 \| 0.6569 \| 0.9619 \| 0.8856 \| 0.9444 \|
	\| 0.075 \| 4.85 \| 800 \| 0.1856 \| 0.7912 \| 0.7929 \| 0.7920 \| 0.6556 \| 0.9617 \| 0.8858 \| 0.9440 \|
	\| 0.0691 \| 4.91 \| 810 \| 0.1844 \| 0.7805 \| 0.8 \| 0.7901 \| 0.6531 \| 0.9609 \| 0.8886 \| 0.9432 \|
	\| 0.0835 \| 4.97 \| 820 \| 0.1829 \| 0.7984 \| 0.7911 \| 0.7947 \| 0.6594 \| 0.9624 \| 0.8854 \| 0.9448 \|
	\| 0.0712 \| 5.03 \| 830 \| 0.1820 \| 0.7906 \| 0.7927 \| 0.7917 \| 0.6552 \| 0.9616 \| 0.8857 \| 0.9443 \|
	\| 0.0594 \| 5.09 \| 840 \| 0.1841 \| 0.7902 \| 0.7948 \| 0.7925 \| 0.6563 \| 0.9617 \| 0.8867 \| 0.9441 \|
	\| 0.0775 \| 5.15 \| 850 \| 0.1834 \| 0.7927 \| 0.7936 \| 0.7932 \| 0.6572 \| 0.9619 \| 0.8863 \| 0.9444 \|
	\| 0.0755 \| 5.21 \| 860 \| 0.1833 \| 0.7924 \| 0.7944 \| 0.7934 \| 0.6575 \| 0.9619 \| 0.8867 \| 0.9444 \|
	\| 0.0717 \| 5.27 \| 870 \| 0.1838 \| 0.7902 \| 0.7958 \| 0.7930 \| 0.6570 \| 0.9618 \| 0.8872 \| 0.9443 \|
	\| 0.0694 \| 5.33 \| 880 \| 0.1834 \| 0.7918 \| 0.7939 \| 0.7928 \| 0.6568 \| 0.9618 \| 0.8864 \| 0.9444 \|
	\| 0.0759 \| 5.39 \| 890 \| 0.1826 \| 0.7905 \| 0.7954 \| 0.7929 \| 0.6569 \| 0.9618 \| 0.8870 \| 0.9443 \|
	\| 0.0666 \| 5.45 \| 900 \| 0.1821 \| 0.7945 \| 0.7922 \| 0.7933 \| 0.6575 \| 0.9620 \| 0.8857 \| 0.9446 \|
	\| 0.08 \| 5.52 \| 910 \| 0.1829 \| 0.7924 \| 0.7953 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8871 \| 0.9444 \|
	\| 0.0816 \| 5.58 \| 920 \| 0.1837 \| 0.7918 \| 0.7954 \| 0.7936 \| 0.6578 \| 0.9619 \| 0.8871 \| 0.9443 \|
	\| 0.0762 \| 5.64 \| 930 \| 0.1837 \| 0.7922 \| 0.7954 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8871 \| 0.9443 \|
	\| 0.0655 \| 5.7 \| 940 \| 0.1843 \| 0.7906 \| 0.7962 \| 0.7934 \| 0.6575 \| 0.9619 \| 0.8874 \| 0.9442 \|
	\| 0.0737 \| 5.76 \| 950 \| 0.1846 \| 0.7904 \| 0.7964 \| 0.7934 \| 0.6576 \| 0.9619 \| 0.8875 \| 0.9441 \|
	\| 0.0717 \| 5.82 \| 960 \| 0.1846 \| 0.7905 \| 0.7961 \| 0.7933 \| 0.6574 \| 0.9618 \| 0.8873 \| 0.9441 \|
	\| 0.0829 \| 5.88 \| 970 \| 0.1845 \| 0.7917 \| 0.7954 \| 0.7935 \| 0.6577 \| 0.9619 \| 0.8871 \| 0.9443 \|
	\| 0.0766 \| 5.94 \| 980 \| 0.1844 \| 0.7924 \| 0.7952 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8870 \| 0.9443 \|
	\| 0.0704 \| 6.0 \| 990 \| 0.1844 \| 0.7925 \| 0.7950 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8870 \| 0.9443 \|
	\| 0.0755 \| 6.06 \| 1000 \| 0.1844 \| 0.7925 \| 0.7950 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8870 \| 0.9443 \|


	### Framework versions

	- Transformers 4.34.1
	- Pytorch 2.0.1
	- Datasets 2.14.6
	- Tokenizers 0.14.1

	---
	license: mit
	base_model: prajjwal1/bert-mini
	tags:
	- generated_from_trainer
	metrics:
	- precision
	- recall
	- f1
	- accuracy
	model-index:
	- name: sembr2023-bert-mini
	results: []
	---

	<!-- This model card has been generated automatically according to the information the Trainer had access to. You
	should probably proofread and complete it, then remove this comment. -->

	# sembr2023-bert-mini

	This model is a fine-tuned version of [prajjwal1/bert-mini](https://huggingface.co/prajjwal1/bert-mini) on an unknown dataset.
	It achieves the following results on the evaluation set:
	- Loss: 0.1844
	- Precision: 0.7925
	- Recall: 0.7950
	- F1: 0.7938
	- Iou: 0.6581
	- Accuracy: 0.9620
	- Balanced Accuracy: 0.8870
	- Overall Accuracy: 0.9443

	## Model description

	More information needed

	## Intended uses & limitations

	More information needed

	## Training and evaluation data

	More information needed

	## Training procedure

	### Training hyperparameters

	The following hyperparameters were used during training:
	- learning_rate: 0.0001
	- train_batch_size: 64
	- eval_batch_size: 128
	- seed: 42
	- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
	- lr_scheduler_type: cosine
	- training_steps: 1000

	### Training results

	\| Training Loss \| Epoch \| Step \| Validation Loss \| Precision \| Recall \| F1 \| Iou \| Accuracy \| Balanced Accuracy \| Overall Accuracy \|
	\|:-------------:\|:-----:\|:----:\|:---------------:\|:---------:\|:------:\|:------:\|:------:\|:--------:\|:-----------------:\|:----------------:\|
	\| 0.5028 \| 0.06 \| 10 \| 0.5036 \| 0 \| 0.0 \| 0.0 \| 0.0 \| 0.9080 \| 0.5 \| 0.9080 \|
	\| 0.417 \| 0.12 \| 20 \| 0.4416 \| 0 \| 0.0 \| 0.0 \| 0.0 \| 0.9080 \| 0.5 \| 0.9080 \|
	\| 0.4292 \| 0.18 \| 30 \| 0.4298 \| 0 \| 0.0 \| 0.0 \| 0.0 \| 0.9080 \| 0.5 \| 0.9080 \|
	\| 0.3964 \| 0.24 \| 40 \| 0.4121 \| 0 \| 0.0 \| 0.0 \| 0.0 \| 0.9080 \| 0.5 \| 0.9080 \|
	\| 0.3611 \| 0.3 \| 50 \| 0.3619 \| 0.5833 \| 0.0080 \| 0.0158 \| 0.0080 \| 0.9082 \| 0.5037 \| 0.9081 \|
	\| 0.3201 \| 0.36 \| 60 \| 0.3103 \| 0.6414 \| 0.5085 \| 0.5673 \| 0.3960 \| 0.9287 \| 0.7399 \| 0.9146 \|
	\| 0.2983 \| 0.42 \| 70 \| 0.2575 \| 0.7866 \| 0.6423 \| 0.7072 \| 0.5470 \| 0.9511 \| 0.8123 \| 0.9333 \|
	\| 0.2621 \| 0.48 \| 80 \| 0.2402 \| 0.7879 \| 0.6824 \| 0.7314 \| 0.5765 \| 0.9539 \| 0.8319 \| 0.9354 \|
	\| 0.2464 \| 0.55 \| 90 \| 0.2262 \| 0.8304 \| 0.6660 \| 0.7391 \| 0.5862 \| 0.9568 \| 0.8261 \| 0.9384 \|
	\| 0.21 \| 0.61 \| 100 \| 0.2186 \| 0.7990 \| 0.7131 \| 0.7536 \| 0.6047 \| 0.9571 \| 0.8475 \| 0.9382 \|
	\| 0.2238 \| 0.67 \| 110 \| 0.2042 \| 0.8242 \| 0.6860 \| 0.7487 \| 0.5984 \| 0.9577 \| 0.8356 \| 0.9408 \|
	\| 0.1849 \| 0.73 \| 120 \| 0.1990 \| 0.8799 \| 0.6422 \| 0.7425 \| 0.5904 \| 0.9590 \| 0.8166 \| 0.9432 \|
	\| 0.1702 \| 0.79 \| 130 \| 0.1959 \| 0.7862 \| 0.7436 \| 0.7643 \| 0.6185 \| 0.9578 \| 0.8615 \| 0.9392 \|
	\| 0.2033 \| 0.85 \| 140 \| 0.1939 \| 0.7996 \| 0.7414 \| 0.7694 \| 0.6252 \| 0.9591 \| 0.8613 \| 0.9404 \|
	\| 0.1686 \| 0.91 \| 150 \| 0.1916 \| 0.7982 \| 0.7437 \| 0.7700 \| 0.6260 \| 0.9591 \| 0.8623 \| 0.9410 \|
	\| 0.1484 \| 0.97 \| 160 \| 0.1855 \| 0.7898 \| 0.7597 \| 0.7745 \| 0.6320 \| 0.9593 \| 0.8696 \| 0.9408 \|
	\| 0.1717 \| 1.03 \| 170 \| 0.1864 \| 0.8231 \| 0.7301 \| 0.7738 \| 0.6310 \| 0.9607 \| 0.8571 \| 0.9434 \|
	\| 0.1584 \| 1.09 \| 180 \| 0.1844 \| 0.7919 \| 0.7676 \| 0.7796 \| 0.6388 \| 0.9601 \| 0.8736 \| 0.9414 \|
	\| 0.1455 \| 1.15 \| 190 \| 0.1807 \| 0.8255 \| 0.7496 \| 0.7857 \| 0.6470 \| 0.9624 \| 0.8668 \| 0.9437 \|
	\| 0.1521 \| 1.21 \| 200 \| 0.1746 \| 0.8277 \| 0.7428 \| 0.7829 \| 0.6433 \| 0.9621 \| 0.8636 \| 0.9450 \|
	\| 0.1385 \| 1.27 \| 210 \| 0.1833 \| 0.8099 \| 0.7573 \| 0.7828 \| 0.6431 \| 0.9613 \| 0.8697 \| 0.9430 \|
	\| 0.1246 \| 1.33 \| 220 \| 0.1857 \| 0.7400 \| 0.8164 \| 0.7763 \| 0.6344 \| 0.9567 \| 0.8937 \| 0.9366 \|
	\| 0.1312 \| 1.39 \| 230 \| 0.1738 \| 0.8345 \| 0.7441 \| 0.7867 \| 0.6484 \| 0.9629 \| 0.8646 \| 0.9458 \|
	\| 0.1139 \| 1.45 \| 240 \| 0.1750 \| 0.7964 \| 0.7861 \| 0.7912 \| 0.6545 \| 0.9618 \| 0.8829 \| 0.9428 \|
	\| 0.1181 \| 1.52 \| 250 \| 0.1728 \| 0.8201 \| 0.7578 \| 0.7877 \| 0.6498 \| 0.9624 \| 0.8705 \| 0.9448 \|
	\| 0.1248 \| 1.58 \| 260 \| 0.1774 \| 0.8148 \| 0.7727 \| 0.7932 \| 0.6573 \| 0.9629 \| 0.8775 \| 0.9441 \|
	\| 0.1384 \| 1.64 \| 270 \| 0.1748 \| 0.7840 \| 0.7925 \| 0.7882 \| 0.6505 \| 0.9608 \| 0.8852 \| 0.9418 \|
	\| 0.1068 \| 1.7 \| 280 \| 0.1744 \| 0.7943 \| 0.7950 \| 0.7947 \| 0.6593 \| 0.9622 \| 0.8871 \| 0.9430 \|
	\| 0.114 \| 1.76 \| 290 \| 0.1749 \| 0.7916 \| 0.7904 \| 0.7910 \| 0.6543 \| 0.9616 \| 0.8847 \| 0.9428 \|
	\| 0.1214 \| 1.82 \| 300 \| 0.1778 \| 0.7551 \| 0.8233 \| 0.7877 \| 0.6498 \| 0.9592 \| 0.8981 \| 0.9392 \|
	\| 0.1139 \| 1.88 \| 310 \| 0.1764 \| 0.7897 \| 0.7839 \| 0.7868 \| 0.6485 \| 0.9609 \| 0.8814 \| 0.9425 \|
	\| 0.1254 \| 1.94 \| 320 \| 0.1771 \| 0.7908 \| 0.7925 \| 0.7916 \| 0.6551 \| 0.9616 \| 0.8856 \| 0.9427 \|
	\| 0.1001 \| 2.0 \| 330 \| 0.1715 \| 0.8057 \| 0.7829 \| 0.7942 \| 0.6586 \| 0.9627 \| 0.8819 \| 0.9445 \|
	\| 0.0989 \| 2.06 \| 340 \| 0.1705 \| 0.8099 \| 0.7803 \| 0.7948 \| 0.6595 \| 0.9629 \| 0.8809 \| 0.9446 \|
	\| 0.1222 \| 2.12 \| 350 \| 0.1761 \| 0.7843 \| 0.7991 \| 0.7916 \| 0.6551 \| 0.9613 \| 0.8884 \| 0.9422 \|
	\| 0.1032 \| 2.18 \| 360 \| 0.1754 \| 0.7961 \| 0.7864 \| 0.7912 \| 0.6545 \| 0.9618 \| 0.8830 \| 0.9432 \|
	\| 0.0799 \| 2.24 \| 370 \| 0.1753 \| 0.7867 \| 0.7879 \| 0.7873 \| 0.6492 \| 0.9608 \| 0.8831 \| 0.9432 \|
	\| 0.099 \| 2.3 \| 380 \| 0.1751 \| 0.8101 \| 0.7738 \| 0.7915 \| 0.6549 \| 0.9625 \| 0.8777 \| 0.9451 \|
	\| 0.0993 \| 2.36 \| 390 \| 0.1699 \| 0.8073 \| 0.7791 \| 0.7929 \| 0.6569 \| 0.9626 \| 0.8801 \| 0.9454 \|
	\| 0.1025 \| 2.42 \| 400 \| 0.1662 \| 0.8203 \| 0.7764 \| 0.7978 \| 0.6636 \| 0.9638 \| 0.8796 \| 0.9465 \|
	\| 0.1081 \| 2.48 \| 410 \| 0.1762 \| 0.8005 \| 0.7893 \| 0.7949 \| 0.6596 \| 0.9625 \| 0.8847 \| 0.9444 \|
	\| 0.1118 \| 2.55 \| 420 \| 0.1720 \| 0.8130 \| 0.7755 \| 0.7938 \| 0.6582 \| 0.9630 \| 0.8787 \| 0.9458 \|
	\| 0.0779 \| 2.61 \| 430 \| 0.1712 \| 0.8131 \| 0.7797 \| 0.7961 \| 0.6612 \| 0.9633 \| 0.8808 \| 0.9454 \|
	\| 0.0944 \| 2.67 \| 440 \| 0.1788 \| 0.7754 \| 0.8094 \| 0.7921 \| 0.6557 \| 0.9609 \| 0.8928 \| 0.9419 \|
	\| 0.1053 \| 2.73 \| 450 \| 0.1696 \| 0.7980 \| 0.7901 \| 0.7940 \| 0.6584 \| 0.9623 \| 0.8849 \| 0.9450 \|
	\| 0.0889 \| 2.79 \| 460 \| 0.1719 \| 0.8215 \| 0.7736 \| 0.7968 \| 0.6623 \| 0.9637 \| 0.8783 \| 0.9465 \|
	\| 0.0879 \| 2.85 \| 470 \| 0.1712 \| 0.8091 \| 0.7828 \| 0.7957 \| 0.6608 \| 0.9630 \| 0.8820 \| 0.9457 \|
	\| 0.0867 \| 2.91 \| 480 \| 0.1769 \| 0.8021 \| 0.78 \| 0.7909 \| 0.6541 \| 0.9621 \| 0.8803 \| 0.9447 \|
	\| 0.0787 \| 2.97 \| 490 \| 0.1788 \| 0.8044 \| 0.7831 \| 0.7936 \| 0.6578 \| 0.9625 \| 0.8819 \| 0.9447 \|
	\| 0.0945 \| 3.03 \| 500 \| 0.1736 \| 0.8055 \| 0.7820 \| 0.7936 \| 0.6578 \| 0.9626 \| 0.8815 \| 0.9445 \|
	\| 0.1011 \| 3.09 \| 510 \| 0.1823 \| 0.7881 \| 0.7962 \| 0.7921 \| 0.6558 \| 0.9616 \| 0.8873 \| 0.9432 \|
	\| 0.0914 \| 3.15 \| 520 \| 0.1819 \| 0.7958 \| 0.7939 \| 0.7948 \| 0.6595 \| 0.9623 \| 0.8866 \| 0.9438 \|
	\| 0.0837 \| 3.21 \| 530 \| 0.1738 \| 0.8129 \| 0.7857 \| 0.7991 \| 0.6654 \| 0.9637 \| 0.8837 \| 0.9460 \|
	\| 0.0776 \| 3.27 \| 540 \| 0.1828 \| 0.7921 \| 0.7961 \| 0.7941 \| 0.6585 \| 0.9620 \| 0.8874 \| 0.9437 \|
	\| 0.0916 \| 3.33 \| 550 \| 0.1776 \| 0.7835 \| 0.7994 \| 0.7913 \| 0.6547 \| 0.9612 \| 0.8885 \| 0.9433 \|
	\| 0.081 \| 3.39 \| 560 \| 0.1784 \| 0.7784 \| 0.8033 \| 0.7907 \| 0.6538 \| 0.9609 \| 0.8901 \| 0.9428 \|
	\| 0.0867 \| 3.45 \| 570 \| 0.1793 \| 0.7728 \| 0.8074 \| 0.7897 \| 0.6525 \| 0.9605 \| 0.8917 \| 0.9425 \|
	\| 0.0816 \| 3.52 \| 580 \| 0.1789 \| 0.7829 \| 0.8017 \| 0.7922 \| 0.6559 \| 0.9613 \| 0.8896 \| 0.9433 \|
	\| 0.0808 \| 3.58 \| 590 \| 0.1791 \| 0.7890 \| 0.7941 \| 0.7916 \| 0.6550 \| 0.9615 \| 0.8863 \| 0.9435 \|
	\| 0.07 \| 3.64 \| 600 \| 0.1844 \| 0.7697 \| 0.8071 \| 0.7880 \| 0.6501 \| 0.9600 \| 0.8913 \| 0.9420 \|
	\| 0.0775 \| 3.7 \| 610 \| 0.1795 \| 0.7849 \| 0.7957 \| 0.7902 \| 0.6532 \| 0.9612 \| 0.8868 \| 0.9433 \|
	\| 0.0722 \| 3.76 \| 620 \| 0.1772 \| 0.7993 \| 0.7814 \| 0.7903 \| 0.6532 \| 0.9619 \| 0.8808 \| 0.9449 \|
	\| 0.0786 \| 3.82 \| 630 \| 0.1775 \| 0.8159 \| 0.7763 \| 0.7956 \| 0.6606 \| 0.9633 \| 0.8793 \| 0.9457 \|
	\| 0.0768 \| 3.88 \| 640 \| 0.1823 \| 0.8015 \| 0.7848 \| 0.7931 \| 0.6571 \| 0.9623 \| 0.8826 \| 0.9442 \|
	\| 0.0728 \| 3.94 \| 650 \| 0.1806 \| 0.7918 \| 0.7885 \| 0.7901 \| 0.6531 \| 0.9615 \| 0.8838 \| 0.9438 \|
	\| 0.0762 \| 4.0 \| 660 \| 0.1831 \| 0.7881 \| 0.7935 \| 0.7908 \| 0.6540 \| 0.9614 \| 0.8859 \| 0.9435 \|
	\| 0.0776 \| 4.06 \| 670 \| 0.1788 \| 0.8015 \| 0.7847 \| 0.7930 \| 0.6570 \| 0.9623 \| 0.8825 \| 0.9453 \|
	\| 0.0843 \| 4.12 \| 680 \| 0.1824 \| 0.8009 \| 0.7876 \| 0.7942 \| 0.6587 \| 0.9625 \| 0.8839 \| 0.9445 \|
	\| 0.066 \| 4.18 \| 690 \| 0.1843 \| 0.7921 \| 0.7918 \| 0.7920 \| 0.6556 \| 0.9617 \| 0.8854 \| 0.9440 \|
	\| 0.0832 \| 4.24 \| 700 \| 0.1781 \| 0.7957 \| 0.7893 \| 0.7925 \| 0.6563 \| 0.9620 \| 0.8844 \| 0.9447 \|
	\| 0.0761 \| 4.3 \| 710 \| 0.1871 \| 0.7817 \| 0.8017 \| 0.7916 \| 0.6550 \| 0.9612 \| 0.8895 \| 0.9428 \|
	\| 0.0696 \| 4.36 \| 720 \| 0.1813 \| 0.7957 \| 0.7924 \| 0.7940 \| 0.6584 \| 0.9622 \| 0.8859 \| 0.9446 \|
	\| 0.0734 \| 4.42 \| 730 \| 0.1827 \| 0.7934 \| 0.7938 \| 0.7936 \| 0.6578 \| 0.9620 \| 0.8864 \| 0.9444 \|
	\| 0.0823 \| 4.48 \| 740 \| 0.1856 \| 0.7956 \| 0.7913 \| 0.7935 \| 0.6576 \| 0.9621 \| 0.8854 \| 0.9443 \|
	\| 0.0662 \| 4.55 \| 750 \| 0.1790 \| 0.7890 \| 0.7952 \| 0.7921 \| 0.6557 \| 0.9616 \| 0.8868 \| 0.9444 \|
	\| 0.0775 \| 4.61 \| 760 \| 0.1858 \| 0.7899 \| 0.7953 \| 0.7926 \| 0.6564 \| 0.9617 \| 0.8869 \| 0.9439 \|
	\| 0.0764 \| 4.67 \| 770 \| 0.1853 \| 0.7852 \| 0.8011 \| 0.7931 \| 0.6572 \| 0.9616 \| 0.8895 \| 0.9436 \|
	\| 0.0689 \| 4.73 \| 780 \| 0.1804 \| 0.7964 \| 0.7924 \| 0.7944 \| 0.6589 \| 0.9623 \| 0.8859 \| 0.9445 \|
	\| 0.0785 \| 4.79 \| 790 \| 0.1817 \| 0.7937 \| 0.7921 \| 0.7929 \| 0.6569 \| 0.9619 \| 0.8856 \| 0.9444 \|
	\| 0.075 \| 4.85 \| 800 \| 0.1856 \| 0.7912 \| 0.7929 \| 0.7920 \| 0.6556 \| 0.9617 \| 0.8858 \| 0.9440 \|
	\| 0.0691 \| 4.91 \| 810 \| 0.1844 \| 0.7805 \| 0.8 \| 0.7901 \| 0.6531 \| 0.9609 \| 0.8886 \| 0.9432 \|
	\| 0.0835 \| 4.97 \| 820 \| 0.1829 \| 0.7984 \| 0.7911 \| 0.7947 \| 0.6594 \| 0.9624 \| 0.8854 \| 0.9448 \|
	\| 0.0712 \| 5.03 \| 830 \| 0.1820 \| 0.7906 \| 0.7927 \| 0.7917 \| 0.6552 \| 0.9616 \| 0.8857 \| 0.9443 \|
	\| 0.0594 \| 5.09 \| 840 \| 0.1841 \| 0.7902 \| 0.7948 \| 0.7925 \| 0.6563 \| 0.9617 \| 0.8867 \| 0.9441 \|
	\| 0.0775 \| 5.15 \| 850 \| 0.1834 \| 0.7927 \| 0.7936 \| 0.7932 \| 0.6572 \| 0.9619 \| 0.8863 \| 0.9444 \|
	\| 0.0755 \| 5.21 \| 860 \| 0.1833 \| 0.7924 \| 0.7944 \| 0.7934 \| 0.6575 \| 0.9619 \| 0.8867 \| 0.9444 \|
	\| 0.0717 \| 5.27 \| 870 \| 0.1838 \| 0.7902 \| 0.7958 \| 0.7930 \| 0.6570 \| 0.9618 \| 0.8872 \| 0.9443 \|
	\| 0.0694 \| 5.33 \| 880 \| 0.1834 \| 0.7918 \| 0.7939 \| 0.7928 \| 0.6568 \| 0.9618 \| 0.8864 \| 0.9444 \|
	\| 0.0759 \| 5.39 \| 890 \| 0.1826 \| 0.7905 \| 0.7954 \| 0.7929 \| 0.6569 \| 0.9618 \| 0.8870 \| 0.9443 \|
	\| 0.0666 \| 5.45 \| 900 \| 0.1821 \| 0.7945 \| 0.7922 \| 0.7933 \| 0.6575 \| 0.9620 \| 0.8857 \| 0.9446 \|
	\| 0.08 \| 5.52 \| 910 \| 0.1829 \| 0.7924 \| 0.7953 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8871 \| 0.9444 \|
	\| 0.0816 \| 5.58 \| 920 \| 0.1837 \| 0.7918 \| 0.7954 \| 0.7936 \| 0.6578 \| 0.9619 \| 0.8871 \| 0.9443 \|
	\| 0.0762 \| 5.64 \| 930 \| 0.1837 \| 0.7922 \| 0.7954 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8871 \| 0.9443 \|
	\| 0.0655 \| 5.7 \| 940 \| 0.1843 \| 0.7906 \| 0.7962 \| 0.7934 \| 0.6575 \| 0.9619 \| 0.8874 \| 0.9442 \|
	\| 0.0737 \| 5.76 \| 950 \| 0.1846 \| 0.7904 \| 0.7964 \| 0.7934 \| 0.6576 \| 0.9619 \| 0.8875 \| 0.9441 \|
	\| 0.0717 \| 5.82 \| 960 \| 0.1846 \| 0.7905 \| 0.7961 \| 0.7933 \| 0.6574 \| 0.9618 \| 0.8873 \| 0.9441 \|
	\| 0.0829 \| 5.88 \| 970 \| 0.1845 \| 0.7917 \| 0.7954 \| 0.7935 \| 0.6577 \| 0.9619 \| 0.8871 \| 0.9443 \|
	\| 0.0766 \| 5.94 \| 980 \| 0.1844 \| 0.7924 \| 0.7952 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8870 \| 0.9443 \|
	\| 0.0704 \| 6.0 \| 990 \| 0.1844 \| 0.7925 \| 0.7950 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8870 \| 0.9443 \|
	\| 0.0755 \| 6.06 \| 1000 \| 0.1844 \| 0.7925 \| 0.7950 \| 0.7938 \| 0.6581 \| 0.9620 \| 0.8870 \| 0.9443 \|


	### Framework versions

	- Transformers 4.34.1
	- Pytorch 2.0.1
	- Datasets 2.14.6
	- Tokenizers 0.14.1