File size: 879 Bytes
449ed48 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
Qwen2.5-1.5B-Instruct
Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate
IQ1_S 417 193.6245 1.77149
IQ1_M 443 66.9068 0.52878
IQ2_XXS 488 33.3356 0.25559
IQ2_XS 525 20.2870 0.14936
IQ2_S 538 18.2927 0.13380
IQ2_M 574 15.4838 0.11113
Q2_K_S 611 16.0169 0.11623
IQ3_XXS 638 12.3935 0.08770
Q2_K 645 14.1657 0.10105
IQ3_XS 698 11.7112 0.08256
Q3_K_S 726 12.4782 0.08842
IQ3_S 728 11.4241 0.07977
IQ3_M 741 11.4058 0.07862
Q3_K_M 786 11.3529 0.08018
Q3_K_L 840 11.1934 0.07913
IQ4_XS 855 10.5302 0.07351
IQ4_NL 893 10.5116 0.07335
Q4_0 895 10.8217 0.07576
Q4_K_S 897 10.5236 0.07360
Q4_K_M 941 10.4628 0.07310
Q4_1 970 10.5100 0.07347
Q5_K_S 1048 10.2715 0.07148
Q5_0 1051 10.3196 0.07212
Q5_K_M 1073 10.2529 0.07143
Q5_1 1126 10.2624 0.07140
Q6_K 1214 10.2030 0.07108
Q8_0 1571 10.1670 0.07068
F16 2951 10.1512 0.07058
|