Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
GGUF Quants with iMatrix for : https://huggingface.co/ShinojiResearch/Senku-70B-Full
|
2 |
|
3 |
-
Q3_K_M
|
4 |
|
5 |
But for IQ2_XS and IQ2_XXS, it's there : https://huggingface.co/dranger003/Senku-70B-iMat.GGUF
|
6 |
|
@@ -18,4 +18,20 @@ LlamaCPP Benchs :
|
|
18 |
|
19 |
The Hellaswag scores might be 5-6 points higher, due to some recent changes in LlamaCPP.
|
20 |
|
21 |
-
Senku is dominant on Arc-Challenge, providing a read bump from the baseline Miqu.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
GGUF Quants with iMatrix for : https://huggingface.co/ShinojiResearch/Senku-70B-Full
|
2 |
|
3 |
+
Q3_K_M, IQ3_XXS, Q2_K, Q2_K_S and Q3_K_S are provided here.
|
4 |
|
5 |
But for IQ2_XS and IQ2_XXS, it's there : https://huggingface.co/dranger003/Senku-70B-iMat.GGUF
|
6 |
|
|
|
18 |
|
19 |
The Hellaswag scores might be 5-6 points higher, due to some recent changes in LlamaCPP.
|
20 |
|
21 |
+
Senku is dominant on Arc-Challenge among Miqu based models, providing a read bump from the baseline Miqu.
|
22 |
+
|
23 |
+
A reflection of its EQ-Bench, highest to date (7/02/2024) among the 70b models?
|
24 |
+
|
25 |
+
On the other hand, the TQA suffers quite a bit.
|
26 |
+
|
27 |
+
Here comes the benchs of its toughest competitor to my knowledge, at equal quant except for the number of chunks of the iMatrix :
|
28 |
+
|
29 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,Hellaswag,84.5,,400,2024-02-07 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,
|
30 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,Hellaswag,83.6,,1000,2024-02-07 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,
|
31 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,Arc-Challenge,58.52842809,,299,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,
|
32 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,Arc-Easy,77.36842105,,570,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,
|
33 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,MMLU,49.84025559,,313,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,
|
34 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,Thruthful-QA,42.83965728,,817,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,
|
35 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,Winogrande,78.7687,,1267,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,
|
36 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,wikitext,4.2963,512,512,2024-02-07 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,81
|
37 |
+
- Undi95_Miqu-70B-Alpaca-DPO-b2101-iMat-c32_ch1000-Q3_K_M.gguf,-,wikitext,3.8397,512,512,2024-02-07 00:00:00,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,Nexesenex,655
|