Hugging Face's logo

mobiuslabsgmbh
/
Llama-3.1-8b-instruct_4bitgs64_hqq

Text Generation
Transformers
Model card Files Community
1
mobicham commited on
Commit
0b97abf
·
verified ·
1 Parent(s): f6ddfb5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -39,6 +39,7 @@ We provide two versions:
39
  | Winogrande (5-shot)| 77.98 | 76.24 | 76.48 | 76.4 | 76.64 |
40
  | GSM8K (5-shot) | 75.44 | 71.27 | 75.36 | 73.47 | 72.25 |
41
  | Average | 69.51 | 68.00 | <b>69.02</b> | 67.67 | 68.23 |
 
42
 
43
  You can reproduce the results above via `pip install lm-eval==0.4.3`
44
 
 
39
  | Winogrande (5-shot)| 77.98 | 76.24 | 76.48 | 76.4 | 76.64 |
40
  | GSM8K (5-shot) | 75.44 | 71.27 | 75.36 | 73.47 | 72.25 |
41
  | Average | 69.51 | 68.00 | <b>69.02</b> | 67.67 | 68.23 |
42
+ | Relative performance | 100% | 97.83% | <b>99.3%</b> | 97.35% | 98.16% |
43
 
44
  You can reproduce the results above via `pip install lm-eval==0.4.3`
45