Commit
•
e32470f
1
Parent(s):
764c481
Update README.md
Browse files
README.md
CHANGED
|
@@ -90,6 +90,11 @@ This evaluation was done using [LM-Eval](https://github.com/EleutherAI/lm-evalua
|
|
| 90 |
|
| 91 |
[Falcon-40b-Instruct](https://huggingface.co/tiiuae/falcon-40b-instruct)
|
| 92 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 93 |
|
| 94 |
[Falcon-40b-Instruct (4-bit 128-group AWQ)](https://huggingface.co/abhinavkulkarni/tiiuae-falcon-40b-instruct-w4-g128-awq)
|
| 95 |
|
|
|
|
| 90 |
|
| 91 |
[Falcon-40b-Instruct](https://huggingface.co/tiiuae/falcon-40b-instruct)
|
| 92 |
|
| 93 |
+
| Task |Version| Metric |Value | |Stderr|
|
| 94 |
+
|--------|------:|---------------|-----:|---|------|
|
| 95 |
+
|wikitext| 1|word_perplexity|8.8219| | |
|
| 96 |
+
| | |byte_perplexity|1.5025| | |
|
| 97 |
+
| | |bits_per_byte |0.5874| | |
|
| 98 |
|
| 99 |
[Falcon-40b-Instruct (4-bit 128-group AWQ)](https://huggingface.co/abhinavkulkarni/tiiuae-falcon-40b-instruct-w4-g128-awq)
|
| 100 |
|