Update README.md
Browse files
README.md
CHANGED
|
@@ -4,4 +4,6 @@ license: apache-2.0
|
|
| 4 |
|
| 5 |
A test quantization of OpenHermes-2.5-Mistral-7B by teknium using importance matrices computed on Ukrainian text, hopefully decreasing the coherence hit after quantization in Ukrainian at the cost of some performance in other languages.
|
| 6 |
|
|
|
|
|
|
|
| 7 |
Will be updated with perplexity testing later.
|
|
|
|
| 4 |
|
| 5 |
A test quantization of OpenHermes-2.5-Mistral-7B by teknium using importance matrices computed on Ukrainian text, hopefully decreasing the coherence hit after quantization in Ukrainian at the cost of some performance in other languages.
|
| 6 |
|
| 7 |
+
Importance matrix was computed in roughly 20 minutes with a Ryzen 5 3550H and GTX 1650 with 8 layers offloaded.
|
| 8 |
+
|
| 9 |
Will be updated with perplexity testing later.
|