AzureBlack
commited on
Commit
•
263d861
1
Parent(s):
1c1923a
Update README.md
Browse files
README.md
CHANGED
@@ -120,6 +120,15 @@ model-index:
|
|
120 |
---
|
121 |
|
122 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
123 |
|
124 |
-----
|
125 |
|
|
|
120 |
---
|
121 |
|
122 |
|
123 |
+
ExllamaV2 version of the model created by [Steelskull](https://huggingface.co/Steelskull)!
|
124 |
+
|
125 |
+
Original Model https://huggingface.co/Sao10K/WinterGoddess-1.4x-70B-L2
|
126 |
+
|
127 |
+
calibration dataset [here.](https://huggingface.co/datasets/royallab/PIPPA-cleaned)
|
128 |
+
|
129 |
+
Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.
|
130 |
+
|
131 |
+
Test using 8192 measurement length and rp dataset. Perplexity came out a bit high so you may need to lower temperature to get coherent results.
|
132 |
|
133 |
-----
|
134 |
|