Update README.md
Browse files
README.md
CHANGED
@@ -45,15 +45,15 @@ Yes... but multipled by each merge(s), and compression(s): 20 billion times.
|
|
45 |
<B>The result:</b>
|
46 |
|
47 |
At Q2K an impressive drop of 533 points in perplexity. (lower is better)
|
48 |
-
(VS: Q2K
|
49 |
|
50 |
At Q4KM a whopping drop of 976 points in perplexity.
|
51 |
-
(VS: Q4km
|
52 |
|
53 |
At Q6 an awesome drop of 234 points in perplexity.
|
54 |
-
(VS: Q6
|
55 |
|
56 |
-
To put this in perspective "Q6" now operates ABOVE the
|
57 |
and Q4KM operates at close to Q6 level quality.
|
58 |
|
59 |
This because at "Q6" the quant / compressed model is considered to be accurate within "+0.0008 ppl" of the full,
|
@@ -118,8 +118,8 @@ Test results VS org and "ultra" regular quants will be posted when they come in.
|
|
118 |
Imatrix Plus repo (with the same floating 32 enhancement at "reg quant plus") that will push the limit even more.
|
119 |
|
120 |
Details of all methods (and pitfalls to avoid) employed to make this high precision remasters will be
|
121 |
-
posted shortly along with
|
122 |
|
123 |
-
Thanks again to Jeb Carter, the
|
124 |
|
125 |
[ https://huggingface.co/jebcarter/psyonic-cetacean-20B ]
|
|
|
45 |
<B>The result:</b>
|
46 |
|
47 |
At Q2K an impressive drop of 533 points in perplexity. (lower is better)
|
48 |
+
(VS: Q2K original base model: PPL = 9.8077 +/- 0.06821 )
|
49 |
|
50 |
At Q4KM a whopping drop of 976 points in perplexity.
|
51 |
+
(VS: Q4km original base model -> PPL = 8.7858 +/- 0.06074)
|
52 |
|
53 |
At Q6 an awesome drop of 234 points in perplexity.
|
54 |
+
(VS: Q6 original base model -> PPL = 8.6070 +/- 0.05907 )
|
55 |
|
56 |
+
To put this in perspective "Q6" now operates ABOVE the original full precision version of "Psyonic-Cetacean-20b"
|
57 |
and Q4KM operates at close to Q6 level quality.
|
58 |
|
59 |
This because at "Q6" the quant / compressed model is considered to be accurate within "+0.0008 ppl" of the full,
|
|
|
118 |
Imatrix Plus repo (with the same floating 32 enhancement at "reg quant plus") that will push the limit even more.
|
119 |
|
120 |
Details of all methods (and pitfalls to avoid) employed to make this high precision remasters will be
|
121 |
+
posted shortly along with comparisions of original model and new ultra remaster.
|
122 |
|
123 |
+
Thanks again to Jeb Carter, the original creator of "Psyonic-Cetacean 20B"
|
124 |
|
125 |
[ https://huggingface.co/jebcarter/psyonic-cetacean-20B ]
|