Update README.md
Browse files
README.md
CHANGED
@@ -26,6 +26,19 @@ Prompts tested with "temp=0" to ensure compliance, 2048 context (model supports
|
|
26 |
|
27 |
Upgrades really "shine" on longer form generation (prompts #2 and #3 below).
|
28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
<B> Model Notes: </B>
|
30 |
|
31 |
Maximum context is 128k. CommandR requires a specific template for usage.
|
|
|
26 |
|
27 |
Upgrades really "shine" on longer form generation (prompts #2 and #3 below).
|
28 |
|
29 |
+
PPL notes:
|
30 |
+
|
31 |
+
Original Q2k (generated from source files):
|
32 |
+
|
33 |
+
PPL = 7.8446 +/- 0.05160
|
34 |
+
|
35 |
+
New Imatrix NEO V1 Q2K:
|
36 |
+
|
37 |
+
PPL = 7.4056 +/- 0.04940
|
38 |
+
|
39 |
+
A 4390 point drop. (lower is better)
|
40 |
+
|
41 |
+
|
42 |
<B> Model Notes: </B>
|
43 |
|
44 |
Maximum context is 128k. CommandR requires a specific template for usage.
|