Update README.md
Browse files
README.md
CHANGED
@@ -9,16 +9,38 @@ tags:
|
|
9 |
---
|
10 |
|
11 |
|
12 |
-
|
13 |
|
|
|
14 |
|
15 |
-
|
16 |
|
17 |
-
|
18 |
|
19 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
20 |
|
21 |
-
|
22 |
|
23 |
|
24 |
|
|
|
9 |
---
|
10 |
|
11 |
|
12 |
+
***notes:***
|
13 |
|
14 |
+
Creative, articulate and has a wacky sense of humour with the right settings:
|
15 |
|
16 |
+
RECOMMENDED SETTINGS:
|
17 |
|
18 |
+
(based on KoboldCPP):
|
19 |
|
20 |
+
Preset: Mayday
|
21 |
+
|
22 |
+
Temperature - 1.3
|
23 |
+
|
24 |
+
Max Ctx. Tokens - 4096
|
25 |
+
|
26 |
+
Top p Sampling - 0.99
|
27 |
+
|
28 |
+
Repetition Penalty - 1.1
|
29 |
+
|
30 |
+
Amount to Gen. - 280
|
31 |
+
|
32 |
+
***New findings:***
|
33 |
+
|
34 |
+
|
35 |
+
IMPORTANT: Repetition Penalty Slope (RpSlp in KoboldCPP) should be set to 0
|
36 |
+
|
37 |
+
around 47 layers offloaded to GPU
|
38 |
+
|
39 |
+
Smartcontext enabled
|
40 |
+
|
41 |
+
Custom RoPe Config enabled (but left as default)
|
42 |
|
43 |
+
Prompt template: Alpaca
|
44 |
|
45 |
|
46 |
|