Elfrino commited on
Commit
58a1c5a
·
verified ·
1 Parent(s): 8d59833

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -5
README.md CHANGED
@@ -9,16 +9,38 @@ tags:
9
  ---
10
 
11
 
12
- IN TESTING..........
13
 
 
14
 
15
- findings so far:
16
 
17
- works very well with ChatML template, far superior to Alpaca
18
 
19
- ***notes:***
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
- Fairly creative but makes spelling mistakes and grammatical errors on occasion. Most likely the slices of the passthrough are not optimal...
22
 
23
 
24
 
 
9
  ---
10
 
11
 
12
+ ***notes:***
13
 
14
+ Creative, articulate and has a wacky sense of humour with the right settings:
15
 
16
+ RECOMMENDED SETTINGS:
17
 
18
+ (based on KoboldCPP):
19
 
20
+ Preset: Mayday
21
+
22
+ Temperature - 1.3
23
+
24
+ Max Ctx. Tokens - 4096
25
+
26
+ Top p Sampling - 0.99
27
+
28
+ Repetition Penalty - 1.1
29
+
30
+ Amount to Gen. - 280
31
+
32
+ ***New findings:***
33
+
34
+
35
+ IMPORTANT: Repetition Penalty Slope (RpSlp in KoboldCPP) should be set to 0
36
+
37
+ around 47 layers offloaded to GPU
38
+
39
+ Smartcontext enabled
40
+
41
+ Custom RoPe Config enabled (but left as default)
42
 
43
+ Prompt template: Alpaca
44
 
45
 
46