Elfrino commited on
Commit
eca3905
·
verified ·
1 Parent(s): 87bea5f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -0
README.md CHANGED
@@ -14,6 +14,51 @@ tags:
14
 
15
  ***The 5th iteration of Harmonic Harlequin and seems the most coherent and lucid of the lot (early days though), need to test for creativity, might be a solid model, fingers crossed..***
16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  # merge
18
 
19
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
14
 
15
  ***The 5th iteration of Harmonic Harlequin and seems the most coherent and lucid of the lot (early days though), need to test for creativity, might be a solid model, fingers crossed..***
16
 
17
+ RECOMMENDED SETTINGS:
18
+
19
+ (based on KoboldCPP):
20
+
21
+
22
+ Preset: Mayday
23
+
24
+ Temperature - 1.3
25
+
26
+ Max Ctx. Tokens - 4096
27
+
28
+ Top p Sampling - 0.99
29
+
30
+ Repetition Penalty - 1.1
31
+
32
+ Amount to Gen. - 280
33
+
34
+ New findings:
35
+
36
+ around 47 layers offloaded to GPU
37
+
38
+ Smartcontext enabled
39
+
40
+ Custom RoPe Config enabled (but left as default)
41
+
42
+ Prompt template: Alpaca
43
+
44
+ ***And a very interesting new find that boosts lucidity immensely:***
45
+
46
+ Set Rp.Slope (Repetion Slope) to 2
47
+
48
+
49
+
50
+
51
+
52
+
53
+
54
+
55
+
56
+
57
+
58
+
59
+
60
+
61
+
62
  # merge
63
 
64
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).