DavidAU commited on
Commit
6034bb2
1 Parent(s): 20b3dc1

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +192 -0
README.md ADDED
@@ -0,0 +1,192 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ (quants uploading...)
2
+
3
+ <h3><font color="green"> Grand-HORROR-17.4B V1.7 STABLE - "Kiss of Death" Version. </font></h3>
4
+
5
+ <img src="horror-maid.jpg" style="float:right; width:320px; height:320px; padding:5px;">
6
+
7
+ <B><font color="red">WARNING:</font> NSFW. Graphic HORROR. Extreme swearing. UNCENSORED. SMART. STABLE. WAY INTENSE ! </B>
8
+
9
+ GRAND HORROR is a take no prisoners, totally uncensored, fiction writing monster and roleplay master as well
10
+ just about any general fiction (all genres) activity "AI guru" including scene generation and scene continuation.
11
+
12
+ I took the original models in "L3-Stheno-Maid-Blackroot 8B" and completely rebuilt it a new pass-through merge (everything preserved)
13
+ and blew it out to over 17.4 billion parameters - 678 tensors, 75 layers (8B original has 32 layers).
14
+
15
+ V 1.7 is a re-worked version of the original "Grand Horror 16.5B" which has been stabilized to operate at far wider range
16
+ of parameters and operation / use cases - and it has been expanded with new augmentation methods.
17
+
18
+ <B>All known issues in the original version have been resolved.</b>
19
+
20
+ V 1.7 is also more focused in the moment, and prose has been cleaned up a bit too.
21
+
22
+ <B>But V1.7 has something new for Grand Horror Series - Brainstorm 5x:</b>
23
+
24
+ The BRAINSTORM process was developed by David_AU.
25
+
26
+ Some of the core principals behind this process are discussed in this scientific paper :
27
+ Progressive LLaMA with Block Expansion . However I went in a different direction from what was outlined in this paper.
28
+
29
+ What is "Brainstorm" ?
30
+
31
+ The reasoning center of an LLM is taken apart, reassembled, and expanded. Then these centers are
32
+ individually calibrated. These "centers" also interact with each other. This introduces subtle changes
33
+ into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further.
34
+
35
+ The number of centers (5x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.
36
+
37
+ The core aim of this process is to increase the model's detail, concept and connection to the "world",
38
+ general concept connections, prose quality and prose length without affecting instruction following.
39
+
40
+ This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.
41
+
42
+ (new examples added below)
43
+
44
+ <B>More HORROR coming...</B>
45
+
46
+ V 1.7 is also the first in a series of NEW "Grand Horror" versions (built, ready for upload) cumulating in the MASSIVE
47
+ GRAND HORROR Nightmare version called "<i><font color="blue">Godzilla's Wicked Sister</font></i>" at 25.05 Billion parameters
48
+ (111 layers, 993 Tensors; for reference 70B models have about 80-120 layers).
49
+
50
+ <B>What is "Grand Horror" ?</B>
51
+
52
+ GRAND HORROR is a take no prisoners, totally uncensored, fiction writing monster and roleplay master as well
53
+ just about any general fiction (all genres) activity "AI guru" including scene generation and scene continuation.
54
+
55
+ As a result of the expansion / merge re-build its level of prose and story generation has significantly improved
56
+ as well as word choice, sentence structure as well as default output levels and lengths.
57
+
58
+ It also has a STRONG horror bias, although it will generate content for almost any genre. That being said
59
+ if there is a "hint" of things going wrong... they will.
60
+
61
+ It will also swear (R-18) like there is no tomorrow at times and "dark" characters will be VERY dark so to speak.
62
+
63
+ Model excels in details (real and "constructed"), descriptions, similes and metaphors.
64
+
65
+ I would also say it can have a sense of humor ... ah... dark humor.
66
+
67
+ With all this being said, this model has an uncanny sense of "there" , "in the moment" and timing too.
68
+ This single quality sets it apart from other models in my opinion.
69
+
70
+ Although it swears to the point of pealing paint off the wall and goes scorched Earth graphic horror at the drop of a pin the
71
+ single quality noted is worth it.
72
+
73
+ These can be filtered / controlled to some degree in your prompts.
74
+
75
+ This model also does not show an "GPTisms" (NO happy ever after, NO morality police) or in your face "Captain Obvious" comments.
76
+
77
+ (see examples sections for different genres)
78
+
79
+ Because of the nature of this merge most attributes of each of the 3 models will be in this rebuilt 16.5B model as opposed to the
80
+ original 8B model where some of one or more of the model's features and/or strengths maybe reduced or overshadowed.
81
+
82
+ Please report any issue(s) and/or feedback via the "Community tab".
83
+
84
+ Please see the models used in this merge (links below in the "formula" section ) for more information on
85
+ what they "bring" to this merged 16.5B model.
86
+
87
+ This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 8k / 8192.
88
+ However this can be extended using "rope" settings up to 32k.
89
+
90
+ It is also known, that the "Command-R" template will work too, and will result in radically different prose/output.
91
+
92
+ <B>Settings / Known Issue(s) and Fix(es):</b>
93
+
94
+ Stable version fixed all known issues from V1.
95
+
96
+ The default "repetition penalty" (from LMStudio) of 1.1 is recommended. (this was used for examples generations below.)
97
+
98
+ <b>Optional Enhancement:</B>
99
+
100
+ The following can be used in place of the "system prompt" or "system role" to further enhance the model.
101
+
102
+ It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along.
103
+ In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
104
+
105
+ Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
106
+
107
+ <PRE>
108
+ Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
109
+
110
+ Here are your skillsets:
111
+ [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)
112
+
113
+ [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)
114
+
115
+ Here are your critical instructions:
116
+ Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
117
+ </PRE>
118
+
119
+ You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation
120
+ and scene continue functions.
121
+
122
+ This enhancement WAS NOT used to generate the examples below.
123
+
124
+ <h3>Models Used:</h3>
125
+
126
+ Special thanks to the incredible work of the model makers "SAO10K", "NEVERSLEEP" and "HASTAGARAS".
127
+
128
+ Models used:
129
+
130
+ [ https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2]
131
+
132
+ [ https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS ]
133
+
134
+ [ https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.V-Blackroot ]
135
+
136
+ <h3>EXAMPLES:</h3>
137
+
138
+ Examples are created using quant Q4_K_M, "temp=.8", minimal parameters and "LLAMA3" template.
139
+
140
+ Below are the least creative outputs, prompt is in <B>BOLD</B>.
141
+
142
+ Higher quants will result in better quality.
143
+
144
+ There will also be some variance between "close" quants like Q4_K_M/Q4_K_S and Q5_K_M/Q5_K_S, so I suggest
145
+ if you are going to use Q4_K_M, you also try Q4_K_S too.
146
+
147
+ ---
148
+
149
+ <B><font color="red">WARNING:</font> NSFW. Graphic HORROR. Swearing. UNCENSORED. </B>
150
+
151
+ ---
152
+
153
+ <B>
154
+ Start a 1000 word scene (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
155
+ </B>
156
+
157
+ <B>GENERATION 1:</B>
158
+
159
+
160
+ <B>GENERATION 2 (same prompt):</b>
161
+
162
+
163
+ ---
164
+
165
+ <B>
166
+
167
+ (continue this scene:)
168
+ The Waystone Inn lay in silence, and it was a silence of three parts.
169
+
170
+ The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained
171
+
172
+ </b>
173
+
174
+
175
+ ---
176
+
177
+ <B>
178
+ Start a 1000 word scene with: The lights flicked, as they entered the atmosphere of new Earth II, there was a distant explosion and then the lights went out completely...
179
+ </b>
180
+
181
+
182
+ ---
183
+
184
+ <b>
185
+
186
+ Using the following "story idea" below, write the first scene in the novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman.
187
+
188
+ Story idea:
189
+ In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.
190
+
191
+ </b>
192
+