parameters guide
samplers guide
model generation
role play settings
quant selection
arm quants
iq quants vs q quants
optimal model setting
gibberish fixes
coherence
instructing following
quality generation
chat settings
quality settings
llamacpp server
llamacpp
lmstudio
sillytavern
koboldcpp
backyard
ollama
model generation steering
steering
model generation fixes
text generation webui
ggufs
exl2
full precision
quants
imatrix
neo imatrix
Update README.md
Browse files
README.md
CHANGED
@@ -36,7 +36,7 @@ tags:
|
|
36 |
|
37 |
<h3>Maximizing Model Performance for All Quants Types And Full-Precision using Samplers, Advance Samplers and Parameters Guide</h3>
|
38 |
|
39 |
-
(Updated: "INDEX", and added "Generation Steering" section ; notes on Roleplay/Simulation added)
|
40 |
|
41 |
This document includes detailed information, references, and notes for general parameters, samplers and
|
42 |
advanced samplers to get the most out of your model's abilities including notes / settings for the most popular AI/LLM app in use (LLAMACPP, KoboldCPP, Text-Generation-WebUI, LMStudio, Sillytavern, Ollama and others).
|
@@ -750,6 +750,8 @@ Not all parameters, samplers and advanced samplers are listed in this quick refe
|
|
750 |
|
751 |
Likewise there may be some "name variation(s)" - in other LLM/AI apps - this is addressed in the detailed sections.
|
752 |
|
|
|
|
|
753 |
<small>
|
754 |
# LLM Parameters Reference Table
|
755 |
|
@@ -825,6 +827,36 @@ Likewise there may be some "name variation(s)" - in other LLM/AI apps - this is
|
|
825 |
|
826 |
</small>
|
827 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
828 |
CLASS 3/4 MODELS:
|
829 |
|
830 |
If you are using a class 3 or class 4 model for use case(s) such as role play, multi-turn, chat etc etc, it is suggested to activate / set all samplers for class 3 but may be required for class 4 models.
|
|
|
36 |
|
37 |
<h3>Maximizing Model Performance for All Quants Types And Full-Precision using Samplers, Advance Samplers and Parameters Guide</h3>
|
38 |
|
39 |
+
(Updated: "INDEX", and added "Generation Steering" section ; notes on Roleplay/Simulation added, Screenshots of parameters/samplers added in quick reference section.)
|
40 |
|
41 |
This document includes detailed information, references, and notes for general parameters, samplers and
|
42 |
advanced samplers to get the most out of your model's abilities including notes / settings for the most popular AI/LLM app in use (LLAMACPP, KoboldCPP, Text-Generation-WebUI, LMStudio, Sillytavern, Ollama and others).
|
|
|
750 |
|
751 |
Likewise there may be some "name variation(s)" - in other LLM/AI apps - this is addressed in the detailed sections.
|
752 |
|
753 |
+
I have added Screenshots of settings for Class 1-2, Class 3 and Class 4 are below this chart for Koboldcpp, SillyTavern and Text Gen Webui.
|
754 |
+
|
755 |
<small>
|
756 |
# LLM Parameters Reference Table
|
757 |
|
|
|
827 |
|
828 |
</small>
|
829 |
|
830 |
+
SCREENSHOTS (right click-> open in new window) of Class 1-2, Class 3, and Class 4 for KoboldCPP, Silly Tavern and Text Gen Webui.
|
831 |
+
|
832 |
+
<a href="class1-2-Silly-Tavern.jpg">class1-2-Silly-Taver</a>
|
833 |
+
|
834 |
+
<a href="class1-2-WebUI.jpg">class1-2-WebUI</a>
|
835 |
+
|
836 |
+
<a href="class1-2-kcpp.jpg">class1-2-kcpp</a>
|
837 |
+
|
838 |
+
<a href="class3-Silly-Tavern.jpg">class3-Silly-Tavern</a>
|
839 |
+
|
840 |
+
<a href="class3-WebUI.jpg">class3-WebUI</a>
|
841 |
+
|
842 |
+
<a href="class3-kcpp.jpg">class3-kcpp</a>
|
843 |
+
|
844 |
+
<a href="class4-Silly-Tavern.jpg">class4-Silly-Tavern</a>
|
845 |
+
|
846 |
+
<a href="class4-WebUI.jpg">class4-WebUI</a>
|
847 |
+
|
848 |
+
<a href="class4-kcpp.jpg">class4-kcpp</a>
|
849 |
+
|
850 |
+
NOTES:
|
851 |
+
|
852 |
+
These cover basic/default settings PER CLASS. See "quick range" of settings above, and full range with details on how to "fine tune" model operation below.
|
853 |
+
|
854 |
+
This is especially important for fine control of Class 3 and Class 4 models ; sometimes you can use class 2 or 3 settings for class 3 and even class 4 models.
|
855 |
+
|
856 |
+
It is your use CASE(s) / smooth operation requirements that determine which settings will work best.
|
857 |
+
|
858 |
+
You should not apply class 3 or class 4 settings on a class 1 or class 2 model - this might limit model operation and usually class 1/2 models do not require this level of control.
|
859 |
+
|
860 |
CLASS 3/4 MODELS:
|
861 |
|
862 |
If you are using a class 3 or class 4 model for use case(s) such as role play, multi-turn, chat etc etc, it is suggested to activate / set all samplers for class 3 but may be required for class 4 models.
|