sphiratrioth666
commited on
Commit
•
c0d6d40
1
Parent(s):
65e6a67
Update README.md
Browse files
README.md
CHANGED
@@ -91,7 +91,7 @@ base_model:
|
|
91 |
**Advanced Users:** Enjoy, modify, forget.\
|
92 |
**Beginners:** Read further.
|
93 |
|
94 |
-
|
95 |
***<<< Most typical templates: Mistral, ChatML, LLAMA3, Alpaca, Metharme/Pygmalion >>>***
|
96 |
2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
|
97 |
***<<< This rule may be broken when you become the advanced user. Then, you'll know what you're doing so you'll mix different context/instruct templates. For now - one ring... khem - one template to rule them all. Don't be the Amazon Saur-off. Be a true Lord of the Templates.>>>***/
|
@@ -110,12 +110,12 @@ base_model:
|
|
110 |
15. Load up my Settings Preset from the Text Completion Presets list.
|
111 |
16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
|
112 |
17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers).
|
113 |
-
18. Enjoy
|
114 |
<br>
|
115 |
<br>
|
116 |
<h1><ins>BEWARE:</ins></h1>
|
117 |
|
118 |
-
|
119 |
|
120 |
<h1><ins>CUSTOMIZATION:</ins></h1>
|
121 |
<li>Dialogues in Markdowns - modify the SYSTEM PROMPT ("Capital A" tab of Silly Tavern UI). It's simple - find the following line and replace with: Respect this markdown format: "direct speech", *actions*</li>
|
|
|
91 |
**Advanced Users:** Enjoy, modify, forget.\
|
92 |
**Beginners:** Read further.
|
93 |
|
94 |
+
1. Find your model's native INSTRUCT TEMPLATE. Every fine-tune stands on a base model, which is usually specified by its creator in a manner of "We're presenting the first fine-tune of Mistral Small" or "Nemo on steroids" or "LLAMA 3 with our special sauce" etc. It may be confusing, it may be clear. Not my fault :-P However, you need to identify the base model of a fine-tune by reading its description page. Different templates may be used by creators (tuners) for training - and then - templates suggested on a fine-tune's page work best. However, creators often just choose the basic template of a model they're tuning - so make sure to check the model's description page or assume it's using the base model's template (template of the main model that a given tuner is tuning).
|
95 |
***<<< Most typical templates: Mistral, ChatML, LLAMA3, Alpaca, Metharme/Pygmalion >>>***
|
96 |
2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
|
97 |
***<<< This rule may be broken when you become the advanced user. Then, you'll know what you're doing so you'll mix different context/instruct templates. For now - one ring... khem - one template to rule them all. Don't be the Amazon Saur-off. Be a true Lord of the Templates.>>>***/
|
|
|
110 |
15. Load up my Settings Preset from the Text Completion Presets list.
|
111 |
16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
|
112 |
17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers).
|
113 |
+
18. Enjoy.
|
114 |
<br>
|
115 |
<br>
|
116 |
<h1><ins>BEWARE:</ins></h1>
|
117 |
|
118 |
+
<p align="justify">**IF YOU WANT THE PRESETS TO WORK PROPERLY, REMEMBER TO START A NEW CHAT FOR TESTING PURPOSES/ACTUAL ROLEPLAY. IF YOU "HOT" SWAP THE PRESETS, YOU MAY EASILY FALL INTO A TRAP OF CONTINUING THE PREVIOUS PROMPT. IN RESULT, THE SHORT/BALANCED/LONG RESPONSES AND NARRATION IN 1st/3rd PERSON WILL NOT SWITCH PROPERLY. ALWAYS START A NEW CHAT. THEORETICALLY, SWITCHING A SYSTEM PROMPT FORCES THE PROMPT EVALUATION BUT IN REALITY - IT OFTEN BREAKS, IT DOES NOT WORK PROPERLY. IT WORKS WHEN YOU START A NEW CHAT THOUGH - OR WHEN YOU RELOAD THE WHOLE SILLY TAVERN UI.**</p>
|
119 |
|
120 |
<h1><ins>CUSTOMIZATION:</ins></h1>
|
121 |
<li>Dialogues in Markdowns - modify the SYSTEM PROMPT ("Capital A" tab of Silly Tavern UI). It's simple - find the following line and replace with: Respect this markdown format: "direct speech", *actions*</li>
|