Not-For-All-Audiences
nsfw
icefog72 commited on
Commit
f0ef593
·
1 Parent(s): 67ff687

Update Summary for ST Beginners.md

Browse files
Files changed (1) hide show
  1. Summary for ST Beginners.md +44 -35
Summary for ST Beginners.md CHANGED
@@ -1,38 +1,34 @@
1
  # Summary for ST Beginners WIP
 
2
  Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself in to support on call, if something isn't working - try to google it yourself or go to ST-discord support channels to cry about it. Feel free to correct me if I'm wrong somewhere with proper arguments.
3
 
4
  # I'm a Noob, How Do I Run LLM?
 
5
  ## What and How Can I Run, and How Do I Properly Install and Set Up Any of This?
 
6
  ### On What All This Is Running On?
 
7
  * python
8
  * miniconda
 
9
  ### From Where We Can Start?
10
 
11
  * Download and first SillyTavern-Launcher start and close.
12
 
13
  ### What Can I Run on My Machine?
14
- * NVIDIA exl2
15
 
16
- NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
17
 
18
- - oobabooga/text-generation-webui
19
-
20
- oobabooga is a name of creator text-generation-webui but every one call text-generation-webui as oobabooga, ooba ...
21
- https://github.com/oobabooga/text-generation-webui
22
-
23
- - TabbyAPI
24
-
25
- https://github.com/theroyallab/tabbyAPI
26
 
 
 
27
  * Other GPU/APU gguf
28
- - Koboldcpp
29
-
30
- https://github.com/LostRuins/koboldcpp
31
- - Ollama
32
-
33
- https://github.com/ollama/ollama
34
- - Others
35
 
 
 
 
36
  * Web API
37
 
38
  ### Set up Windows Terminal - PowerShell - oh-my-posh Setup - Conda env - git UI. Do I Need To Do All Of This?
@@ -40,15 +36,16 @@ NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Pr
40
  You don't.
41
 
42
  * Set up Conda env in PowerShell
 
43
  ```
44
  conda init powershell
45
  ```
46
-
47
  * oh-my-posh Setup
48
-
49
- Intro and how to setup https://www.hanselman.com/blog/my-ultimate-powershell-prompt-with-oh-my-posh-and-the-windows-terminal
50
-
51
- After all done open in editor selected theme and this segment where you want. (find "segments": [ )
 
52
  ```
53
  {
54
  "background": "#FFDE57",
@@ -68,23 +65,35 @@ You don't.
68
  ```
69
 
70
  ## How to Properly Install ST?
71
- * SillyTavern-Launcher
 
 
72
  ## How to Use?
73
- * Cards
74
- - chub.ai
75
- * User Settings
76
- * Extensions
77
- - Where Can I Find More?
 
 
78
  ## How Does It Work?
 
79
  ## What is a Context Template and Why Should I Care About It?
 
80
  ## Author's Note/LoreBook?
 
81
  ## What Else Can I Use with ST, and How to Install and Set Up All of This?
82
- * SillyTavern-extras
83
- * XTTS
84
- * StableDiffusion
 
 
85
  ## How to Change ST to Look Like Yours?
86
- * CSS
 
 
87
  ## What More Can I Do?
88
- * STscript
89
- * mergekit
90
- * exllamav2
 
 
1
  # Summary for ST Beginners WIP
2
+
3
  Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself in to support on call, if something isn't working - try to google it yourself or go to ST-discord support channels to cry about it. Feel free to correct me if I'm wrong somewhere with proper arguments.
4
 
5
  # I'm a Noob, How Do I Run LLM?
6
+
7
  ## What and How Can I Run, and How Do I Properly Install and Set Up Any of This?
8
+
9
  ### On What All This Is Running On?
10
+
11
  * python
12
  * miniconda
13
+
14
  ### From Where We Can Start?
15
 
16
  * Download and first SillyTavern-Launcher start and close.
17
 
18
  ### What Can I Run on My Machine?
 
19
 
20
+ If you have:
21
 
22
+ * NVIDIA newer then 20xx RTX card then it's no brain - use exl2 models.
23
+ NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
 
 
 
 
 
 
24
 
25
+ 1. [oobabooga/text-generation-webui](https://https://github.com/oobabooga/text-generation-webui) oobabooga is a name of creator text-generation-webui but every one call text-generation-webui as oobabooga
26
+ 2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI)
27
  * Other GPU/APU gguf
 
 
 
 
 
 
 
28
 
29
+ 1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
30
+ 2. [Ollama](https://github.com/ollama/ollama)
31
+ 3. Others
32
  * Web API
33
 
34
  ### Set up Windows Terminal - PowerShell - oh-my-posh Setup - Conda env - git UI. Do I Need To Do All Of This?
 
36
  You don't.
37
 
38
  * Set up Conda env in PowerShell
39
+
40
  ```
41
  conda init powershell
42
  ```
 
43
  * oh-my-posh Setup
44
+
45
+ [Intro and how to setup](https://www.hanselman.com/blog/my-ultimate-powershell-prompt-with-oh-my-posh-and-the-windows-terminal)
46
+
47
+ After all done open in editor selected theme and add this segment where you want (find "segments": [ ) to have python enviroment segment.
48
+
49
  ```
50
  {
51
  "background": "#FFDE57",
 
65
  ```
66
 
67
  ## How to Properly Install ST?
68
+
69
+ * SillyTavern-Launcher
70
+
71
  ## How to Use?
72
+
73
+ * Cards
74
+ - chub.ai
75
+ * User Settings
76
+ * Extensions
77
+ - Where Can I Find More?
78
+
79
  ## How Does It Work?
80
+
81
  ## What is a Context Template and Why Should I Care About It?
82
+
83
  ## Author's Note/LoreBook?
84
+
85
  ## What Else Can I Use with ST, and How to Install and Set Up All of This?
86
+
87
+ * SillyTavern-extras
88
+ * XTTS
89
+ * StableDiffusion
90
+
91
  ## How to Change ST to Look Like Yours?
92
+
93
+ * CSS
94
+
95
  ## What More Can I Do?
96
+
97
+ * STscript
98
+ * mergekit
99
+ * exllamav2