Not-For-All-Audiences
nsfw
icefog72 commited on
Commit
67ff687
·
1 Parent(s): 9a92039

Create Summary for ST Beginners.md

Browse files
Files changed (1) hide show
  1. Summary for ST Beginners.md +90 -0
Summary for ST Beginners.md ADDED
@@ -0,0 +1,90 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Summary for ST Beginners WIP
2
+ Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself in to support on call, if something isn't working - try to google it yourself or go to ST-discord support channels to cry about it. Feel free to correct me if I'm wrong somewhere with proper arguments.
3
+
4
+ # I'm a Noob, How Do I Run LLM?
5
+ ## What and How Can I Run, and How Do I Properly Install and Set Up Any of This?
6
+ ### On What All This Is Running On?
7
+ * python
8
+ * miniconda
9
+ ### From Where We Can Start?
10
+
11
+ * Download and first SillyTavern-Launcher start and close.
12
+
13
+ ### What Can I Run on My Machine?
14
+ * NVIDIA exl2
15
+
16
+ NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
17
+
18
+ - oobabooga/text-generation-webui
19
+
20
+ oobabooga is a name of creator text-generation-webui but every one call text-generation-webui as oobabooga, ooba ...
21
+ https://github.com/oobabooga/text-generation-webui
22
+
23
+ - TabbyAPI
24
+
25
+ https://github.com/theroyallab/tabbyAPI
26
+
27
+ * Other GPU/APU gguf
28
+ - Koboldcpp
29
+
30
+ https://github.com/LostRuins/koboldcpp
31
+ - Ollama
32
+
33
+ https://github.com/ollama/ollama
34
+ - Others
35
+
36
+ * Web API
37
+
38
+ ### Set up Windows Terminal - PowerShell - oh-my-posh Setup - Conda env - git UI. Do I Need To Do All Of This?
39
+
40
+ You don't.
41
+
42
+ * Set up Conda env in PowerShell
43
+ ```
44
+ conda init powershell
45
+ ```
46
+
47
+ * oh-my-posh Setup
48
+
49
+ Intro and how to setup https://www.hanselman.com/blog/my-ultimate-powershell-prompt-with-oh-my-posh-and-the-windows-terminal
50
+
51
+ After all done open in editor selected theme and this segment where you want. (find "segments": [ )
52
+ ```
53
+ {
54
+ "background": "#FFDE57",
55
+ "foreground": "#111111",
56
+ "powerline_symbol": "\ue0b0",
57
+ "properties": {
58
+ "home_enabled": true,
59
+ "display_mode": "environment",
60
+ "fetch_virtual_env": true,
61
+ "display_virtual_env": true,
62
+ "fetch_version": true
63
+ },
64
+ "style": "powerline",
65
+ "template": " \ue235 {{ .Full }}{{ if .Venv }} {{ .Venv }}{{ end }} ",
66
+ "type": "python"
67
+ }
68
+ ```
69
+
70
+ ## How to Properly Install ST?
71
+ * SillyTavern-Launcher
72
+ ## How to Use?
73
+ * Cards
74
+ - chub.ai
75
+ * User Settings
76
+ * Extensions
77
+ - Where Can I Find More?
78
+ ## How Does It Work?
79
+ ## What is a Context Template and Why Should I Care About It?
80
+ ## Author's Note/LoreBook?
81
+ ## What Else Can I Use with ST, and How to Install and Set Up All of This?
82
+ * SillyTavern-extras
83
+ * XTTS
84
+ * StableDiffusion
85
+ ## How to Change ST to Look Like Yours?
86
+ * CSS
87
+ ## What More Can I Do?
88
+ * STscript
89
+ * mergekit
90
+ * exllamav2