Not-For-All-Audiences
nsfw
icefog72 commited on
Commit
0efc551
·
1 Parent(s): d70865d

Update Summary for ST Beginners.md

Browse files
Files changed (1) hide show
  1. Summary for ST Beginners.md +21 -15
Summary for ST Beginners.md CHANGED
@@ -1,28 +1,34 @@
1
- # Summary for ST Beginners WIP
2
 
3
- Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself in to support on call, if something isn't working - try to google it yourself or go to ST-discord support channels to cry about it. Feel free to correct me if I'm wrong somewhere with proper arguments.
4
 
5
- # I'm a Noob, How Do I Run LLM?
6
 
7
- ## What and How Can I Run, and How Do I Properly Install and Set Up Any of This?
8
 
9
- ### On What All This Is Running On?
10
- * python
11
- * miniconda
12
- You are not a kid to explain basics, if you don't know wtf is this 2 google it.
13
- ### From Where We Can Start?
14
 
15
- * Download and first SillyTavern-Launcher start and close.
 
 
 
 
 
 
 
 
 
 
16
 
17
  ### What Can I Run on My Machine?
18
 
19
  If you have:
20
 
21
- * NVIDIA newer then 20xx RTX card then it's no brain - use exl2 models.
22
- From the get go do this- open NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
23
 
24
- 1. [oobabooga/text-generation-webui](https://https://github.com/oobabooga/text-generation-webui) oobabooga is a name of creator text-generation-webui but every one call text-generation-webui as oobabooga
25
- 2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI) Hot wo setup [Getting-Started](https://github.com/theroyallab/tabbyAPI/wiki/1.-Getting-Started)
26
  * Other GPU/APU gguf
27
 
28
  1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
@@ -95,4 +101,4 @@ If you have:
95
 
96
  * STscript
97
  * mergekit
98
- * exllamav2
 
1
+ # Summary for ST Beginners (Work in Progress)
2
 
3
+ Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself into support on call, if something isn't working - try to Google it yourself or go to ST-discord support channels to ask about it (without mentioning me or this summary). Feel free to correct me if I'm wrong somewhere with proper arguments.
4
 
5
+ # I'm a Beginner, How Do I Run ST and What Is It?
6
 
7
+ SillyTavern is a frontend for LLM models. To use it you need to run LLM locally or have access to Web solutions.
8
 
9
+ ## What Can I Run, and How Do I Properly Install and Set Up Any of This?
 
 
 
 
10
 
11
+ ### What Is All This Running On?
12
+
13
+ * Python
14
+ * Miniconda
15
+ * Hopes and dreams
16
+
17
+ You are not a kid, if you don't know what these are, Google it.
18
+
19
+ ### Where Do We Start?
20
+
21
+ * We go here [SillyTavern-Launcher](https://github.com/SillyTavern/SillyTavern-Launcher) and follow all the installation steps.
22
 
23
  ### What Can I Run on My Machine?
24
 
25
  If you have:
26
 
27
+ * NVIDIA newer than 20xx RTX card then it's a no-brainer - use exl2 models.
28
+ From the get-go do this- open NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
29
 
30
+ 1. [oobabooga/text-generation-webui](https://github.com/oobabooga/text-generation-webui) oobabooga is the name of the creator of text-generation-webui but everyone calls text-generation-webui as oobabooga
31
+ 2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI) How to setup [Getting-Started](https://github.com/theroyallab/tabbyAPI/wiki/1.-Getting-Started)
32
  * Other GPU/APU gguf
33
 
34
  1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
 
101
 
102
  * STscript
103
  * mergekit
104
+ * exllamav2