Not-For-All-Audiences
nsfw
Update Summary for ST Beginners.md
Browse files- Summary for ST Beginners.md +21 -15
Summary for ST Beginners.md
CHANGED
@@ -1,28 +1,34 @@
|
|
1 |
-
# Summary for ST Beginners
|
2 |
|
3 |
-
Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself
|
4 |
|
5 |
-
# I'm a
|
6 |
|
7 |
-
|
8 |
|
9 |
-
|
10 |
-
* python
|
11 |
-
* miniconda
|
12 |
-
You are not a kid to explain basics, if you don't know wtf is this 2 google it.
|
13 |
-
### From Where We Can Start?
|
14 |
|
15 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
|
17 |
### What Can I Run on My Machine?
|
18 |
|
19 |
If you have:
|
20 |
|
21 |
-
* NVIDIA newer
|
22 |
-
From the get
|
23 |
|
24 |
-
1. [oobabooga/text-generation-webui](https://
|
25 |
-
2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI)
|
26 |
* Other GPU/APU gguf
|
27 |
|
28 |
1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
|
@@ -95,4 +101,4 @@ If you have:
|
|
95 |
|
96 |
* STscript
|
97 |
* mergekit
|
98 |
-
* exllamav2
|
|
|
1 |
+
# Summary for ST Beginners (Work in Progress)
|
2 |
|
3 |
+
Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself into support on call, if something isn't working - try to Google it yourself or go to ST-discord support channels to ask about it (without mentioning me or this summary). Feel free to correct me if I'm wrong somewhere with proper arguments.
|
4 |
|
5 |
+
# I'm a Beginner, How Do I Run ST and What Is It?
|
6 |
|
7 |
+
SillyTavern is a frontend for LLM models. To use it you need to run LLM locally or have access to Web solutions.
|
8 |
|
9 |
+
## What Can I Run, and How Do I Properly Install and Set Up Any of This?
|
|
|
|
|
|
|
|
|
10 |
|
11 |
+
### What Is All This Running On?
|
12 |
+
|
13 |
+
* Python
|
14 |
+
* Miniconda
|
15 |
+
* Hopes and dreams
|
16 |
+
|
17 |
+
You are not a kid, if you don't know what these are, Google it.
|
18 |
+
|
19 |
+
### Where Do We Start?
|
20 |
+
|
21 |
+
* We go here [SillyTavern-Launcher](https://github.com/SillyTavern/SillyTavern-Launcher) and follow all the installation steps.
|
22 |
|
23 |
### What Can I Run on My Machine?
|
24 |
|
25 |
If you have:
|
26 |
|
27 |
+
* NVIDIA newer than 20xx RTX card then it's a no-brainer - use exl2 models.
|
28 |
+
From the get-go do this- open NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
|
29 |
|
30 |
+
1. [oobabooga/text-generation-webui](https://github.com/oobabooga/text-generation-webui) oobabooga is the name of the creator of text-generation-webui but everyone calls text-generation-webui as oobabooga
|
31 |
+
2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI) How to setup [Getting-Started](https://github.com/theroyallab/tabbyAPI/wiki/1.-Getting-Started)
|
32 |
* Other GPU/APU gguf
|
33 |
|
34 |
1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
|
|
|
101 |
|
102 |
* STscript
|
103 |
* mergekit
|
104 |
+
* exllamav2
|