Not-For-All-Audiences
nsfw
Update Summary for ST Beginners.md
Browse files
Summary for ST Beginners.md
CHANGED
@@ -20,10 +20,10 @@ Hello everyone. This is a brief summary of the most frequently asked questions I
|
|
20 |
If you have:
|
21 |
|
22 |
* NVIDIA newer then 20xx RTX card then it's no brain - use exl2 models.
|
23 |
-
NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
|
24 |
|
25 |
1. [oobabooga/text-generation-webui](https://https://github.com/oobabooga/text-generation-webui) oobabooga is a name of creator text-generation-webui but every one call text-generation-webui as oobabooga
|
26 |
-
2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI)
|
27 |
* Other GPU/APU gguf
|
28 |
|
29 |
1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
|
@@ -33,7 +33,7 @@ If you have:
|
|
33 |
|
34 |
### Set up Windows Terminal - PowerShell - oh-my-posh Setup - Conda env - git UI. Do I Need To Do All Of This?
|
35 |
|
36 |
-
You don't
|
37 |
|
38 |
* Set up Conda env in PowerShell
|
39 |
|
|
|
20 |
If you have:
|
21 |
|
22 |
* NVIDIA newer then 20xx RTX card then it's no brain - use exl2 models.
|
23 |
+
From the get go do this- open NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
|
24 |
|
25 |
1. [oobabooga/text-generation-webui](https://https://github.com/oobabooga/text-generation-webui) oobabooga is a name of creator text-generation-webui but every one call text-generation-webui as oobabooga
|
26 |
+
2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI) Hot wo setup [Getting-Started](https://github.com/theroyallab/tabbyAPI/wiki/1.-Getting-Started)
|
27 |
* Other GPU/APU gguf
|
28 |
|
29 |
1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
|
|
|
33 |
|
34 |
### Set up Windows Terminal - PowerShell - oh-my-posh Setup - Conda env - git UI. Do I Need To Do All Of This?
|
35 |
|
36 |
+
> **You don't.**
|
37 |
|
38 |
* Set up Conda env in PowerShell
|
39 |
|