Summary for ST Beginners WIP

Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself in to support on call, if something isn't working - try to google it yourself or go to ST-discord support channels to cry about it. Feel free to correct me if I'm wrong somewhere with proper arguments.

I'm a Noob, How Do I Run LLM?

What and How Can I Run, and How Do I Properly Install and Set Up Any of This?

On What All This Is Running On?

python
miniconda

From Where We Can Start?

Download and first SillyTavern-Launcher start and close.

What Can I Run on My Machine?

If you have:

NVIDIA newer then 20xx RTX card then it's no brain - use exl2 models. From the get go do this- open NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
1. oobabooga/text-generation-webui oobabooga is a name of creator text-generation-webui but every one call text-generation-webui as oobabooga
2. TabbyAPI Hot wo setup Getting-Started
Other GPU/APU gguf
1. Koboldcpp
2. Ollama
3. Others
Web API

Set up Windows Terminal - PowerShell - oh-my-posh Setup - Conda env - git UI. Do I Need To Do All Of This?

You don't.

Set up Conda env in PowerShell
```
conda init powershell
```

oh-my-posh Setup

Intro and how to setup

After all done open in editor selected theme and add this segment where you want (find "segments": [ ) to have python enviroment segment.

{
    "background": "#FFDE57",
    "foreground": "#111111",
    "powerline_symbol": "\ue0b0",
    "properties": {
    "home_enabled": true,
    "display_mode": "environment",
    "fetch_virtual_env": true,
    "display_virtual_env": true,
    "fetch_version": true
    },
    "style": "powerline",
    "template": " \ue235 {{ .Full }}{{ if .Venv }} {{ .Venv }}{{ end }} ",
    "type": "python"
}

How to Properly Install ST?

SillyTavern-Launcher

How to Use?

Cards
- chub.ai
User Settings
Extensions
- Where Can I Find More?

How Does It Work?

What is a Context Template and Why Should I Care About It?

Author's Note/LoreBook?

What Else Can I Use with ST, and How to Install and Set Up All of This?

SillyTavern-extras
XTTS
StableDiffusion

How to Change ST to Look Like Yours?

What More Can I Do?

STscript
mergekit
exllamav2