Spaces:
Running
Running
| # Additional one-click installers info | |
| ## Installing nvcc | |
| If you have an NVIDIA GPU and ever need to compile something, like ExLlamav2 (that currently doesn't have pre-built wheels), you can install `nvcc` by running the `cmd_` script for your OS and entering this command: | |
| ``` | |
| conda install cuda -c nvidia/label/cuda-11.7.1 | |
| ``` | |
| ## Using an AMD GPU in Linux | |
| Requires ROCm SDK 5.4.2 or 5.4.3 to be installed. Some systems may also | |
| need: sudo apt-get install libstdc++-12-dev | |
| Edit the "one_click.py" script using a text editor and un-comment and | |
| modify the lines near the top of the script according to your setup. In | |
| particular, modify the os.environ["ROCM_PATH"] = '/opt/rocm' line to | |
| point to your ROCm installation. | |
| ## WSL instructions | |
| If you do not have WSL installed, see here: | |
| https://learn.microsoft.com/en-us/windows/wsl/install | |
| If you want to install Linux to a drive other than C | |
| Open powershell and enter these commands: | |
| cd D:\Path\To\Linux | |
| $ProgressPreference = 'SilentlyContinue' | |
| Invoke-WebRequest -Uri <LinuxDistroURL> -OutFile Linux.appx -UseBasicParsing | |
| mv Linux.appx Linux.zip | |
| Then open Linux.zip and you should see several .appx files inside. | |
| The one with _x64.appx contains the exe installer that you need. | |
| Extract the contents of that _x64.appx file and run <distro>.exe to install. | |
| Linux Distro URLs: | |
| https://learn.microsoft.com/en-us/windows/wsl/install-manual#downloading-distributions | |
| ****************************************************************************** | |
| *ENSURE THAT THE WSL LINUX DISTRO THAT YOU WISH TO USE IS SET AS THE DEFAULT!* | |
| ****************************************************************************** | |
| Do this by using these commands: | |
| wsl -l | |
| wsl -s <DistroName> | |
| ### Web UI Installation | |
| Run the "start" script. By default it will install the web UI in WSL: | |
| /home/{username}/text-gen-install | |
| To launch the web UI in the future after it is already installed, run | |
| the same "start" script. Ensure that one_click.py and wsl.sh are next to it! | |
| ### Updating the web UI | |
| As an alternative to running the "update" script, you can also run "wsl.sh update" in WSL. | |
| ### Running an interactive shell | |
| As an alternative to running the "cmd" script, you can also run "wsl.sh cmd" in WSL. | |
| ### Changing the default install location | |
| To change this, you will need to edit the scripts as follows: | |
| wsl.sh: line ~22 INSTALL_DIR="/path/to/install/dir" | |
| Keep in mind that there is a long-standing bug in WSL that significantly | |
| slows drive read/write speeds when using a physical drive as opposed to | |
| the virtual one that Linux is installed in. | |