Update README.md

README.md

@@ -26,19 +26,21 @@ This model works best with the following prompt template:
 
 ## GIBBERISH OUTPUT IN `text-generation-webui`?
 
-Please read the Provided Files section below. You should use `stable-vicuna-13B-GPTQ-4bit.no-act-order.safetensors` unless you are able to use the latest GPTQ-for-LLaMa code.
+Please read the Provided Files section below. You should use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors` unless you are able to use the latest GPTQ-for-LLaMa code.
 
-If you're using a text-generation-webui one click installer, you MUST use `stable-vicuna-13B-GPTQ-4bit.no-act-order.safetensors`.
+If you're using a text-generation-webui one click installer, you MUST use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`.
 
 ## Provided files
 
-Two files are provided. **The second file will not work unless you use a recent version of GPTQ-for-LLaMa**
+Two files are provided. **The 'latest' file will not work unless you use a recent version of GPTQ-for-LLaMa**
+
+If you do an automatic download with `text-generation-webui` it will pick the 'compat' file which should work for everyone.
 
 Specifically, the second file uses `--act-order` for maximum quantisation quality and will not work with oobabooga's fork of GPTQ-for-LLaMa. Therefore at this time it will also not work with `text-generation-webui` one-click installers.
 
-Unless you are able to use the latest GPTQ-for-LLaMa code, please use `wizardLM-7B-GPTQ-4bit-128g.no-act-order.safetensors`.
+Unless you are able to use the latest GPTQ-for-LLaMa code, please use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`.
  
-* `stable-vicuna-13B-GPTQ-4bit.no-act-order.safetensors`
+* `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`
   * Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
   * Works with text-generation-webui one-click-installers
   * Works on Windows
@@ -47,7 +49,7 @@ Unless you are able to use the latest GPTQ-for-LLaMa code, please use `wizardLM-
     ```
     CUDA_VISIBLE_DEVICES=0 python3 llama.py stable-vicuna-13B-HF c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors stable-vicuna-13B-GPTQ-4bit.no-act-order.safetensors
     ```
-* `stable-vicuna-13B-GPTQ-4bit.act-order.safetensors`
+* `stable-vicuna-13B-GPTQ-4bit.latest.act-order.safetensors`
   * Only works with recent GPTQ-for-LLaMa code
   * **Does not** work with text-generation-webui one-click-installers
   * Parameters: Groupsize = 128g. act-order.
@@ -57,9 +59,23 @@ Unless you are able to use the latest GPTQ-for-LLaMa code, please use `wizardLM-
     CUDA_VISIBLE_DEVICES=0 python3 llama.py stable-vicuna-13B-HF c4 --wbits 4 --true-sequential --act-order --groupsize 128 --save_safetensors stable-vicuna-13B-GPTQ-4bit.act-order.safetensors
     ```
 
-## How to run in `text-generation-webui`
+## How to easily download and use a model in text-generation-webui
+
+Load text-generation-webui as you normally do.
+
+1. Click the **Model tab**.
+2. Under **Download custom model or LoRA**, enter the repo name to download: `TheBloke/stable-vicuna-13B-GPTQ`.
+3. Click **Download**.
+4. Wait until it says it's finished downloading.
+5. As this is a GPTQ model, fill in the `GPTQ parameters` on the right: `Bits = 4`, `Groupsize = 128`, `model_type = Llama`
+6. Now click the **Refresh** icon next to **Model** in the top left.
+7. In the **Model drop-down**: choose the model you just downloaded, eg `stable-vicuna-13B-GPTQ`.
+8. Click **Reload the Model** in the top right.
+9. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
+
+## Manual instructions for `text-generation-webui`
 
-File `stable-vicuna-13B-GPTQ-4bit.no-act-order.safetensors` can be loaded the same as any other GPTQ file, without requiring any updates to [oobaboogas text-generation-webui](https://github.com/oobabooga/text-generation-webui).
+File `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors` can be loaded the same as any other GPTQ file, without requiring any updates to [oobaboogas text-generation-webui](https://github.com/oobabooga/text-generation-webui).
 
 [Instructions on using GPTQ 4bit files in text-generation-webui are here](https://github.com/oobabooga/text-generation-webui/wiki/GPTQ-models-\(4-bit-mode\)).