Update README.md
Browse files
README.md
CHANGED
@@ -37,10 +37,16 @@ Load text-generation-webui as you normally do.
|
|
37 |
7. In the **Model drop-down**: choose this model: `stable-vicuna-13B-GPTQ`.
|
38 |
8. Click **Reload the Model** in the top right.
|
39 |
9. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
|
|
|
|
|
|
|
|
|
|
|
|
|
40 |
|
41 |
## GIBBERISH OUTPUT IN `text-generation-webui`?
|
42 |
|
43 |
-
If you're installing the model files manually,
|
44 |
|
45 |
If you're using a text-generation-webui one click installer, you MUST use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`.
|
46 |
|
|
|
37 |
7. In the **Model drop-down**: choose this model: `stable-vicuna-13B-GPTQ`.
|
38 |
8. Click **Reload the Model** in the top right.
|
39 |
9. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
|
40 |
+
|
41 |
+
Note that the automatic download will currently download two model files, and you only need one.
|
42 |
+
|
43 |
+
Feel free to delete `stable-vicuna-13B-GPTQ-4bit.latest.no-act-order.safetensors` after it's downloaded (unless you know you can use latest GPTQ-for-LLaMa code as described below, in which case delete the 'compat' file instead.)
|
44 |
+
|
45 |
+
I will soon improve this repo so only one file is downloaded.
|
46 |
|
47 |
## GIBBERISH OUTPUT IN `text-generation-webui`?
|
48 |
|
49 |
+
If you're installing the model files manually, please read the Provided Files section below. You should use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors` unless you are able to use the latest GPTQ-for-LLaMa code.
|
50 |
|
51 |
If you're using a text-generation-webui one click installer, you MUST use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`.
|
52 |
|