Text Generation
Transformers
Safetensors
English
llama
causal-lm
text-generation-inference
4-bit precision
gptq
TheBloke commited on
Commit
910ca7b
1 Parent(s): 4c3d3ac

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -37,10 +37,16 @@ Load text-generation-webui as you normally do.
37
  7. In the **Model drop-down**: choose this model: `stable-vicuna-13B-GPTQ`.
38
  8. Click **Reload the Model** in the top right.
39
  9. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 
 
 
 
 
 
40
 
41
  ## GIBBERISH OUTPUT IN `text-generation-webui`?
42
 
43
- If you're installing the model files manually, olease read the Provided Files section below. You should use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors` unless you are able to use the latest GPTQ-for-LLaMa code.
44
 
45
  If you're using a text-generation-webui one click installer, you MUST use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`.
46
 
 
37
  7. In the **Model drop-down**: choose this model: `stable-vicuna-13B-GPTQ`.
38
  8. Click **Reload the Model** in the top right.
39
  9. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
40
+
41
+ Note that the automatic download will currently download two model files, and you only need one.
42
+
43
+ Feel free to delete `stable-vicuna-13B-GPTQ-4bit.latest.no-act-order.safetensors` after it's downloaded (unless you know you can use latest GPTQ-for-LLaMa code as described below, in which case delete the 'compat' file instead.)
44
+
45
+ I will soon improve this repo so only one file is downloaded.
46
 
47
  ## GIBBERISH OUTPUT IN `text-generation-webui`?
48
 
49
+ If you're installing the model files manually, please read the Provided Files section below. You should use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors` unless you are able to use the latest GPTQ-for-LLaMa code.
50
 
51
  If you're using a text-generation-webui one click installer, you MUST use `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`.
52