TheBloke
/

Falcon-7B-Instruct-GPTQ

Text Generation

RefinedWebModel

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Jun 22, 2023

Commit

6d5351c

•

1 Parent(s): d65910c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -81,7 +81,7 @@ So please first update text-genration-webui to the latest version.
 8. In the **Model drop-down**: choose the model you just downloaded, `falcon-7B-instruct-GPTQ`.
 9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
 10. Tick **Trust Remote Code**, followed by **Save Settings**
-11. Make sure Click **Reload**.
 12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 ## About `trust_remote_code`

 8. In the **Model drop-down**: choose the model you just downloaded, `falcon-7B-instruct-GPTQ`.
 9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
 10. Tick **Trust Remote Code**, followed by **Save Settings**
+11. Click **Reload**.
 12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 ## About `trust_remote_code`