Update README.md
Browse files
README.md
CHANGED
@@ -5,15 +5,15 @@ license: other
|
|
5 |
|
6 |
# Tim Dettmers' Guanaco 13B GPTQ
|
7 |
|
8 |
-
These files are GPTQ 4bit model files for [Tim Dettmers' Guanaco
|
9 |
|
10 |
-
It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
|
11 |
|
12 |
## Other repositories available
|
13 |
|
14 |
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/TheBloke/guanaco-13B-GPTQ)
|
15 |
* [4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference](https://huggingface.co/TheBloke/guanaco-13B-GGML)
|
16 |
-
* [Original unquantised fp16 model in HF format](https://huggingface.co/
|
17 |
|
18 |
## How to easily download and use this model in text-generation-webui
|
19 |
|
|
|
5 |
|
6 |
# Tim Dettmers' Guanaco 13B GPTQ
|
7 |
|
8 |
+
These files are GPTQ 4bit model files for [Tim Dettmers' Guanaco 13B](https://huggingface.co/timdettmers/guanaco-13b).
|
9 |
|
10 |
+
It is the result of merging the LoRA then quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
|
11 |
|
12 |
## Other repositories available
|
13 |
|
14 |
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/TheBloke/guanaco-13B-GPTQ)
|
15 |
* [4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference](https://huggingface.co/TheBloke/guanaco-13B-GGML)
|
16 |
+
* [Original unquantised fp16 model in HF format](https://huggingface.co/TheBloke/guanaco-13B-HF)
|
17 |
|
18 |
## How to easily download and use this model in text-generation-webui
|
19 |
|