Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ inference: false
|
|
10 |
|
11 |
This is GGML format quantised 4bit and 5bit models of [Eric Hartford's 'uncensored' training of Wizard-Vicuna 13B](https://huggingface.co/ehartford/Wizard-Vicuna-13B-Uncensored).
|
12 |
|
13 |
-
|
14 |
|
15 |
## Repositories available
|
16 |
|
|
|
10 |
|
11 |
This is GGML format quantised 4bit and 5bit models of [Eric Hartford's 'uncensored' training of Wizard-Vicuna 13B](https://huggingface.co/ehartford/Wizard-Vicuna-13B-Uncensored).
|
12 |
|
13 |
+
This repo is the result of quantising to 4bit and 5bit GGML for CPU inference using [llama.cpp](https://github.com/ggerganov/llama.cpp).
|
14 |
|
15 |
## Repositories available
|
16 |
|