Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
GGUF of a merged checkpoint 4320 [ausboss/llama2-13b-supercot-loras2](https://huggingface.co/ausboss/llama2-13b-supercot-loras2) with base Llama 2 13B. It is currently only quantised to Q5_K_M as this is the smallest size with comparable accuracy to 8bit (almost lossless). I have a fp16 GGUF and will probably quant to 8bit and 4bit GGUF soon.
|
2 |
|
3 |
-
Ausboss' original model card with the LoRA training info
|
4 |
|
5 |
### Training procedure
|
6 |
|
|
|
1 |
GGUF of a merged checkpoint 4320 [ausboss/llama2-13b-supercot-loras2](https://huggingface.co/ausboss/llama2-13b-supercot-loras2) with base Llama 2 13B. It is currently only quantised to Q5_K_M as this is the smallest size with comparable accuracy to 8bit (almost lossless). I have a fp16 GGUF and will probably quant to 8bit and 4bit GGUF soon.
|
2 |
|
3 |
+
Ausboss' original model card with the LoRA training info. See his model page for further information.
|
4 |
|
5 |
### Training procedure
|
6 |
|