Update README.md
Browse filesAdded link to GGUF; updated name
README.md
CHANGED
@@ -8,7 +8,7 @@ tags:
|
|
8 |
- merge
|
9 |
license: cc-by-nc-4.0
|
10 |
---
|
11 |
-
# kukulemon-7B
|
12 |
|
13 |
This is an 8.0bpw h8 exl2 quant of a merger of two similar models with strong reasoning, hopefully resulting in "dense" encoding of said reasoning, was merged with a model targeting roleplay.
|
14 |
|
@@ -17,6 +17,7 @@ I've tested with ChatML prompts with temperature=1.1 and minP=0.03. The model it
|
|
17 |
Alternative downloads:
|
18 |
[GGUF quants courtesy of Lewdiculous](https://huggingface.co/Lewdiculous/kukulemon-7B-GGUF-IQ-Imatrix)
|
19 |
[fp16 safetensors](https://huggingface.co/grimjim/kukulemon-7B)
|
|
|
20 |
|
21 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
22 |
|
|
|
8 |
- merge
|
9 |
license: cc-by-nc-4.0
|
10 |
---
|
11 |
+
# kukulemon-7B-8.0bpw-h8_exl2
|
12 |
|
13 |
This is an 8.0bpw h8 exl2 quant of a merger of two similar models with strong reasoning, hopefully resulting in "dense" encoding of said reasoning, was merged with a model targeting roleplay.
|
14 |
|
|
|
17 |
Alternative downloads:
|
18 |
[GGUF quants courtesy of Lewdiculous](https://huggingface.co/Lewdiculous/kukulemon-7B-GGUF-IQ-Imatrix)
|
19 |
[fp16 safetensors](https://huggingface.co/grimjim/kukulemon-7B)
|
20 |
+
[Q8_0 GGUF](https://huggingface.co/grimjim/kukulemon-7B-GGUF)
|
21 |
|
22 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
23 |
|