grimjim commited on
Commit
ba141ca
1 Parent(s): 37040c1

Added more quants

Browse files
README.md CHANGED
@@ -6,14 +6,15 @@ tags:
6
  - mergekit
7
  - merge
8
  license: cc-by-nc-4.0
 
9
  ---
10
  # kululemon-spiked-9B-GGUF
11
 
12
- This is a Q8_0 GGUF quant of [kululemon-spiked-9B](https://huggingface.co/grimjim/kukulemon-spiked-9B).
13
 
14
  The model a frankenmerge of a pre-trained language model created using [mergekit](https://github.com/cg123/mergekit). As an experiment, this appears to be a partial success.
15
 
16
- Lightly tested with temperature 1 and minP 0.01 with ChatML prompts; the model supports Alpaca prompts and has 8K context length, a result of its Mistral v0.1 provenance. The model's output has been coherent and stable during aforementioned testing.
17
 
18
  The merge formula for this frankenmerge is below. It is conjectured that the shorter first section is not key to variation, the middle segment is key to balancing reasoning and variation, and that the lengthy final section is required for convergence and eventual stability. The internal instability is probably better suited for narrative involving unstable and/or unhinged characters and situations.
19
 
 
6
  - mergekit
7
  - merge
8
  license: cc-by-nc-4.0
9
+ pipeline_tag: text-generation
10
  ---
11
  # kululemon-spiked-9B-GGUF
12
 
13
+ This repository contains GGUF quants of [kululemon-spiked-9B](https://huggingface.co/grimjim/kukulemon-spiked-9B).
14
 
15
  The model a frankenmerge of a pre-trained language model created using [mergekit](https://github.com/cg123/mergekit). As an experiment, this appears to be a partial success.
16
 
17
+ Lightly tested with temperature 1 and minP 0.01 with ChatML prompts; the model supports Alpaca prompts and has solid 8K context length, a result of its Mistral v0.1 provenance. The model's output has been coherent and stable during aforementioned testing.
18
 
19
  The merge formula for this frankenmerge is below. It is conjectured that the shorter first section is not key to variation, the middle segment is key to balancing reasoning and variation, and that the lengthy final section is required for convergence and eventual stability. The internal instability is probably better suited for narrative involving unstable and/or unhinged characters and situations.
20
 
kukulemon-spiked-9B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35fd8a7b7af0f9d13f28f2bda2a58a84047846c7dd72a312197702211365c7a2
3
+ size 5415053248
kukulemon-spiked-9B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59949ac4c1bdf1ad4b209e8ec6d3a093eeeccafb001e896ee5a3c4aec4947432
3
+ size 6364669888
kukulemon-spiked-9B.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d68a85e7ba650e11f9303d73ef7cb7be72fddf49d5c6c3ec0dfff681b77ea546
3
+ size 7373637568