OmnicromsBrain commited on
Commit
30f48bb
1 Parent(s): cadde44

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -1
README.md CHANGED
@@ -23,7 +23,7 @@ base_model:
23
 
24
  I was blown away by the writing results I was getting from mlabonne/Beyonder-4x7B-v3 while writing in NovelCrafter.
25
 
26
- Inspired by his LLM Course and fueled by his LazyMergeKit.
27
  I couldnt help but wonder what a writing model would be like if all 4 “experts” excelled in creative writing.
28
 
29
  I present NeuralStar-AlphaWriter-4x7b:
@@ -35,6 +35,17 @@ NeuralStar_AlphaWriter_4x7b is a Mixture of Experts (MoE) made with the followin
35
  * [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
36
  * [OmnicromsBrain/NeuralStar-7b-Lazy](https://huggingface.co/OmnicromsBrain/NeuralStar-7b-Lazy)
37
 
 
 
 
 
 
 
 
 
 
 
 
38
  ## 🧩 Configuration
39
 
40
  ```yaml
 
23
 
24
  I was blown away by the writing results I was getting from mlabonne/Beyonder-4x7B-v3 while writing in NovelCrafter.
25
 
26
+ Inspired by his [LLM Course](https://github.com/mlabonne/llm-course) and fueled by his [LazyMergeKit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb).
27
  I couldnt help but wonder what a writing model would be like if all 4 “experts” excelled in creative writing.
28
 
29
  I present NeuralStar-AlphaWriter-4x7b:
 
35
  * [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
36
  * [OmnicromsBrain/NeuralStar-7b-Lazy](https://huggingface.co/OmnicromsBrain/NeuralStar-7b-Lazy)
37
 
38
+ ## ⚡ Quantized Models
39
+
40
+ Thanks to MRadermacher for the quantized models
41
+
42
+ **.GGUF** https://huggingface.co/mradermacher/NeuralStar_AlphaWriter_4x7b-GGUF
43
+
44
+ Q4_K_M and Q5_K_M .gguf [**Here**](https://huggingface.co/OmnicromsBrain/NeuralStar_AlphaWriter_4x7b-GGUF) created with [mlabonne/Autogguf](https://colab.research.google.com/drive/1P646NEg33BZy4BfLDNpTz0V0lwIU3CHu)
45
+
46
+
47
+
48
+
49
  ## 🧩 Configuration
50
 
51
  ```yaml