Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
frankenmoe
Merge
mergekit
lazymergekit
mlabonne/AlphaMonarch-7B
FPHam/Karen_TheEditor_V2_STRICT_Mistral_7B
SanjiWatsuki/Kunoichi-DPO-v2-7B
OmnicromsBrain/NeuralStar-7b-Lazy
conversational
Eval Results
text-generation-inference
Inference Endpoints
OmnicromsBrain
commited on
Commit
•
30f48bb
1
Parent(s):
cadde44
Update README.md
Browse files
README.md
CHANGED
@@ -23,7 +23,7 @@ base_model:
|
|
23 |
|
24 |
I was blown away by the writing results I was getting from mlabonne/Beyonder-4x7B-v3 while writing in NovelCrafter.
|
25 |
|
26 |
-
Inspired by his LLM Course and fueled by his LazyMergeKit.
|
27 |
I couldnt help but wonder what a writing model would be like if all 4 “experts” excelled in creative writing.
|
28 |
|
29 |
I present NeuralStar-AlphaWriter-4x7b:
|
@@ -35,6 +35,17 @@ NeuralStar_AlphaWriter_4x7b is a Mixture of Experts (MoE) made with the followin
|
|
35 |
* [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
|
36 |
* [OmnicromsBrain/NeuralStar-7b-Lazy](https://huggingface.co/OmnicromsBrain/NeuralStar-7b-Lazy)
|
37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
## 🧩 Configuration
|
39 |
|
40 |
```yaml
|
|
|
23 |
|
24 |
I was blown away by the writing results I was getting from mlabonne/Beyonder-4x7B-v3 while writing in NovelCrafter.
|
25 |
|
26 |
+
Inspired by his [LLM Course](https://github.com/mlabonne/llm-course) and fueled by his [LazyMergeKit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb).
|
27 |
I couldnt help but wonder what a writing model would be like if all 4 “experts” excelled in creative writing.
|
28 |
|
29 |
I present NeuralStar-AlphaWriter-4x7b:
|
|
|
35 |
* [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
|
36 |
* [OmnicromsBrain/NeuralStar-7b-Lazy](https://huggingface.co/OmnicromsBrain/NeuralStar-7b-Lazy)
|
37 |
|
38 |
+
## ⚡ Quantized Models
|
39 |
+
|
40 |
+
Thanks to MRadermacher for the quantized models
|
41 |
+
|
42 |
+
**.GGUF** https://huggingface.co/mradermacher/NeuralStar_AlphaWriter_4x7b-GGUF
|
43 |
+
|
44 |
+
Q4_K_M and Q5_K_M .gguf [**Here**](https://huggingface.co/OmnicromsBrain/NeuralStar_AlphaWriter_4x7b-GGUF) created with [mlabonne/Autogguf](https://colab.research.google.com/drive/1P646NEg33BZy4BfLDNpTz0V0lwIU3CHu)
|
45 |
+
|
46 |
+
|
47 |
+
|
48 |
+
|
49 |
## 🧩 Configuration
|
50 |
|
51 |
```yaml
|