Hugging Face's logo

xxx777xxxASD
/
PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0

Text Generation
Transformers
Safetensors
English
mixtral
Merge
Mixture of Experts
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
xxx777xxxASD commited on
Commit
71563c1
·
verified ·
1 Parent(s): 92a0e25

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -7,4 +7,5 @@ tags:
7
  ---
8
  ![image/png](https://i.ibb.co/Z19xdzd/icon3.png)
9
 
10
- ExLlamaV2 BPW 4.0 quant of [xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k)
 
 
7
  ---
8
  ![image/png](https://i.ibb.co/Z19xdzd/icon3.png)
9
 
10
+ ExLlamaV2 BPW 4.0 quant of [xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k)
11
+ (Fits in 12GB VRAM/14k context/4-bit cache)