Hugging Face's logo

xxx777xxxASD
/
PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0

Text Generation
Transformers
Safetensors
English
mixtral
Merge
Mixture of Experts
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0
File size: 309 Bytes 
0738dc7
 
92a0e25
 
 
 
be6635e
0738dc7
52ff44c
92a0e25
71563c1
c4a878a
eaedbad
 
1
2
3
4
5
6
7
8
9
10
11
12
13
 
---
license: apache-2.0
language:
- en
tags:
- merge
- moe
---
![image/png](https://i.ibb.co/7k4j8Gm/icon10.png)

ExLlamaV2 BPW 4.0 quant of [xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k)

(Fits in 12GB VRAM/16k context/4-bit cache)