Hugging Face's logo

xxx777xxxASD
/
PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0

Text Generation
Transformers
Safetensors
English
mixtral
Merge
Mixture of Experts
conversational
text-generation-inference
Inference Endpoints
Model card Files Community

image/png

ExLlamaV2 BPW 4.0 quant of xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k

(Fits in 12GB VRAM/16k context/4-bit cache)

Downloads last month
20
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.

Collection including xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0