Quantized 4x MoE of this model.
#5
by
Kquant03
- opened
https://huggingface.co/Kquant03/MistralTrix-4x9B-ERP-GGUF
Thank you so much for training this model, man. You're a legend.
(edit: llama.cpp is bugged again, I have to go back again for the 3rd time and work on this...π)