Quantized 4x MoE of this model.

#5
by Kquant03 - opened

https://huggingface.co/Kquant03/MistralTrix-4x9B-ERP-GGUF

Thank you so much for training this model, man. You're a legend.

(edit: llama.cpp is bugged again, I have to go back again for the 3rd time and work on this...πŸ˜”)

Sign up or log in to comment