Llamacpp Quantization of Qwenstien2.5-32B-Instruct
Original model https://huggingface.co/maldv/Qwenstein2.5-32B-Instruct
All thanks should go to the original model creator.
This is my first quantization of a model so if you find anything wrong with the quant please let me know.