dranger003

/

deepseek-coder-33b-instruct-iMat.GGUF

like 7

Hi Dan,

Is there any chance you could try to re-quantize this model with the new Q1_S algorithm in llama.cpp?

https://github.com/ggerganov/llama.cpp/pull/5999

Alternatively, could you maybe upload the imatrix.dat file you used for this quantization?

Thanks. :)