Using the new gguf quant method may result in a worse overall performance than that of the old gguf quants.
1
#2 opened about 1 year ago
by
TheYuriLover
Is th GGUF model compatible with llama.cpp?
1
#1 opened about 1 year ago
by
victorx98