GPTQ quantization

#1
by MartaZ - opened

Can you provide GPTQ versions of that too please ?
It should work faster with Exllama.
Please...

Owner

yes, today

Sign up or log in to comment