Plans for GPTQ quantized model

#15
by Tejasw1 - opened

Are there any plans to release GPTQ quantised model? If not, which dataset is preferred for the quantization?

Sign up or log in to comment