Yhyu13

/

oasst-rlhf-2-llama-30b-7k-steps-gptq-4bit

like 3

First of all, thank you for all the work you have done. Without it, I couldn't have executed such large models. I'm following you closely... I just wanted to make a request if it's possible that you could quantify this model at 2 bits. Kind regards