Exl2 quants please
#8
by
rjmehta
- opened
Thank you for this DPO version. Exl2 quants please
Hi,
Thanks for the request. I have never done Exl2 quants, but maybe we can ask
@LoneStriker
if he has time?
If not, I can look to see how to do it with high quality.
Hi,
Thanks for the request. I have never done Exl2 quants, but maybe we can ask @LoneStriker if he has time?
If not, I can look to see how to do it with high quality.
exl2 quants uploading here:
https://huggingface.co/models?sort=trending&search=LoneStriker+Llama-3-70B-Instruct-DPO-v0.4
rjmehta
changed discussion status to
closed