Exl2 versions
#3
by
Handgun1773
- opened
Do you plan on doing exl2 for the r1 distill familly? It would be very nice.
As always, thanks for the great work, people like you carry the open source ai community.
Yeah I think I will after my GPU is less busy from my current imatrix :) my poor 3090 can only handle so much at once 😂