Exl Quant Request
Looks interesting and unique. Would like to try it so I'd like to request an exl quant of 4.5 bpw and 4.25 bpw just in case as I only have access to 15 gb vram.
Source files will be uploading right now. Likely EXL2 quants will be available in a day or two.
I can not make this on my machine - issues with install of TurboDep's "Exl2" maker.
No fault of his , my machine is "grumpy" sometimes.
Hi:
I checked models; seems to be a slow down in EXL2 model quants. (holidays?)
You may want to contact (via community tab):
https://huggingface.co/bartowski/
And ask him if he will make one.
As an alternative, there are google "colabs" which can also create EXL2 quants.
Stats show the source files for Grand Horror KOD have be downloaded 4 or more times as of this writing.