Q4_0 version please
#4
by
Mykee
- opened
I like this model, and I would use it on mobile, but I should only use the plain Q4_0 on it, because it is automatically converted to ARM processor. However, you have not made a Q4_0 version, so I would ask you. Thanks in advance!
Mykee
changed discussion title from
Q4 version please
to Q4_0 version please
- add ARM-Friendly Q4_0 quant:
L3-8B-Stheno-v3.2-Q4_0-imat.gguf
Cheers!
Lewdiculous
changed discussion status to
closed
Thank you for quick response and model!