Spaces:
Running
Running
Error: [quantize] The requested number of bits 3 is not supported. The supported bits are 2, 4 and 8.
#34
by
Felladrin
- opened
The quantization options Q3 and Q6 were added in https://huggingface.co/spaces/mlx-community/mlx-my-repo/discussions/31
But when we try converting, it throws the error:
Error: [quantize] The requested number of bits 3 is not supported. The supported bits are 2, 4 and 8.
Looking into it!
This should work now: I just created a Q3 to test: https://huggingface.co/reach-vb/Qwen2.5-0.5B-Instruct-Q3-mlx
reach-vb
changed discussion status to
closed
Thank you for fixing it so fast! 🙏