Model to MLX Request

#1
by MajinAnix - opened

Hi Mortiz, I am not sure where exactly I should put such request, but could you do mlx conversion of Bielik-11B-v2.3-Instruct? (8bit, 6bit, 4bit)

Hi Majin, unfortunately I was unable to convert it. If you want to try it yourself or in general want to know how to convert models to MLX here is a link to a tutorial: https://www.rudrank.com/exploring-mlx-quantizing-model-mlx-ios/ :)

Sign up or log in to comment