When trying to run the example, I get an error saying "Model type cohere2 not supported"
#2
by
shamikbose89
- opened
Is this something that is going to be supported soon? Thanks!
Updated with additional details:mlx_lm == 0.20.4
same problem i encountered
I copied "$VENV/site-packages/mlx_lm/models/cohere.py" to "$VENV/site-packages/mlx_lm/models/cohere2.py"
The error went away but the llm output was gibberish