Of course this is a unworkable model, I only use this to test mergekit and llama.cpp on my Apple M2 Macbook, do not use unless I somehow finetune it with the MoD dataset. My minor mergekit fix for anyone using on M2 with Rossetta.
- Downloads last month
- 2
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.