A Mistral-7B pruned50 with Marlin Kernel and AutoGPTQ
Please see my tutorial to execute this model:
- Downloads last month
- 9
Inference API (serverless) is not available, repository is disabled.
A Mistral-7B pruned50 with Marlin Kernel and AutoGPTQ
Please see my tutorial to execute this model: