shuttle-2.5-mini

ExLlamav2 8 bpw quants of https://huggingface.co/shuttleai/shuttle-2.5-mini

Downloads last month
5
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for altomek/shuttle-2.5-mini-8bpw-EXL2

Quantized
(3)
this model