Exllama v2 Quantizations of Tess-v2.5.2-Qwen2-72B
Using turboderp's ExLlamaV2 v0.0.21 for quantization.
Original model: https://huggingface.co/migtissera/Tess-v2.5.2-Qwen2-72B
- Downloads last month
- 1
Inference API (serverless) is not available, repository is disabled.