EXL2 quants of [Smaug-72B-v0.1](https://huggingface.co/abacusai/Smaug-72B-v0.1). [2.50 bits per weight](https://huggingface.co/turboderp/Smaug-72B-exl2/tree/2.5bpw) (coming soon) [3.00 bits per weight](https://huggingface.co/turboderp/Smaug-72B-exl2/tree/3.0bpw) [4.00 bits per weight](https://huggingface.co/turboderp/Smaug-72B-exl2/tree/4.0bpw) (coming soon) [5.00 bits per weight](https://huggingface.co/turboderp/Smaug-72B-exl2/tree/5.0bpw) (coming soon) [measurement.json](https://huggingface.co/turboderp/Smaug-72B-exl2/blob/main/measurement.json)