turboderp
/

Smaug-72B-exl2

Model card Files Files and versions Community

Smaug-72B-exl2 / README.md

turboderp's picture

Create README.md

4fa0509 verified 9 months ago

|

571 Bytes

EXL2 quants of Smaug-72B-v0.1.

2.50 bits per weight (coming soon)
3.00 bits per weight
4.00 bits per weight (coming soon)
5.00 bits per weight (coming soon)

measurement.json