metadata
license: other
license_name: mrl
license_link: https://mistral.ai/licenses/MRL-0.1.md
language:
- en
- fr
- de
- es
- it
- pt
- zh
- ja
- ru
- ko
EXL2 quants of Mistral-Large-Instruct-2407
This model requires the dev branch of ExLlamaV2 for now. New release coming soon with the necessary changes.
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.25 bits per weight
4.50 bits per weight