Create README.md

README.md

@@ -0,0 +1,28 @@
+---
+license: other
+license_name: mrl
+license_link: https://mistral.ai/licenses/MRL-0.1.md
+language:
+  - en
+  - fr
+  - de
+  - es
+  - it
+  - pt
+  - zh
+  - ja
+  - ru 
+  - ko
+---
+
+EXL2 quants of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407/edit/main/README.md)
+
+_**This model requires the dev branch of ExLlamaV2 for now. New release coming soon with the necessary changes.**_
+
+[3.00 bits per weight](https://huggingface.co/turboderp/Mistral-Large-Instruct-2407-123B-exl2/tree/3.0bpw)     
+[3.50 bits per weight](https://huggingface.co/turboderp/Mistral-Large-Instruct-2407-123B-exl2/tree/3.5bpw)     
+[4.00 bits per weight](https://huggingface.co/turboderp/Mistral-Large-Instruct-2407-123B-exl2/tree/4.0bpw)     
+[4.25 bits per weight](https://huggingface.co/turboderp/Mistral-Large-Instruct-2407-123B-exl2/tree/4.25bpw)     
+[4.50 bits per weight](https://huggingface.co/turboderp/Mistral-Large-Instruct-2407-123B-exl2/tree/4.5bpw)     
+
+[measurement.json](https://huggingface.co/turboderp/Mistral-Large-Instruct-2407-123B-exl2/blob/main/measurement.json)