EXL2 6.0 BPW quant of cyberagent/Mistral-Nemo-Japanese-Instruct-2408 w/ ExLlamaV2 0.2.7 using augmxnt/ultra-orca-boros-en-ja-v1 as calibration set

Downloads last month
9
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-exl2-6.0bpw

Collection including shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-exl2-6.0bpw