DeusImperator/magnum-v3-34b_exl2_4.6bpw
Updated
Mid-range models exl2 quants
Exl2 quants of mid-range (20-40B) LLM models. Usually around 4-5 BPW
-
-
DeusImperator/magnum-v3-34b_exl2_4.6bpw_rpcal_mk2
Updated • 3 -
DeusImperator/magnum-32b-v2_exl2_4.7bpw_rpcal_mk2
Text Generation • Updated • 1 -
DeusImperator/magnum-32b-v2_exl2_4.7bpw
Text Generation • Updated • 3 -
DeusImperator/Star-Command-R-32B-v1_exl2_4.5bpw
Updated • 11 • 1 -
DeusImperator/Qwen2.5-32B-Instruct_exl2_4.7bpw_rpcal_mk2
Text Generation • Updated • 8 -
DeusImperator/Mistral-Small-Instruct-2409_exl2_6.8bpw_rpcal_mk2
Text Generation • Updated • 6 -
DeusImperator/Big-Tiger-Gemma-27B-v1_exl2_5.6bpw
Updated • 7