Lyra

MN-12B-Lyra-v4-4bpw-h6-exl2

This is a 4bpw h6 exl2 quant of MN-12B-Lyra-v4

Built-in(default) calibration dataset is used.

Downloads last month
8
Inference API
Unable to determine this model's library. Check the docs .

Model tree for riveRiPH/MN-12B-Lyra-v4-4bpw-h6-exl2

Quantized
this model

Collection including riveRiPH/MN-12B-Lyra-v4-4bpw-h6-exl2