README.md

---
license: cc-by-nc-4.0
library_name: transformers
base_model:
- nbeerbower/Lyra4-Gutenberg2-12B
---
![image/png](https://huggingface.co/nbeerbower/Mistral-Small-Gutenberg-Doppel-22B/resolve/main/doppel-header?download=true)

# Lyra4-Gutenberg2-12B-6bpw-h8-exl2

This is a 6bpw h8 exl2 quant of [Lyra4-Gutenberg2-12B](https://huggingface.co/nbeerbower/Lyra4-Gutenberg2-12B)

Built-in(default) calibration dataset is used.