---
license: apache-2.0
datasets:
- argilla/distilabel-intel-orca-dpo-pairs
tags:
- dpo
- 11B
---

# NeuralBeagle-11B

DPO'd from vicgalle/franken-Beagle-11B, a Beagle-like model upscaled to 11B. 
It is a frankenmerge model created using mergekit. Then, we applied DPO over a high-quality preference dataset.

![image/png](https://cdn-uploads.huggingface.co/production/uploads/5fad8602b8423e1d80b8a965/6u4L-v7GHZWSJq2CT40TS.png)