README.md

---
license: apache-2.0
datasets:
- jondurbin/truthy-dpo-v0.1
language:
- en
library_name: transformers
pipeline_tag: text-generation
tags:
- merge
- dpo
- text-generation-inference
---

DPO Finetuned paulml/OGNO-7B using jondurbin/truthy-dpo-v0.1

paulml/OGNO-7B is a mistral 7b variant afaik and this repo is an experimental repo, so might not be useable in prod

Thx for the great data sources.