---
license: cc-by-nc-4.0
library_name: transformers
tags:
- alpaca
- mistral
- not-for-all-audiences
- nsfw
---
# IceMartiniRP (IceDrinkNameGoesHereRP-7b-Model_Stock-dpo)

## Details

Dpo of [IceDrinkNameGoesHereRP-7b-Model_Stock](https://huggingface.co/icefog72/IceDrinkNameGoesHereRP-7b-Model_Stock) 

Used datasets

```
icefog72/MyRulesDPO
MaziyarPanahi/truthy-dpo-v0.1-axolotl
argilla/distilabel-intel-orca-dpo-pairs
vicgalle/configurable-system-prompt-multitask
```