Edit model card

Uploaded model

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Safetensors

Model size

7.24B params

Tensor type

BF16

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for RLHF-And-Friends/Zephyr-7B-DPO-0.05

Base model

Quantized

(7)

this model