Update README.md

README.md

@@ -54,7 +54,7 @@ Fine-tuning datasets for this model are based on [Stack Exchange Paired](https:/
 **DPO Training:** [https://huggingface.co/datasets/lvwerra/stack-exchange-paired/tree/main/data/rl](https://huggingface.co/datasets/lvwerra/stack-exchange-paired/tree/main/data/rl)
 
 ### Training Procedure
-The model was first fine-tuned on the Stack Exchange question and answer pairs and then fine-tuned via the DPO training procedure using a Stack Exchange Reward Model. 
+The model was first fine-tuned on the Stack Exchange question and answer pairs and then fine-tuned via the DPO training procedure using the SFT model as the reference model.  
 It is trained to respond to prompts with the following template:
 
 ```