DPO vs non-DPO
#1
by
lazyDataScientist
- opened
Was there any significant difference with DPO being used? What are the technical benefits of DPO?
Was there any significant difference with DPO being used? What are the technical benefits of DPO?
The DPO is our chat model. You can use Vicuna template or ChatML template. :)