meiflwr
/

cs329x-prism-dpo

Model card Files Files and versions Community

Edit model card

Model Card for Model ID

This model is created for the CS329X class HW1, and was trained on 270 self-annotated preference pairs based on PRISM questions.

Downloads last month: 3

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for meiflwr/cs329x-prism-dpo

Base model

meta-llama/Llama-2-7b-chat-hf

Adapter

(1036)

this model