| library_name: peft | |
| base_model: meta-llama/Meta-Llama-3-8B-Instruct | |
| license: other | |
| datasets: | |
| - argilla/dpo-mix-7k | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
| tags: | |
| - text-generation | |
| - llama | |
| - orpo | |
| - llama3 | |
| - text-generation-inference | |
| A finetuning experiment on llama3 8b it with selected 5k examples from argilla dpo 7k |