8B AWQ
Collection
164 items
•
Updated
•
1
mlabonne/OrpoLlama-3-8B AWQ
- Model creator: mlabonne
- Original model: OrpoLlama-3-8B
Model Summary
This is an ORPO fine-tune of meta-llama/Meta-Llama-3-8B on 1k samples of mlabonne/orpo-dpo-mix-40k created for this article.
It's a successful fine-tune that follows the ChatML template!
Try the demo: https://huggingface.co/spaces/mlabonne/OrpoLlama-3-8B
🔎 Application
This model uses a context window of 8k. It was trained with the ChatML template.
🏆 Evaluation
Nous
OrpoLlama-4-8B outperforms Llama-3-8B-Instruct on the GPT4All and TruthfulQA datasets.
- Downloads last month
- 79
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API has been turned off for this model.