Adding Evaluation Results

README.md

@@ -1,20 +1,20 @@
 ---
+language:
+- en
 license: other
-license_name: gemma-terms-of-use
-license_link: https://ai.google.dev/gemma/terms
 library_name: transformers
-base_model: google/gemma-2b
 tags:
 - trl
 - orpo
 - generated_from_trainer
+base_model: google/gemma-2b
+datasets:
+- alvarobartt/dpo-mix-7k-simplified
+license_name: gemma-terms-of-use
+license_link: https://ai.google.dev/gemma/terms
 model-index:
 - name: gemma-2b-orpo
   results: []
-datasets:
-- alvarobartt/dpo-mix-7k-simplified
-language:
-- en
 ---
 
 <img src="./assets/gemma-2b-orpo.png" width="450"></img>
@@ -77,4 +77,17 @@ The model was trained using HF TRL.
 - Transformers 4.39.1
 - Pytorch 2.2.0+cu121
 - Datasets 2.18.0
-- Tokenizers 0.15.2
+- Tokenizers 0.15.2
+# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
+Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_anakin87__gemma-2b-orpo)
+
+|             Metric              |Value|
+|---------------------------------|----:|
+|Avg.                             |47.35|
+|AI2 Reasoning Challenge (25-Shot)|49.15|
+|HellaSwag (10-Shot)              |73.72|
+|MMLU (5-Shot)                    |38.52|
+|TruthfulQA (0-shot)              |44.53|
+|Winogrande (5-shot)              |64.33|
+|GSM8k (5-shot)                   |13.87|
+