| license: apache-2.0 | |
| tags: | |
| - MetaModelv2 | |
| - merge | |
| # MetaModelv2 | |
| This model is a hybrid of the following models and is trained using the following configuration: | |
| * [VAGOsolutions/SauerkrautLM-SOLAR-Instruct](https://huggingface.co/VAGOsolutions/SauerkrautLM-SOLAR-Instruct) | |
| * [kyujinpy/Sakura-SOLAR-Instruct](https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct) | |
| # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) | |
| Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_gagan3012__MetaModelv2) | |
| | Metric | Value | | |
| |-----------------------|---------------------------| | |
| | Avg. | 74.24 | | |
| | ARC (25-shot) | 71.08 | | |
| | HellaSwag (10-shot) | 88.56 | | |
| | MMLU (5-shot) | 66.29 | | |
| | TruthfulQA (0-shot) | 71.94 | | |
| | Winogrande (5-shot) | 83.11 | | |
| | GSM8K (5-shot) | 64.44 | | |