|
--- |
|
license: apache-2.0 |
|
--- |
|
|
|
# Base Model - SOLAR-10.7B |
|
|
|
This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral. |
|
|
|
Please check specific details in the GitHub Repository. |
|
|
|
GitHub Repository: https://github.com/gauss5930/iDUS |
|
|
|
# 🏆 HuggingFace Open LLM Leaderboard |
|
|
|
|Model|ARC|HellaSwag|MMLU|TruthfulQA|Winogrande|GSM8K|Average| |
|
|---|---|---|---|---|---|---|---| |
|
|Llama2_init_Mistral|60.07|83.3|64.09|42.15|78.37|37.91|60.98| |
