---
license: apache-2.0
---

# Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS

# 🏆 HuggingFace Open LLM Leaderboard

|Model|ARC|HellaSwag|MMLU|TruthfulQA|Winogrande|GSM8K|Average|
|---|---|---|---|---|---|---|---|
|Llama2_init_Mistral|60.07|83.3|64.09|42.15|78.37|37.91|60.98|