metadata
license: mit
language:
- en
CarbonVillain
This model is an experimental version created using (mergekit)[https://github.com/cg123/mergekit].
- merge models
- Weyaxi/SauerkrautLM-UNA-SOLAR-Instruct
- https://huggingface.co/VAGOsolutions/SauerkrautLM-SOLAR-Instruct
- method: slerp
This model is the same as CarbonVillain-en-13B-v1 and was registered twice due to my mistake.
Prompt Template(s)
### User:
{user}
### Assistant:
{asistant}
Evaluation
Detailed results can be found here
Metric | Value |
---|---|
Avg. | 74.27 |
ARC (25-shot) | 71.24 |
HellaSwag (10-shot) | 88.45 |
MMLU (5-shot) | 66.42 |
TruthfulQA (0-shot) | 71.97 |
Winogrande (5-shot) | 83.26 |
GSM8K (5-shot) | 64.29 |