jeonsworld commited on
Commit
40b4eb6
1 Parent(s): a797e7e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -7
README.md CHANGED
@@ -5,17 +5,35 @@ language:
5
  ---
6
 
7
  # CarbonVillain
 
8
 
9
- ## Model description
 
 
 
10
 
11
- More information needed
12
 
13
- ## Intended uses & limitations
14
 
15
- More information needed
 
 
16
 
17
- ## Training and evaluation data
 
 
18
 
19
- More information needed
20
 
21
- ## Training procedure
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  # CarbonVillain
8
+ This model is an experimental version created using (mergekit)[https://github.com/cg123/mergekit].
9
 
10
+ - merge models
11
+ - Weyaxi/SauerkrautLM-UNA-SOLAR-Instruct
12
+ - https://huggingface.co/VAGOsolutions/SauerkrautLM-SOLAR-Instruct
13
+ - method: slerp
14
 
15
+ This model is the same as CarbonVillain-en-13B-v1 and was registered twice due to my mistake.
16
 
17
+ # Prompt Template(s)
18
 
19
+ ```
20
+ ### User:
21
+ {user}
22
 
23
+ ### Assistant:
24
+ {asistant}
25
+ ```
26
 
 
27
 
28
+ # Evaluation
29
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_jeonsworld__CarbonVillain-en-10.7B-v1)
30
+
31
+ | Metric | Value |
32
+ |-----------------------|---------------------------|
33
+ | Avg. | 74.27 |
34
+ | ARC (25-shot) | 71.24 |
35
+ | HellaSwag (10-shot) | 88.45 |
36
+ | MMLU (5-shot) | 66.42 |
37
+ | TruthfulQA (0-shot) | 71.97 |
38
+ | Winogrande (5-shot) | 83.26 |
39
+ | GSM8K (5-shot) | 64.29 |