T145 commited on
Commit
6b64519
·
verified ·
1 Parent(s): 6c4fdd6

Removed old results

Browse files
Files changed (1) hide show
  1. README.md +0 -113
README.md CHANGED
@@ -9,105 +9,6 @@ tags:
9
  base_model:
10
  - T145/ZEUS-8B-V2
11
  license: llama3.1
12
- model-index:
13
- - name: ZEUS-8B-V2-abliterated
14
- results:
15
- - task:
16
- type: text-generation
17
- name: Text Generation
18
- dataset:
19
- name: IFEval (0-Shot)
20
- type: wis-k/instruction-following-eval
21
- split: train
22
- args:
23
- num_few_shot: 0
24
- metrics:
25
- - type: inst_level_strict_acc and prompt_level_strict_acc
26
- value: 74.57
27
- name: averaged accuracy
28
- source:
29
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V2-abliterated
30
- name: Open LLM Leaderboard
31
- - task:
32
- type: text-generation
33
- name: Text Generation
34
- dataset:
35
- name: BBH (3-Shot)
36
- type: SaylorTwift/bbh
37
- split: test
38
- args:
39
- num_few_shot: 3
40
- metrics:
41
- - type: acc_norm
42
- value: 30.34
43
- name: normalized accuracy
44
- source:
45
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V2-abliterated
46
- name: Open LLM Leaderboard
47
- - task:
48
- type: text-generation
49
- name: Text Generation
50
- dataset:
51
- name: MATH Lvl 5 (4-Shot)
52
- type: lighteval/MATH-Hard
53
- split: test
54
- args:
55
- num_few_shot: 4
56
- metrics:
57
- - type: exact_match
58
- value: 20.39
59
- name: exact match
60
- source:
61
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V2-abliterated
62
- name: Open LLM Leaderboard
63
- - task:
64
- type: text-generation
65
- name: Text Generation
66
- dataset:
67
- name: GPQA (0-shot)
68
- type: Idavidrein/gpqa
69
- split: train
70
- args:
71
- num_few_shot: 0
72
- metrics:
73
- - type: acc_norm
74
- value: 7.05
75
- name: acc_norm
76
- source:
77
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V2-abliterated
78
- name: Open LLM Leaderboard
79
- - task:
80
- type: text-generation
81
- name: Text Generation
82
- dataset:
83
- name: MuSR (0-shot)
84
- type: TAUR-Lab/MuSR
85
- args:
86
- num_few_shot: 0
87
- metrics:
88
- - type: acc_norm
89
- value: 9.59
90
- name: acc_norm
91
- source:
92
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V2-abliterated
93
- name: Open LLM Leaderboard
94
- - task:
95
- type: text-generation
96
- name: Text Generation
97
- dataset:
98
- name: MMLU-PRO (5-shot)
99
- type: TIGER-Lab/MMLU-Pro
100
- config: main
101
- split: test
102
- args:
103
- num_few_shot: 5
104
- metrics:
105
- - type: acc
106
- value: 31.94
107
- name: accuracy
108
- source:
109
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V2-abliterated
110
- name: Open LLM Leaderboard
111
  ---
112
 
113
  # ZEUS 8B 🌩️ V2 - ABLITERATED
@@ -308,17 +209,3 @@ slices:
308
  model: unsloth/Meta-Llama-3.1-8B-Instruct
309
  tokenizer_source: base
310
  ```
311
-
312
- # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
313
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/T145__ZEUS-8B-V2-abliterated-details)!
314
- Summarized results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/contents/viewer/default/train?q=T145%2FZEUS-8B-V2-abliterated&sort[column]=Average%20%E2%AC%86%EF%B8%8F&sort[direction]=desc)!
315
-
316
- | Metric |Value (%)|
317
- |-------------------|--------:|
318
- |**Average** | 28.98|
319
- |IFEval (0-Shot) | 74.57|
320
- |BBH (3-Shot) | 30.34|
321
- |MATH Lvl 5 (4-Shot)| 20.39|
322
- |GPQA (0-shot) | 7.05|
323
- |MuSR (0-shot) | 9.59|
324
- |MMLU-PRO (5-shot) | 31.94|
 
9
  base_model:
10
  - T145/ZEUS-8B-V2
11
  license: llama3.1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  # ZEUS 8B 🌩️ V2 - ABLITERATED
 
209
  model: unsloth/Meta-Llama-3.1-8B-Instruct
210
  tokenizer_source: base
211
  ```