Hugging Face's logo

sthenno-com
/
miscii-14b-1225

Text Generation
Transformers
Safetensors
English
Chinese
qwen2
mergekit
Merge
custom-research
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
4
sthenno commited on
Commit
02e19f4
·
verified ·
1 Parent(s): d7addda

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -28,7 +28,8 @@ model-index:
28
  value: 78.78
29
  name: strict accuracy
30
  source:
31
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
 
32
  name: Open LLM Leaderboard
33
  - task:
34
  type: text-generation
@@ -43,7 +44,8 @@ model-index:
43
  value: 50.91
44
  name: normalized accuracy
45
  source:
46
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
 
47
  name: Open LLM Leaderboard
48
  - task:
49
  type: text-generation
@@ -58,7 +60,8 @@ model-index:
58
  value: 31.57
59
  name: exact match
60
  source:
61
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
 
62
  name: Open LLM Leaderboard
63
  - task:
64
  type: text-generation
@@ -73,7 +76,8 @@ model-index:
73
  value: 17
74
  name: acc_norm
75
  source:
76
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
 
77
  name: Open LLM Leaderboard
78
  - task:
79
  type: text-generation
@@ -88,7 +92,8 @@ model-index:
88
  value: 14.77
89
  name: acc_norm
90
  source:
91
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
 
92
  name: Open LLM Leaderboard
93
  - task:
94
  type: text-generation
@@ -105,8 +110,10 @@ model-index:
105
  value: 47.46
106
  name: accuracy
107
  source:
108
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
 
109
  name: Open LLM Leaderboard
 
110
  ---
111
 
112
  # miscii-14b-1225
@@ -197,5 +204,4 @@ As of **December 25, 2024**, this should be the **best-performing 14B model** in
197
  |MATH Lvl 5 (4-Shot)|45.17|
198
  |GPQA (0-shot) |17.00|
199
  |MuSR (0-shot) |14.77|
200
- |MMLU-PRO (5-shot) |47.46|
201
-
 
28
  value: 78.78
29
  name: strict accuracy
30
  source:
31
+ url: >-
32
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
33
  name: Open LLM Leaderboard
34
  - task:
35
  type: text-generation
 
44
  value: 50.91
45
  name: normalized accuracy
46
  source:
47
+ url: >-
48
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
49
  name: Open LLM Leaderboard
50
  - task:
51
  type: text-generation
 
60
  value: 31.57
61
  name: exact match
62
  source:
63
+ url: >-
64
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
65
  name: Open LLM Leaderboard
66
  - task:
67
  type: text-generation
 
76
  value: 17
77
  name: acc_norm
78
  source:
79
+ url: >-
80
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
81
  name: Open LLM Leaderboard
82
  - task:
83
  type: text-generation
 
92
  value: 14.77
93
  name: acc_norm
94
  source:
95
+ url: >-
96
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
97
  name: Open LLM Leaderboard
98
  - task:
99
  type: text-generation
 
110
  value: 47.46
111
  name: accuracy
112
  source:
113
+ url: >-
114
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
115
  name: Open LLM Leaderboard
116
+ new_version: sthenno-com/miscii-14b-0218
117
  ---
118
 
119
  # miscii-14b-1225
 
204
  |MATH Lvl 5 (4-Shot)|45.17|
205
  |GPQA (0-shot) |17.00|
206
  |MuSR (0-shot) |14.77|
207
+ |MMLU-PRO (5-shot) |47.46|