Hugging Face's logo

prithivMLmods
/
Calcium-Opus-14B-Elite

Text Generation
Transformers
Safetensors
English
qwen2
opus
elite
14B
calcium
qwq
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
1
prithivMLmods commited on
Commit
94839fc
·
verified ·
1 Parent(s): c7a5125

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -9,6 +9,7 @@ library_name: transformers
9
  tags:
10
  - qwen
11
  - opus
 
12
  model-index:
13
  - name: Calcium-Opus-14B-Elite
14
  results:
@@ -26,7 +27,8 @@ model-index:
26
  value: 60.64
27
  name: averaged accuracy
28
  source:
29
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
30
  name: Open LLM Leaderboard
31
  - task:
32
  type: text-generation
@@ -42,7 +44,8 @@ model-index:
42
  value: 46.53
43
  name: normalized accuracy
44
  source:
45
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
46
  name: Open LLM Leaderboard
47
  - task:
48
  type: text-generation
@@ -58,7 +61,8 @@ model-index:
58
  value: 37.08
59
  name: exact match
60
  source:
61
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
62
  name: Open LLM Leaderboard
63
  - task:
64
  type: text-generation
@@ -74,7 +78,8 @@ model-index:
74
  value: 16.44
75
  name: acc_norm
76
  source:
77
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
78
  name: Open LLM Leaderboard
79
  - task:
80
  type: text-generation
@@ -89,7 +94,8 @@ model-index:
89
  value: 20.95
90
  name: acc_norm
91
  source:
92
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
93
  name: Open LLM Leaderboard
94
  - task:
95
  type: text-generation
@@ -106,7 +112,8 @@ model-index:
106
  value: 47.85
107
  name: accuracy
108
  source:
109
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
110
  name: Open LLM Leaderboard
111
  ---
112
  ![opus.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/BELYApcX2oNMRsOW6nIyR.gif)
@@ -217,5 +224,4 @@ Summarized results can be found [here](https://huggingface.co/datasets/open-llm-
217
  |MATH Lvl 5 (4-Shot)| 37.08|
218
  |GPQA (0-shot) | 16.44|
219
  |MuSR (0-shot) | 20.95|
220
- |MMLU-PRO (5-shot) | 47.85|
221
-
 
9
  tags:
10
  - qwen
11
  - opus
12
+ - elite
13
  model-index:
14
  - name: Calcium-Opus-14B-Elite
15
  results:
 
27
  value: 60.64
28
  name: averaged accuracy
29
  source:
30
+ url: >-
31
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
32
  name: Open LLM Leaderboard
33
  - task:
34
  type: text-generation
 
44
  value: 46.53
45
  name: normalized accuracy
46
  source:
47
+ url: >-
48
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
49
  name: Open LLM Leaderboard
50
  - task:
51
  type: text-generation
 
61
  value: 37.08
62
  name: exact match
63
  source:
64
+ url: >-
65
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
66
  name: Open LLM Leaderboard
67
  - task:
68
  type: text-generation
 
78
  value: 16.44
79
  name: acc_norm
80
  source:
81
+ url: >-
82
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
83
  name: Open LLM Leaderboard
84
  - task:
85
  type: text-generation
 
94
  value: 20.95
95
  name: acc_norm
96
  source:
97
+ url: >-
98
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
99
  name: Open LLM Leaderboard
100
  - task:
101
  type: text-generation
 
112
  value: 47.85
113
  name: accuracy
114
  source:
115
+ url: >-
116
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
117
  name: Open LLM Leaderboard
118
  ---
119
  ![opus.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/BELYApcX2oNMRsOW6nIyR.gif)
 
224
  |MATH Lvl 5 (4-Shot)| 37.08|
225
  |GPQA (0-shot) | 16.44|
226
  |MuSR (0-shot) | 20.95|
227
+ |MMLU-PRO (5-shot) | 47.85|