Hugging Face's logo

prithivMLmods
/
Calcium-Opus-20B-v1

Text Generation
Transformers
Safetensors
English
qwen2
Opus
text-generation-inference
conversational
Eval Results
Inference Endpoints
Model card Files Community
1
prithivMLmods commited on
Commit
d160b50
·
verified ·
1 Parent(s): 12260c8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -9
README.md CHANGED
@@ -9,7 +9,6 @@ library_name: transformers
9
  tags:
10
  - Opus
11
  - text-generation-inference
12
- - Qwen
13
  model-index:
14
  - name: Calcium-Opus-20B-v1
15
  results:
@@ -27,7 +26,8 @@ model-index:
27
  value: 30.93
28
  name: averaged accuracy
29
  source:
30
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
 
31
  name: Open LLM Leaderboard
32
  - task:
33
  type: text-generation
@@ -43,7 +43,8 @@ model-index:
43
  value: 41.81
44
  name: normalized accuracy
45
  source:
46
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
 
47
  name: Open LLM Leaderboard
48
  - task:
49
  type: text-generation
@@ -59,7 +60,8 @@ model-index:
59
  value: 11.03
60
  name: exact match
61
  source:
62
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
 
63
  name: Open LLM Leaderboard
64
  - task:
65
  type: text-generation
@@ -75,7 +77,8 @@ model-index:
75
  value: 13.76
76
  name: acc_norm
77
  source:
78
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
 
79
  name: Open LLM Leaderboard
80
  - task:
81
  type: text-generation
@@ -90,7 +93,8 @@ model-index:
90
  value: 22.09
91
  name: acc_norm
92
  source:
93
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
 
94
  name: Open LLM Leaderboard
95
  - task:
96
  type: text-generation
@@ -107,7 +111,8 @@ model-index:
107
  value: 41.49
108
  name: accuracy
109
  source:
110
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
 
111
  name: Open LLM Leaderboard
112
  ---
113
  ![opus.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/-vC9B4g2ccchvbS00HffZ.gif)
@@ -223,5 +228,4 @@ Summarized results can be found [here](https://huggingface.co/datasets/open-llm-
223
  |MATH Lvl 5 (4-Shot)| 11.03|
224
  |GPQA (0-shot) | 13.76|
225
  |MuSR (0-shot) | 22.09|
226
- |MMLU-PRO (5-shot) | 41.49|
227
-
 
9
  tags:
10
  - Opus
11
  - text-generation-inference
 
12
  model-index:
13
  - name: Calcium-Opus-20B-v1
14
  results:
 
26
  value: 30.93
27
  name: averaged accuracy
28
  source:
29
+ url: >-
30
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
31
  name: Open LLM Leaderboard
32
  - task:
33
  type: text-generation
 
43
  value: 41.81
44
  name: normalized accuracy
45
  source:
46
+ url: >-
47
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
48
  name: Open LLM Leaderboard
49
  - task:
50
  type: text-generation
 
60
  value: 11.03
61
  name: exact match
62
  source:
63
+ url: >-
64
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
65
  name: Open LLM Leaderboard
66
  - task:
67
  type: text-generation
 
77
  value: 13.76
78
  name: acc_norm
79
  source:
80
+ url: >-
81
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
82
  name: Open LLM Leaderboard
83
  - task:
84
  type: text-generation
 
93
  value: 22.09
94
  name: acc_norm
95
  source:
96
+ url: >-
97
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
98
  name: Open LLM Leaderboard
99
  - task:
100
  type: text-generation
 
111
  value: 41.49
112
  name: accuracy
113
  source:
114
+ url: >-
115
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-20B-v1
116
  name: Open LLM Leaderboard
117
  ---
118
  ![opus.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/-vC9B4g2ccchvbS00HffZ.gif)
 
228
  |MATH Lvl 5 (4-Shot)| 11.03|
229
  |GPQA (0-shot) | 13.76|
230
  |MuSR (0-shot) | 22.09|
231
+ |MMLU-PRO (5-shot) | 41.49|