Files changed (1) hide show
  1. README.md +18 -18
README.md CHANGED
@@ -23,7 +23,7 @@ inference: false
23
  model_creator: MaziyarPanahi
24
  quantized_by: MaziyarPanahi
25
  model-index:
26
- - name: Llama-3-70B-Instruct-DPO-v0.4
27
  results:
28
  - task:
29
  type: text-generation
@@ -40,7 +40,7 @@ model-index:
40
  value: 72.61
41
  name: normalized accuracy
42
  source:
43
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
44
  name: Open LLM Leaderboard
45
  - task:
46
  type: text-generation
@@ -56,7 +56,7 @@ model-index:
56
  value: 86.03
57
  name: normalized accuracy
58
  source:
59
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
60
  name: Open LLM Leaderboard
61
  - task:
62
  type: text-generation
@@ -73,7 +73,7 @@ model-index:
73
  value: 80.5
74
  name: accuracy
75
  source:
76
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
77
  name: Open LLM Leaderboard
78
  - task:
79
  type: text-generation
@@ -89,7 +89,7 @@ model-index:
89
  - type: mc2
90
  value: 63.26
91
  source:
92
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
93
  name: Open LLM Leaderboard
94
  - task:
95
  type: text-generation
@@ -106,7 +106,7 @@ model-index:
106
  value: 83.58
107
  name: accuracy
108
  source:
109
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
110
  name: Open LLM Leaderboard
111
  - task:
112
  type: text-generation
@@ -123,7 +123,7 @@ model-index:
123
  value: 87.34
124
  name: accuracy
125
  source:
126
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
127
  name: Open LLM Leaderboard
128
  - task:
129
  type: text-generation
@@ -138,7 +138,7 @@ model-index:
138
  value: 50.27
139
  name: strict accuracy
140
  source:
141
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
142
  name: Open LLM Leaderboard
143
  - task:
144
  type: text-generation
@@ -153,7 +153,7 @@ model-index:
153
  value: 48.4
154
  name: normalized accuracy
155
  source:
156
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
157
  name: Open LLM Leaderboard
158
  - task:
159
  type: text-generation
@@ -168,7 +168,7 @@ model-index:
168
  value: 22.66
169
  name: exact match
170
  source:
171
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
172
  name: Open LLM Leaderboard
173
  - task:
174
  type: text-generation
@@ -183,7 +183,7 @@ model-index:
183
  value: 11.97
184
  name: acc_norm
185
  source:
186
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
187
  name: Open LLM Leaderboard
188
  - task:
189
  type: text-generation
@@ -198,7 +198,7 @@ model-index:
198
  value: 13.1
199
  name: acc_norm
200
  source:
201
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
202
  name: Open LLM Leaderboard
203
  - task:
204
  type: text-generation
@@ -215,23 +215,23 @@ model-index:
215
  value: 46.71
216
  name: accuracy
217
  source:
218
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
219
  name: Open LLM Leaderboard
220
  ---
221
 
222
  <img src="./llama-3-merges.webp" alt="Llama-3 DPO Logo" width="500" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
223
 
224
 
225
- # MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4
226
 
227
  This model is a fine-tune (DPO) of `meta-llama/Meta-Llama-3-70B-Instruct` model.
228
 
229
  # ⚡ Quantized GGUF
230
 
231
- All GGUF models are available here: [MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4-GGUF](https://huggingface.co/MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4-GGUF)
232
 
233
  # 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
234
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__Llama-3-70B-Instruct-DPO-v0.4)
235
 
236
  | Metric |Value|
237
  |-------------------|----:|
@@ -275,7 +275,7 @@ This model uses `ChatML` prompt template:
275
 
276
  # How to use
277
 
278
- You can use this model by using `MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4` as the model name in Hugging Face's
279
  transformers library.
280
 
281
  ```python
@@ -283,7 +283,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
283
  from transformers import pipeline
284
  import torch
285
 
286
- model_id = "MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4"
287
 
288
  model = AutoModelForCausalLM.from_pretrained(
289
  model_id,
 
23
  model_creator: MaziyarPanahi
24
  quantized_by: MaziyarPanahi
25
  model-index:
26
+ - name: calme-2.4-llama3-70b
27
  results:
28
  - task:
29
  type: text-generation
 
40
  value: 72.61
41
  name: normalized accuracy
42
  source:
43
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
44
  name: Open LLM Leaderboard
45
  - task:
46
  type: text-generation
 
56
  value: 86.03
57
  name: normalized accuracy
58
  source:
59
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
60
  name: Open LLM Leaderboard
61
  - task:
62
  type: text-generation
 
73
  value: 80.5
74
  name: accuracy
75
  source:
76
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
77
  name: Open LLM Leaderboard
78
  - task:
79
  type: text-generation
 
89
  - type: mc2
90
  value: 63.26
91
  source:
92
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
93
  name: Open LLM Leaderboard
94
  - task:
95
  type: text-generation
 
106
  value: 83.58
107
  name: accuracy
108
  source:
109
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
110
  name: Open LLM Leaderboard
111
  - task:
112
  type: text-generation
 
123
  value: 87.34
124
  name: accuracy
125
  source:
126
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
127
  name: Open LLM Leaderboard
128
  - task:
129
  type: text-generation
 
138
  value: 50.27
139
  name: strict accuracy
140
  source:
141
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
142
  name: Open LLM Leaderboard
143
  - task:
144
  type: text-generation
 
153
  value: 48.4
154
  name: normalized accuracy
155
  source:
156
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
157
  name: Open LLM Leaderboard
158
  - task:
159
  type: text-generation
 
168
  value: 22.66
169
  name: exact match
170
  source:
171
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
172
  name: Open LLM Leaderboard
173
  - task:
174
  type: text-generation
 
183
  value: 11.97
184
  name: acc_norm
185
  source:
186
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
187
  name: Open LLM Leaderboard
188
  - task:
189
  type: text-generation
 
198
  value: 13.1
199
  name: acc_norm
200
  source:
201
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
202
  name: Open LLM Leaderboard
203
  - task:
204
  type: text-generation
 
215
  value: 46.71
216
  name: accuracy
217
  source:
218
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
219
  name: Open LLM Leaderboard
220
  ---
221
 
222
  <img src="./llama-3-merges.webp" alt="Llama-3 DPO Logo" width="500" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
223
 
224
 
225
+ # MaziyarPanahi/calme-2.4-llama3-70b
226
 
227
  This model is a fine-tune (DPO) of `meta-llama/Meta-Llama-3-70B-Instruct` model.
228
 
229
  # ⚡ Quantized GGUF
230
 
231
+ All GGUF models are available here: [MaziyarPanahi/calme-2.4-llama3-70b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.4-llama3-70b-GGUF)
232
 
233
  # 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
234
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__calme-2.4-llama3-70b)
235
 
236
  | Metric |Value|
237
  |-------------------|----:|
 
275
 
276
  # How to use
277
 
278
+ You can use this model by using `MaziyarPanahi/calme-2.4-llama3-70b` as the model name in Hugging Face's
279
  transformers library.
280
 
281
  ```python
 
283
  from transformers import pipeline
284
  import torch
285
 
286
+ model_id = "MaziyarPanahi/calme-2.4-llama3-70b"
287
 
288
  model = AutoModelForCausalLM.from_pretrained(
289
  model_id,