Update README.md
#15
by
MaziyarPanahi
- opened
README.md
CHANGED
@@ -23,7 +23,7 @@ inference: false
|
|
23 |
model_creator: MaziyarPanahi
|
24 |
quantized_by: MaziyarPanahi
|
25 |
model-index:
|
26 |
-
- name:
|
27 |
results:
|
28 |
- task:
|
29 |
type: text-generation
|
@@ -40,7 +40,7 @@ model-index:
|
|
40 |
value: 72.61
|
41 |
name: normalized accuracy
|
42 |
source:
|
43 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/
|
44 |
name: Open LLM Leaderboard
|
45 |
- task:
|
46 |
type: text-generation
|
@@ -56,7 +56,7 @@ model-index:
|
|
56 |
value: 86.03
|
57 |
name: normalized accuracy
|
58 |
source:
|
59 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/
|
60 |
name: Open LLM Leaderboard
|
61 |
- task:
|
62 |
type: text-generation
|
@@ -73,7 +73,7 @@ model-index:
|
|
73 |
value: 80.5
|
74 |
name: accuracy
|
75 |
source:
|
76 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/
|
77 |
name: Open LLM Leaderboard
|
78 |
- task:
|
79 |
type: text-generation
|
@@ -89,7 +89,7 @@ model-index:
|
|
89 |
- type: mc2
|
90 |
value: 63.26
|
91 |
source:
|
92 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/
|
93 |
name: Open LLM Leaderboard
|
94 |
- task:
|
95 |
type: text-generation
|
@@ -106,7 +106,7 @@ model-index:
|
|
106 |
value: 83.58
|
107 |
name: accuracy
|
108 |
source:
|
109 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/
|
110 |
name: Open LLM Leaderboard
|
111 |
- task:
|
112 |
type: text-generation
|
@@ -123,7 +123,7 @@ model-index:
|
|
123 |
value: 87.34
|
124 |
name: accuracy
|
125 |
source:
|
126 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/
|
127 |
name: Open LLM Leaderboard
|
128 |
- task:
|
129 |
type: text-generation
|
@@ -138,7 +138,7 @@ model-index:
|
|
138 |
value: 50.27
|
139 |
name: strict accuracy
|
140 |
source:
|
141 |
-
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/
|
142 |
name: Open LLM Leaderboard
|
143 |
- task:
|
144 |
type: text-generation
|
@@ -153,7 +153,7 @@ model-index:
|
|
153 |
value: 48.4
|
154 |
name: normalized accuracy
|
155 |
source:
|
156 |
-
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/
|
157 |
name: Open LLM Leaderboard
|
158 |
- task:
|
159 |
type: text-generation
|
@@ -168,7 +168,7 @@ model-index:
|
|
168 |
value: 22.66
|
169 |
name: exact match
|
170 |
source:
|
171 |
-
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/
|
172 |
name: Open LLM Leaderboard
|
173 |
- task:
|
174 |
type: text-generation
|
@@ -183,7 +183,7 @@ model-index:
|
|
183 |
value: 11.97
|
184 |
name: acc_norm
|
185 |
source:
|
186 |
-
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/
|
187 |
name: Open LLM Leaderboard
|
188 |
- task:
|
189 |
type: text-generation
|
@@ -198,7 +198,7 @@ model-index:
|
|
198 |
value: 13.1
|
199 |
name: acc_norm
|
200 |
source:
|
201 |
-
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/
|
202 |
name: Open LLM Leaderboard
|
203 |
- task:
|
204 |
type: text-generation
|
@@ -215,23 +215,23 @@ model-index:
|
|
215 |
value: 46.71
|
216 |
name: accuracy
|
217 |
source:
|
218 |
-
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/
|
219 |
name: Open LLM Leaderboard
|
220 |
---
|
221 |
|
222 |
<img src="./llama-3-merges.webp" alt="Llama-3 DPO Logo" width="500" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
223 |
|
224 |
|
225 |
-
# MaziyarPanahi/
|
226 |
|
227 |
This model is a fine-tune (DPO) of `meta-llama/Meta-Llama-3-70B-Instruct` model.
|
228 |
|
229 |
# ⚡ Quantized GGUF
|
230 |
|
231 |
-
All GGUF models are available here: [MaziyarPanahi/
|
232 |
|
233 |
# 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
234 |
-
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/
|
235 |
|
236 |
| Metric |Value|
|
237 |
|-------------------|----:|
|
@@ -275,7 +275,7 @@ This model uses `ChatML` prompt template:
|
|
275 |
|
276 |
# How to use
|
277 |
|
278 |
-
You can use this model by using `MaziyarPanahi/
|
279 |
transformers library.
|
280 |
|
281 |
```python
|
@@ -283,7 +283,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
|
|
283 |
from transformers import pipeline
|
284 |
import torch
|
285 |
|
286 |
-
model_id = "MaziyarPanahi/
|
287 |
|
288 |
model = AutoModelForCausalLM.from_pretrained(
|
289 |
model_id,
|
|
|
23 |
model_creator: MaziyarPanahi
|
24 |
quantized_by: MaziyarPanahi
|
25 |
model-index:
|
26 |
+
- name: calme-2.4-llama3-70b
|
27 |
results:
|
28 |
- task:
|
29 |
type: text-generation
|
|
|
40 |
value: 72.61
|
41 |
name: normalized accuracy
|
42 |
source:
|
43 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
44 |
name: Open LLM Leaderboard
|
45 |
- task:
|
46 |
type: text-generation
|
|
|
56 |
value: 86.03
|
57 |
name: normalized accuracy
|
58 |
source:
|
59 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
60 |
name: Open LLM Leaderboard
|
61 |
- task:
|
62 |
type: text-generation
|
|
|
73 |
value: 80.5
|
74 |
name: accuracy
|
75 |
source:
|
76 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
77 |
name: Open LLM Leaderboard
|
78 |
- task:
|
79 |
type: text-generation
|
|
|
89 |
- type: mc2
|
90 |
value: 63.26
|
91 |
source:
|
92 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
93 |
name: Open LLM Leaderboard
|
94 |
- task:
|
95 |
type: text-generation
|
|
|
106 |
value: 83.58
|
107 |
name: accuracy
|
108 |
source:
|
109 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
110 |
name: Open LLM Leaderboard
|
111 |
- task:
|
112 |
type: text-generation
|
|
|
123 |
value: 87.34
|
124 |
name: accuracy
|
125 |
source:
|
126 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
127 |
name: Open LLM Leaderboard
|
128 |
- task:
|
129 |
type: text-generation
|
|
|
138 |
value: 50.27
|
139 |
name: strict accuracy
|
140 |
source:
|
141 |
+
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
142 |
name: Open LLM Leaderboard
|
143 |
- task:
|
144 |
type: text-generation
|
|
|
153 |
value: 48.4
|
154 |
name: normalized accuracy
|
155 |
source:
|
156 |
+
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
157 |
name: Open LLM Leaderboard
|
158 |
- task:
|
159 |
type: text-generation
|
|
|
168 |
value: 22.66
|
169 |
name: exact match
|
170 |
source:
|
171 |
+
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
172 |
name: Open LLM Leaderboard
|
173 |
- task:
|
174 |
type: text-generation
|
|
|
183 |
value: 11.97
|
184 |
name: acc_norm
|
185 |
source:
|
186 |
+
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
187 |
name: Open LLM Leaderboard
|
188 |
- task:
|
189 |
type: text-generation
|
|
|
198 |
value: 13.1
|
199 |
name: acc_norm
|
200 |
source:
|
201 |
+
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
202 |
name: Open LLM Leaderboard
|
203 |
- task:
|
204 |
type: text-generation
|
|
|
215 |
value: 46.71
|
216 |
name: accuracy
|
217 |
source:
|
218 |
+
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.4-llama3-70b
|
219 |
name: Open LLM Leaderboard
|
220 |
---
|
221 |
|
222 |
<img src="./llama-3-merges.webp" alt="Llama-3 DPO Logo" width="500" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
223 |
|
224 |
|
225 |
+
# MaziyarPanahi/calme-2.4-llama3-70b
|
226 |
|
227 |
This model is a fine-tune (DPO) of `meta-llama/Meta-Llama-3-70B-Instruct` model.
|
228 |
|
229 |
# ⚡ Quantized GGUF
|
230 |
|
231 |
+
All GGUF models are available here: [MaziyarPanahi/calme-2.4-llama3-70b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.4-llama3-70b-GGUF)
|
232 |
|
233 |
# 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
234 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__calme-2.4-llama3-70b)
|
235 |
|
236 |
| Metric |Value|
|
237 |
|-------------------|----:|
|
|
|
275 |
|
276 |
# How to use
|
277 |
|
278 |
+
You can use this model by using `MaziyarPanahi/calme-2.4-llama3-70b` as the model name in Hugging Face's
|
279 |
transformers library.
|
280 |
|
281 |
```python
|
|
|
283 |
from transformers import pipeline
|
284 |
import torch
|
285 |
|
286 |
+
model_id = "MaziyarPanahi/calme-2.4-llama3-70b"
|
287 |
|
288 |
model = AutoModelForCausalLM.from_pretrained(
|
289 |
model_id,
|