Update README.md
Browse files
README.md
CHANGED
@@ -14,8 +14,8 @@ tags:
|
|
14 |
|
15 |
# Model Card for una-cybertron-7b-v2-bf16 (UNA: Uniform Neural Alignment)
|
16 |
|
17 |
-
We strike back, introducing **Cybertron 7B
|
18 |
-
He scores **64.60**+ on HF LeaderBoard at least, we'll update the final test soon, .. and we have in the oven a few surprises for all the christmas, subscribe.
|
19 |
T
|
20 |
* v1 Scoring **#1** at 2 December 2023 with 64.60
|
21 |
* v2 Scoring **?** ..?
|
@@ -77,14 +77,14 @@ Answer:
|
|
77 |
## Evaluation (UNA-Cybertron-7B-v1-fp16)
|
78 |
```
|
79 |
| Tasks |Version|Shots | Metric |Value | |Stderr|
|
80 |
-
|
81 |
|arc_challenge | | 25 |acc_norm|0.6817|± |0.0136|
|
82 |
|truthfulqa_mc2| | 0 |acc |0.6398|± |0.0151|
|
83 |
|hellaswag | | 10 |acc_norm|0.8492|± |0.0036|
|
84 |
|winogrande | | 0 |acc |0.809 |± |0.011 |
|
85 |
|gsm8k | | 5 |acc |0.2733|± |0.0137|
|
86 |
|mmlu | | 5 |acc |0.6207|± |0.1230|
|
87 |
-
| |average| |acc
|
88 |
|
89 |
| Groups |Version|Filter|n-shot|Metric|Value | |Stderr|
|
90 |
|------------------|-------|------|-----:|------|-----:|---|-----:|
|
@@ -105,7 +105,7 @@ Answer:
|
|
105 |
### Citations
|
106 |
If you find Cybertron, Juanako or any of our models useful, specially if you use it for your big brand.. cite please:
|
107 |
```
|
108 |
-
@misc{
|
109 |
title={Cybertron: Uniform Neural Alignment},
|
110 |
author={Xavier Murias},
|
111 |
year={2023},
|
|
|
14 |
|
15 |
# Model Card for una-cybertron-7b-v2-bf16 (UNA: Uniform Neural Alignment)
|
16 |
|
17 |
+
We strike back, introducing **Cybertron 7B v2** a 7B MistralAI based model, best on it's series. Trained on SFT, DPO and UNA (Unified Neural Alignment) on multiple datasets.
|
18 |
+
He scores more than **64.60**+ on HF LeaderBoard at least, we'll update the final test soon, .. and we have in the oven a few surprises for all the christmas, subscribe.
|
19 |
T
|
20 |
* v1 Scoring **#1** at 2 December 2023 with 64.60
|
21 |
* v2 Scoring **?** ..?
|
|
|
77 |
## Evaluation (UNA-Cybertron-7B-v1-fp16)
|
78 |
```
|
79 |
| Tasks |Version|Shots | Metric |Value | |Stderr|
|
80 |
+
|--------------|-------|------|--------|-----:|---|-----:|
|
81 |
|arc_challenge | | 25 |acc_norm|0.6817|± |0.0136|
|
82 |
|truthfulqa_mc2| | 0 |acc |0.6398|± |0.0151|
|
83 |
|hellaswag | | 10 |acc_norm|0.8492|± |0.0036|
|
84 |
|winogrande | | 0 |acc |0.809 |± |0.011 |
|
85 |
|gsm8k | | 5 |acc |0.2733|± |0.0137|
|
86 |
|mmlu | | 5 |acc |0.6207|± |0.1230|
|
87 |
+
| |average| |acc |0.6456| | |
|
88 |
|
89 |
| Groups |Version|Filter|n-shot|Metric|Value | |Stderr|
|
90 |
|------------------|-------|------|-----:|------|-----:|---|-----:|
|
|
|
105 |
### Citations
|
106 |
If you find Cybertron, Juanako or any of our models useful, specially if you use it for your big brand.. cite please:
|
107 |
```
|
108 |
+
@misc{unacybertron7b,
|
109 |
title={Cybertron: Uniform Neural Alignment},
|
110 |
author={Xavier Murias},
|
111 |
year={2023},
|