huihui-ai
/

Qwen2.5-7B-Instruct-abliterated

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

huihui-ai commited on Sep 20, 2024

Commit

c04c14c

·

verified ·

1 Parent(s): 03f26d5

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -100,9 +100,9 @@ The following data has been re-evaluated and calculated as the average for each
 | Benchmark   | Qwen2.5-7B-Instruct | Qwen2.5-7B-Instruct-abliterated |
 |-------------|---------------------|---------------------------------|
 | IF_Eval     | 76.44               | **76.49**                       |
-| MMLU Pro    | 43.12               | 41.71                           |
 | TruthfulQA  | 62.46               | **64.92**                       |
-| BBH         | 53.92               | 52.77                           |
 | GPQA        | 31.91               | **31.97**                       |
 The script used for evaluation can be found inside this repository under /eval.sh, or click [here](https://huggingface.co/huihui-ai/Qwen2.5-7B-Instruct-abliterated/blob/main/eval.sh)

 | Benchmark   | Qwen2.5-7B-Instruct | Qwen2.5-7B-Instruct-abliterated |
 |-------------|---------------------|---------------------------------|
 | IF_Eval     | 76.44               | **76.49**                       |
+| MMLU Pro    | **43.12**           | 41.71                           |
 | TruthfulQA  | 62.46               | **64.92**                       |
+| BBH         | **53.92**           | 52.77                           |
 | GPQA        | 31.91               | **31.97**                       |
 The script used for evaluation can be found inside this repository under /eval.sh, or click [here](https://huggingface.co/huihui-ai/Qwen2.5-7B-Instruct-abliterated/blob/main/eval.sh)