| license: apache-2.0 | |
| This was just an experiment. One that went bad. | |
| I actually managed to _decrease_ the ability to do math by using a math dpo dataset with a german translation. | |
| ```json | |
| { | |
| "first_turn": 6.48125, | |
| "second_turn": 6.19375, | |
| "categories": { | |
| "writing": 8.425, | |
| "roleplay": 7.4, | |
| "reasoning": 4.6, | |
| "math": 2.65, | |
| "coding": 4.6, | |
| "extraction": 7, | |
| "stem": 8.0, | |
| "humanities": 8.025 | |
| }, | |
| "average": 6.3375 | |
| } | |
| ``` |