metadata
license: unknown
tags:
- merge
- mergekit
- WizardLM/WizardMath-7B-V1.1
- teknium/OpenHermes-2.5-Mistral-7B
- mlabonne/Marcoro14-7B-slerp
DraftReasoner-2x7B-MoE-v0.1
Experimental 2-expert MoE merge using mlabonne/Marcoro14-7B-slerp as base.
- Marcoro14-7B-slerp as base.
- OpenHermes-2.5-Mistral-7B as model 0.
- WizardMath-7B-V1.1 as model 1.
Notes
Please evaluate before use in any application pipeline. Activation for Math part of the model would be 'math', 'reason', 'solve', 'count'.