base_model: | |
- Khetterman/AbominationScience-12B-v4 | |
- jtatman/mistral_nemo_12b_reasoning_psychology_lora | |
- mergekit-community/mergekit-slerp-mirtnuv | |
library_name: transformers | |
tags: | |
- mergekit | |
- merge | |
# merge | |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). | |
## Merge Details | |
### Merge Method | |
This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method. | |
### Models Merged | |
The following models were included in the merge: | |
* [Khetterman/AbominationScience-12B-v4](https://huggingface.co/Khetterman/AbominationScience-12B-v4) + [jtatman/mistral_nemo_12b_reasoning_psychology_lora](https://huggingface.co/jtatman/mistral_nemo_12b_reasoning_psychology_lora) | |
* [mergekit-community/mergekit-slerp-mirtnuv](https://huggingface.co/mergekit-community/mergekit-slerp-mirtnuv) | |
### Configuration | |
The following YAML configuration was used to produce this model: | |
```yaml | |
models: | |
- model: Khetterman/AbominationScience-12B-v4+jtatman/mistral_nemo_12b_reasoning_psychology_lora | |
- model: mergekit-community/mergekit-slerp-mirtnuv | |
merge_method: slerp | |
base_model: Khetterman/AbominationScience-12B-v4+jtatman/mistral_nemo_12b_reasoning_psychology_lora | |
dtype: bfloat16 | |
parameters: | |
t: [0, 0.5, 1, 0.5, 0] | |
``` | |