---
base_model:
- elinas/Chronos-Gold-12B-1.0
- PygmalionAI/Pygmalion-3-12B
- yamatazen/Ayla-Light-12B-Stock
- allura-org/Bigger-Body-12b
- Aleteian/Saiga-Unleashed
- PygmalionAI/Eleusis-12B
- OddTheGreat/Nomad_12B_V6
- Gryphe/Pantheon-RP-1.5-12b-Nemo
- nothingiisreal/MN-12B-Celeste-V1.9
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Aleteian/Saiga-Unleashed](https://huggingface.co/Aleteian/Saiga-Unleashed) as a base.

### Models Merged

The following models were included in the merge:
* [elinas/Chronos-Gold-12B-1.0](https://huggingface.co/elinas/Chronos-Gold-12B-1.0)
* [PygmalionAI/Pygmalion-3-12B](https://huggingface.co/PygmalionAI/Pygmalion-3-12B)
* [yamatazen/Ayla-Light-12B-Stock](https://huggingface.co/yamatazen/Ayla-Light-12B-Stock)
* [allura-org/Bigger-Body-12b](https://huggingface.co/allura-org/Bigger-Body-12b)
* [PygmalionAI/Eleusis-12B](https://huggingface.co/PygmalionAI/Eleusis-12B)
* [OddTheGreat/Nomad_12B_V6](https://huggingface.co/OddTheGreat/Nomad_12B_V6)
* [Gryphe/Pantheon-RP-1.5-12b-Nemo](https://huggingface.co/Gryphe/Pantheon-RP-1.5-12b-Nemo)
* [nothingiisreal/MN-12B-Celeste-V1.9](https://huggingface.co/nothingiisreal/MN-12B-Celeste-V1.9)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: allura-org/Bigger-Body-12b
  - model: yamatazen/Ayla-Light-12B-Stock
  - model: PygmalionAI/Pygmalion-3-12B
  - model: PygmalionAI/Eleusis-12B
  - model: OddTheGreat/Nomad_12B_V6
  - model: Gryphe/Pantheon-RP-1.5-12b-Nemo
  - model: nothingiisreal/MN-12B-Celeste-V1.9
  - model: elinas/Chronos-Gold-12B-1.0
  
merge_method: model_stock
base_model: Aleteian/Saiga-Unleashed

dtype: bfloat16
tokenizer_source: "union"
chat_template: "mistral"

```