---
base_model:
- cognitivecomputations/Dolphin3.0-Llama3.2-1B
- NickyNicky/Llama-1B-GRPO_Final
- prithivMLmods/Bellatrix-Tiny-1B-v3
- bunnycore/FuseChat-3.2-1B-Creative-RP
- xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [bunnycore/FuseChat-3.2-1B-Creative-RP](https://huggingface.co/bunnycore/FuseChat-3.2-1B-Creative-RP) as a base.

### Models Merged

The following models were included in the merge:
* [cognitivecomputations/Dolphin3.0-Llama3.2-1B](https://huggingface.co/cognitivecomputations/Dolphin3.0-Llama3.2-1B)
* [NickyNicky/Llama-1B-GRPO_Final](https://huggingface.co/NickyNicky/Llama-1B-GRPO_Final)
* [prithivMLmods/Bellatrix-Tiny-1B-v3](https://huggingface.co/prithivMLmods/Bellatrix-Tiny-1B-v3)
* [xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora](https://huggingface.co/xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: bunnycore/FuseChat-3.2-1B-Creative-RP
  - model: NickyNicky/Llama-1B-GRPO_Final
  - model: prithivMLmods/Bellatrix-Tiny-1B-v3
  - model: xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora
  - model: cognitivecomputations/Dolphin3.0-Llama3.2-1B
merge_method: model_stock
base_model: bunnycore/FuseChat-3.2-1B-Creative-RP
dtype: bfloat16
parameters:
  t: [0, 0.5, 1, 0.5, 0]
```