--- base_model: - artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond - cognitivecomputations/Dolphin3.0-Llama3.2-1B - artificialguybr/LLAMA-3.2-1B-OpenHermes2.5 library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond](https://huggingface.co/artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond) as a base. ### Models Merged The following models were included in the merge: * [cognitivecomputations/Dolphin3.0-Llama3.2-1B](https://huggingface.co/cognitivecomputations/Dolphin3.0-Llama3.2-1B) * [artificialguybr/LLAMA-3.2-1B-OpenHermes2.5](https://huggingface.co/artificialguybr/LLAMA-3.2-1B-OpenHermes2.5) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: model_stock models: - model: artificialguybr/LLAMA-3.2-1B-OpenHermes2.5 parameters: weight: 1.0 - model: cognitivecomputations/Dolphin3.0-Llama3.2-1B parameters: weight: 1.0 base_model: artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond dtype: bfloat16 normalize: true ```