Aleteian/Darkness-Reign-MN-12B

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using Aleteian/Saiga-Unleashed as a base.

Models Merged

The following models were included in the merge:

• Aleteian/One-To-Rule-Them-All-MN-12B
• Aleteian/Hello-Darkness-My-Old-Friend-5-MN-12B
• Aleteian/Follow-the-Flow-MN-12B

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Aleteian/Follow-the-Flow-MN-12B
  - model: Aleteian/One-To-Rule-Them-All-MN-12B
  - model: Aleteian/Hello-Darkness-My-Old-Friend-5-MN-12B
  
merge_method: model_stock
base_model: Aleteian/Saiga-Unleashed

dtype: bfloat16

tokenizer:
  source: IlyaGusev/saiga_nemo_12b
  
chat_template: "mistral"