DopeyGay/L3-Reapers-Coast-v0.2-8B

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Task Arithmetic merge method using DopeyGay/L3-Reapers-Coast-8B as a base.

Models Merged

The following models were included in the merge:

• Dampfinchen/Llama-3-8B-Ultra-Instruct
• kromeurus/L3.1-Aglow-Vulca-v0.1-8B
• Hastagaras/Jamet-8B-L3-MK.V-Blackroot

Configuration

The following YAML configuration was used to produce this model:

slices:
- sources:
  - model: DopeyGay/L3-Reapers-Coast-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.55
  - model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
    layer_range: [0, 32]
    parameters:
      weight: 0.35
  - model: kromeurus/L3.1-Aglow-Vulca-v0.1-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.5
  - model: Dampfinchen/Llama-3-8B-Ultra-Instruct
    layer_range: [0, 32]
    parameters:
      weight: 0.5
merge_method: task_arithmetic
base_model: DopeyGay/L3-Reapers-Coast-8B
normalize: False
dtype: bfloat16