mergekit-passthrough-jgairfu / mergekit_config.yml
Taephom's picture
Upload folder using huggingface_hub
523d241 verified
raw
history blame contribute delete
531 Bytes
slices:
- sources:
- layer_range: [0, 8]
model: maywell/Qwen2-7B-Multilingual-RP
- sources:
- layer_range: [4, 12]
model: maywell/Qwen2-7B-Multilingual-RP
- sources:
- layer_range: [9, 16]
model: maywell/Qwen2-7B-Multilingual-RP
- sources:
- layer_range: [13, 20]
model: maywell/Qwen2-7B-Multilingual-RP
- sources:
- layer_range: [17, 24]
model: maywell/Qwen2-7B-Multilingual-RP
- sources:
- layer_range: [21, 28]
model: maywell/Qwen2-7B-Multilingual-RP
merge_method: passthrough
dtype: bfloat16