Qwen2.5-7B-ko-quant-merge-v1 / mergekit_config.yml
vitus9988's picture
Upload folder using huggingface_hub
24f10b3 verified
raw
history blame contribute delete
313 Bytes
models:
- model: Qwen2.5-7B-Instruct-Lora
parameters:
density: 1
weight: 1
- model: Qwen/Qwen2.5-7B-Instruct
parameters:
density: 1
weight: 1
merge_method: ties
base_model: Qwen/Qwen2.5-7B
parameters:
int8_mask: true
nomalize: true
weight: 1
density: 1
dtype: bfloat16