calme-Slerp-78b / mergekit_config.yml
hotmailuser's picture
Upload folder using huggingface_hub
ef451ad verified
raw
history blame contribute delete
296 Bytes
models:
- model: MaziyarPanahi/calme-3.2-instruct-78b
- model: dfurman/CalmeRys-78B-Orpo-v0.1
merge_method: slerp
base_model: MaziyarPanahi/calme-3.2-instruct-78b
dtype: float16
parameters:
t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Hermes for input & output, WizardMath in the middle layers