tr-dare-merge-7B / README.md
berkecr's picture
Upload folder using huggingface_hub
b99aad9 verified
|
raw
history blame
549 Bytes
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - TURKCELL/Turkcell-LLM-7b-v1
  - Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0

tr-dare-merge-7B

Configs

```yaml models:

  • model: mistralai/Mistral-7B-Instruct-v0.2
  • model: TURKCELL/Turkcell-LLM-7b-v1 parameters: density: 0.7 weight: 0.4
  • model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0 parameters: density: 0.7 weight: 0.4 merge_method: dare_ties base_model: mistralai/Mistral-7B-Instruct-v0.2 parameters: int8_mask: true dtype: bfloat16```