Upload folder using huggingface_hub

README.md

@@ -1,7 +1,7 @@
 ---
 base_model:
-- johnsnowlabs/JSL-MedLlama-3-8B-v1.0
 - aaditya/OpenBioLLM-Llama3-8B
+- johnsnowlabs/JSL-MedLlama-3-8B-v1.0
 library_name: transformers
 tags:
 - mergekit
@@ -15,7 +15,7 @@ This is a merge of pre-trained language models created using [mergekit](https://
 ## Merge Details
 ### Merge Method
 
-This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [aaditya/OpenBioLLM-Llama3-8B](https://huggingface.co/aaditya/OpenBioLLM-Llama3-8B) as a base.
+This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [aaditya/OpenBioLLM-Llama3-8B](https://huggingface.co/aaditya/OpenBioLLM-Llama3-8B) as a base.
 
 ### Models Merged
 
@@ -29,12 +29,11 @@ The following YAML configuration was used to produce this model:
 ```yaml
 models:
   - model: aaditya/OpenBioLLM-Llama3-8B
-    parameters:
-      weight: 0.5
   - model: johnsnowlabs/JSL-MedLlama-3-8B-v1.0
     parameters:
+      density: 0.5
       weight: 0.5
+merge_method: dare_ties
 base_model: aaditya/OpenBioLLM-Llama3-8B
-merge_method: task_arithmetic
 dtype: float16
 ```

mergekit_config.yml

@@ -1,10 +1,9 @@
 models:
   - model: aaditya/OpenBioLLM-Llama3-8B
-    parameters:
-      weight: 0.5
   - model: johnsnowlabs/JSL-MedLlama-3-8B-v1.0
     parameters:
+      density: 0.5
       weight: 0.5
+merge_method: dare_ties
 base_model: aaditya/OpenBioLLM-Llama3-8B
-merge_method: task_arithmetic
 dtype: float16

model-00001-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2556393edd37350038c475c6e574887114c0e97734756e27e3da6338c51d4a7f
+oid sha256:519fb7d2d2fc266f5e907388a0a249cda83414b4be0ee5a68e3236e79abca823
 size 9976501216

model-00002-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:43c568063263fff900b207cb0bce7f2056693cb9c5bb592345807134ce3ce2b9
+oid sha256:faec43c2b16ad5f24a37815d1f987ac1354cb285ed3b777c217b749a8a79779e
 size 6084054888