Upload folder using huggingface_hub

README.md

@@ -1,28 +1,39 @@
 ---
-license: apache-2.0
-tags:
-- merge
-- mergekit
-- lazymergekit
 base_model:
+- mayacinka/yam-jom-7B
 - mayacinka/yam-jom-7B-slerp
-- mayacinka/yam-jom-7B-ties
+library_name: transformers
+tags:
+- mergekit
+- merge
+
 ---
+# merge
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
 
-# YamYam-7B
+This model was merged using the SLERP merge method.
 
-YamYam-7B is an automated merge created by [Maxime Labonne](https://huggingface.co/mlabonne) using the following configuration.
+### Models Merged
+
+The following models were included in the merge:
+* [mayacinka/yam-jom-7B](https://huggingface.co/mayacinka/yam-jom-7B)
 * [mayacinka/yam-jom-7B-slerp](https://huggingface.co/mayacinka/yam-jom-7B-slerp)
-* [mayacinka/yam-jom-7B-ties](https://huggingface.co/mayacinka/yam-jom-7B-ties)
 
-## 🧩 Configuration
+### Configuration
+
+The following YAML configuration was used to produce this model:
 
 ```yaml
+
 slices:
   - sources:
       - model: mayacinka/yam-jom-7B-slerp
         layer_range: [0, 32]
-      - model: mayacinka/yam-jom-7B-ties
+      - model: mayacinka/yam-jom-7B
         layer_range: [0, 32]
 merge_method: slerp
 base_model: mayacinka/yam-jom-7B-slerp
@@ -35,29 +46,5 @@ parameters:
     - value: 0.5
 dtype: bfloat16
 random_seed: 0
-    ```
-
-## 💻 Usage
-
-```python
-!pip install -qU transformers accelerate
-
-from transformers import AutoTokenizer
-import transformers
-import torch
-
-model = "automerger/YamYam-7B"
-messages = [{"role": "user", "content": "What is a large language model?"}]
-
-tokenizer = AutoTokenizer.from_pretrained(model)
-prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
-pipeline = transformers.pipeline(
-    "text-generation",
-    model=model,
-    torch_dtype=torch.float16,
-    device_map="auto",
-)
-
-outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
-print(outputs[0]["generated_text"])
-```
+    
+```

mergekit_config.yml

@@ -3,7 +3,7 @@ slices:
   - sources:
       - model: mayacinka/yam-jom-7B-slerp
         layer_range: [0, 32]
-      - model: mayacinka/yam-jom-7B-ties
+      - model: mayacinka/yam-jom-7B
         layer_range: [0, 32]
 merge_method: slerp
 base_model: mayacinka/yam-jom-7B-slerp

model-00001-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:afdccf57e56d6ba1b3e1cf578cdc19b966618942f1da2636ed630059e9bbfa80
+oid sha256:3cf14dae94c7657f0073eee02d4331d3f03fdc2caf5edc42baf3913fc04e7942
 size 9942981696

model-00002-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:891fa7428d46fdf71b94ac59d71f3d725e10a575593e024b1557dc9824804283
+oid sha256:1ec711b3e4b8113989bcf30dd2b8b36dd6fda2d76d1e40ade9cee2def702cff8
 size 4540516344