Hugging Face's logo

MotherEarth
/
MotherEarth-1.0-8B

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
Roleplay
Climate
Environment
Biodiversity
Indigenous
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
MotherEarth commited on
Commit
5b762a5
•
1 Parent(s): f3d88b9

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. README.md +5 -5
  2. config.json +1 -1
  3. mergekit_config.yml +3 -3
  4. model-00001-of-00004.safetensors +2 -2
  5. model-00002-of-00004.safetensors +2 -2
  6. model-00003-of-00004.safetensors +2 -2
  7. model-00004-of-00004.safetensors +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  base_model:
3
- - MotherEarth/linear_MotherEarth_1.0_slerp_storm_aflah
4
  - MotherEarth/MotherEarth_1.0
5
  library_name: transformers
6
  tags:
@@ -20,7 +20,7 @@ This model was merged using the SLERP merge method.
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
23
- * [MotherEarth/linear_MotherEarth_1.0_slerp_storm_aflah](https://huggingface.co/MotherEarth/linear_MotherEarth_1.0_slerp_storm_aflah)
24
  * [MotherEarth/MotherEarth_1.0](https://huggingface.co/MotherEarth/MotherEarth_1.0)
25
 
26
  ### Configuration
@@ -30,11 +30,11 @@ The following YAML configuration was used to produce this model:
30
  ```yaml
31
  models:
32
  - model: MotherEarth/MotherEarth_1.0
33
- - model: MotherEarth/linear_MotherEarth_1.0_slerp_storm_aflah
34
  merge_method: slerp
35
  base_model: MotherEarth/MotherEarth_1.0
36
- dtype: float16
37
  parameters:
38
- t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Hermes for input & output, WizardMath in the middle layers
39
 
40
  ```
 
1
  ---
2
  base_model:
3
+ - MotherEarth/slerp_MotherEarth-MothErarth_slerp_aflah-linear_strom
4
  - MotherEarth/MotherEarth_1.0
5
  library_name: transformers
6
  tags:
 
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
23
+ * [MotherEarth/slerp_MotherEarth-MothErarth_slerp_aflah-linear_strom](https://huggingface.co/MotherEarth/slerp_MotherEarth-MothErarth_slerp_aflah-linear_strom)
24
  * [MotherEarth/MotherEarth_1.0](https://huggingface.co/MotherEarth/MotherEarth_1.0)
25
 
26
  ### Configuration
 
30
  ```yaml
31
  models:
32
  - model: MotherEarth/MotherEarth_1.0
33
+ - model: MotherEarth/slerp_MotherEarth-MothErarth_slerp_aflah-linear_strom
34
  merge_method: slerp
35
  base_model: MotherEarth/MotherEarth_1.0
36
+ dtype: bfloat16
37
  parameters:
38
+ t: [0.2, 0.4, 0.8, 0.4, 0.2] # V shaped curve: Hermes for input & output, WizardMath in the middle layers
39
 
40
  ```
config.json CHANGED
@@ -22,7 +22,7 @@
22
  "rope_scaling": null,
23
  "rope_theta": 500000.0,
24
  "tie_word_embeddings": false,
25
- "torch_dtype": "float16",
26
  "transformers_version": "4.44.1",
27
  "use_cache": true,
28
  "vocab_size": 128256
 
22
  "rope_scaling": null,
23
  "rope_theta": 500000.0,
24
  "tie_word_embeddings": false,
25
+ "torch_dtype": "bfloat16",
26
  "transformers_version": "4.44.1",
27
  "use_cache": true,
28
  "vocab_size": 128256
mergekit_config.yml CHANGED
@@ -1,8 +1,8 @@
1
  models:
2
  - model: MotherEarth/MotherEarth_1.0
3
- - model: MotherEarth/linear_MotherEarth_1.0_slerp_storm_aflah
4
  merge_method: slerp
5
  base_model: MotherEarth/MotherEarth_1.0
6
- dtype: float16
7
  parameters:
8
- t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Hermes for input & output, WizardMath in the middle layers
 
1
  models:
2
  - model: MotherEarth/MotherEarth_1.0
3
+ - model: MotherEarth/slerp_MotherEarth-MothErarth_slerp_aflah-linear_strom
4
  merge_method: slerp
5
  base_model: MotherEarth/MotherEarth_1.0
6
+ dtype: bfloat16
7
  parameters:
8
+ t: [0.2, 0.4, 0.8, 0.4, 0.2] # V shaped curve: Hermes for input & output, WizardMath in the middle layers
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a31e9bb9b04c2bf28f11487a3f02fd00d6dcbbb24605241e777d155e1acd59b5
3
- size 4953586328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:003e3b378aacff044f449f7e3a8c8ad1b220961c5c7f7a415e679b0f9aa5f5a8
3
+ size 4953586384
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:20a4a2c10dee3cd4bd80b10299fe48b249e271eb0fd7d4f447f0ac35bafdaab6
3
- size 4999819232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2960c39b03dd4921bb38644fd22380ce7d3cd0de2d2eed43f9a88e3a1d943f8e
3
+ size 4999819336
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ff7346df3b8a73e36f5ab57fee434f46f422d3602e1662cbbd9f6d2c91b43e53
3
- size 4915916048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed26b733779f321b51f886c6aefe974822be22c489c15afd911702721b50b568
3
+ size 4915916144
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:da1e9b79ac4033521f122bb42b77c455733082f41e675c17c6aa561f220f883d
3
- size 1191234448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27edd6cc3f5e44c9181df24c2fa0ac642b862ddcd786af3d8c160dea4a6e94c8
3
+ size 1191234472