kromeurus commited on
Commit
f1e9f72
·
verified ·
1 Parent(s): 1bc2086

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -5
README.md CHANGED
@@ -1,4 +1,3 @@
1
- ---
2
  base_model:
3
  - kromeurus/L3-Blackened-Sunfall-15B
4
  - ZeusLabs/L3-Aethora-15B-V2
@@ -9,14 +8,37 @@ tags:
9
  - not-for-all-audiences
10
  license: cc-by-sa-4.0
11
  ---
 
 
 
 
 
 
 
 
 
 
 
12
 
13
- ## Merge Details
14
 
 
15
 
 
 
16
 
17
- ### Merge Method
 
18
 
19
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method.
 
 
 
 
 
 
 
 
20
 
21
  ### Models Merged
22
 
@@ -24,7 +46,7 @@ The following models were included in the merge:
24
  * [ZeusLabs/L3-Aethora-15B-V2](https://huggingface.co/ZeusLabs/L3-Aethora-15B-V2)
25
  * [kromeurus/L3-Blackened-Sunfall-15B](https://huggingface.co/kromeurus/L3-Blackened-Sunfall-15B)
26
 
27
- ### Configuration
28
 
29
  The following YAML configuration was used to produce this model:
30
 
 
 
1
  base_model:
2
  - kromeurus/L3-Blackened-Sunfall-15B
3
  - ZeusLabs/L3-Aethora-15B-V2
 
8
  - not-for-all-audiences
9
  license: cc-by-sa-4.0
10
  ---
11
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/667eea5cdebd46a5ec4dcc3d/UMWmfuTrttjzcY0Xet7bT.jpeg)
12
+
13
+ Dear god, this model took half a day to upload because my internet kept cutting out. Totally worth it, though.
14
+
15
+ This is my attempt at making a more human and verbose version of Aethora v2 by ZeusLabs that's also better at eRP. While I liked both versions of Aethora for its coherency and storytelling for RP, it felt very neutral and tame; not lacking in creativity but restricted in a way.
16
+ So, why not take that and merge it with two of the most chaotic and human models out there; Sunfall Stheno and Jamet Blackroot. Somehow it worked.
17
+
18
+ I first created a frankenmerge of Sunfall Stheno and Jamet Blackroot with a bit of Llama 3Some into Blackened Sunfall (check og model card for details). What I'm calling the Blackfall series, merged that with Aethora v2 via the TIES method and you get a bright fluid model while retaining most of the intelligence from individual merged models.
19
+ Full disclosure, this is an experimental model that needs some more finetuning down the line. Please understand I'm still new to merging and there's probably something I missed. But fow now, I'm thrilled with the results. Proceed with caution.
20
+
21
+ ## Quants (Unavailable ATM)
22
 
23
+ ## Merge Details & Recommended Settings
24
 
25
+ (Still Testing; details might change)
26
 
27
+ Blackfall Summanus is a good balance between the chaos and literacy. Can get very explicit once in eRP. Though it can happen, it doesn't write for the user as often in limited testing. Dialogue is much more natural and connotative compared to Aethora v2 but doesn't ramble on like Blackened Sunfall.
28
+ Understands nuance and context better from being a larger(15B) model and from the additional training in Aethora v2, yet generates more vivid and human text. Likes sticking close to the example text. Leans romantic? The artistic movement, not the genre.
29
 
30
+ For a merge made from some of the most temperature intolerant models I've seen, Summanus is fine with high temps. Looses coherency past 2, but much better than Blackened Sunfall. Also, this model works best of default template setting. Llama 3 is okay, doesn't have the same 'sparkle' as default but ChatML straight up can break it.
31
+ I find I get better results with Top P & K, but min-p is great too; lean closer to zero.
32
 
33
+ Rec. Settings:
34
+ ```
35
+ Template: Model Default
36
+ Temperature: 1.3
37
+ Top P: 0.94
38
+ Top K: 31
39
+ Repeat Penelty: 1.05
40
+ Repeat Penelty Tokens: 256
41
+ ```
42
 
43
  ### Models Merged
44
 
 
46
  * [ZeusLabs/L3-Aethora-15B-V2](https://huggingface.co/ZeusLabs/L3-Aethora-15B-V2)
47
  * [kromeurus/L3-Blackened-Sunfall-15B](https://huggingface.co/kromeurus/L3-Blackened-Sunfall-15B)
48
 
49
+ ### Config
50
 
51
  The following YAML configuration was used to produce this model:
52