sometimesanotion
/

Lamarck-14B-v0.7-Fusion

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sometimesanotion commited on about 15 hours ago

Commit

45016f0

·

verified ·

1 Parent(s): 3fa0145

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -15,6 +15,7 @@ language:
 # EXPERIMENTAL:
 So what's this new arcee_fusion merge method, and what can we do with it?  This model aims to find out, as a multi-stage merge where 3 out of 4 steps are fusions:
 * A fusion of [Lamarck-14B-v0.7](http://huggingface.co/sometimesanotion/Lamarck-14B-v0.7) and @suayptalha's [Lamarckvergence SLERP merge](http://huggingface.co/suayptalha/Lamarckvergence-14B) of Lamarck-14B-v0.7 and [Qwenvergence-14B-v12-Prose-DS](http://huggingface.co/sometimesanotion/Qwenvergence-14B-v12-Prose-DS).
 * A SLERP of Lamarck-14B-v0.7-Fusionvergence with Qwenvergence-14B-v12-Prose-DS, the latter emphasized in later layers.

 # EXPERIMENTAL:
 So what's this new arcee_fusion merge method, and what can we do with it?  This model aims to find out, as a multi-stage merge where 3 out of 4 steps are fusions:
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/665fef5a4794222f6a2fe605/5J98k-IqLMb_obGPaP1CM.png)
 * A fusion of [Lamarck-14B-v0.7](http://huggingface.co/sometimesanotion/Lamarck-14B-v0.7) and @suayptalha's [Lamarckvergence SLERP merge](http://huggingface.co/suayptalha/Lamarckvergence-14B) of Lamarck-14B-v0.7 and [Qwenvergence-14B-v12-Prose-DS](http://huggingface.co/sometimesanotion/Qwenvergence-14B-v12-Prose-DS).
 * A SLERP of Lamarck-14B-v0.7-Fusionvergence with Qwenvergence-14B-v12-Prose-DS, the latter emphasized in later layers.