ND911 commited on
Commit
18d6c12
1 Parent(s): 08b2b1c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -2
README.md CHANGED
@@ -6,13 +6,19 @@ library_name: transformers
6
  tags:
7
  - mergekit
8
  - merge
9
-
10
  ---
11
- # sfM-v1
 
 
 
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
 
15
  ## Merge Details
 
 
 
16
  ### Merge Method
17
 
18
  This model was merged using the passthrough merge method.
@@ -43,3 +49,22 @@ merge_method: passthrough
43
  dtype: float16
44
  name: fM-v2
45
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  tags:
7
  - mergekit
8
  - merge
9
+ - not-for-all-audiences
10
  ---
11
+
12
+ ![](maid.png)
13
+
14
+ # Mistralv0.2-StarlingLM-FrankenSonya-10.5B
15
 
16
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
 
18
  ## Merge Details
19
+
20
+ See Below
21
+
22
  ### Merge Method
23
 
24
  This model was merged using the passthrough merge method.
 
49
  dtype: float16
50
  name: fM-v2
51
  ```
52
+
53
+ ```yaml
54
+ models:
55
+ - model: mistralai/Mistral-7B-Instruct-v0.2
56
+ - model: Franken-Maid
57
+ parameters:
58
+ weight: 0.25
59
+ density: 1.0
60
+ - model: Franken-Maid
61
+ parameters:
62
+ weight: 0.30
63
+ density: 1.0
64
+ merge_method: dare_ties
65
+ base_model: mistralai/Mistral-7B-Instruct-v0.2
66
+ parameters:
67
+ int8_mask: true
68
+ dtype: bfloat16
69
+ name: fM-v2
70
+ ```