Nitral-AI commited on
Commit
aefedc3
·
verified ·
1 Parent(s): bfee3e9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -26
README.md CHANGED
@@ -11,30 +11,4 @@ tags:
11
 
12
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/Mlmns28rm6piPC2m4WZAk.jpeg)
13
 
14
-
15
- The following models were included in the merge:
16
- * [Nitral-AI/OpiumOrca-L3-8B](https://huggingface.co/Nitral-AI/OpiumOrca-L3-8B)
17
- * [Nitral-AI/Smaurpo-L3-8B](https://huggingface.co/Nitral-AI/Smaurpo-L3-8B)
18
-
19
- ### Configuration
20
-
21
- The following YAML configuration was used to produce this model:
22
-
23
- ```yaml
24
- slices:
25
- - sources:
26
- - model: Nitral-AI/Smaurpo-L3-8B
27
- layer_range: [0, 32]
28
- - model: Nitral-AI/OpiumOrca-L3-8B
29
- layer_range: [0, 32]
30
- merge_method: slerp
31
- base_model: Nitral-AI/Smaurpo-L3-8B
32
- parameters:
33
- t:
34
- - filter: self_attn
35
- value: [0, 0.5, 0.3, 0.7, 1]
36
- - filter: mlp
37
- value: [1, 0.5, 0.7, 0.3, 0]
38
- - value: 0.5
39
- dtype: bfloat16
40
  ```
 
11
 
12
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/Mlmns28rm6piPC2m4WZAk.jpeg)
13
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ```