grimjim commited on
Commit
8ccbd48
1 Parent(s): 471509b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +53 -54
README.md CHANGED
@@ -1,54 +1,53 @@
1
- ---
2
- base_model:
3
- - mlabonne/NeuralDaredevil-8B-abliterated
4
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
5
- - Hastagaras/Halu-OAS-8B-Llama3
6
- library_name: transformers
7
- tags:
8
- - mergekit
9
- - merge
10
- pipeline_tag: text-generation
11
- license: llama3
12
- license_link: LICENSE
13
- ---
14
- # Llama-3-Oasis-v1-OAS-8B-8bpw_h8_exl2
15
-
16
- This is an 8bpw exl2 quant of [grimjim/Llama-3-Oasis-v1-OAS-8B](https://huggingface.co/grimjim/Llama-3-Oasis-v1-OAS-8B)
17
-
18
- This model is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
19
-
20
- Built with Meta Llama 3.
21
-
22
- ## Merge Details
23
- ### Merge Method
24
-
25
- This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [mlabonne/NeuralDaredevil-8B-abliterated](https://huggingface.co/mlabonne/NeuralDaredevil-8B-abliterated) as a base.
26
-
27
- ### Models Merged
28
-
29
- The following models were included in the merge:
30
- * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS)
31
- * [Hastagaras/Halu-OAS-8B-Llama3](https://huggingface.co/Hastagaras/Halu-OAS-8B-Llama3)
32
-
33
- ### Configuration
34
-
35
- The following YAML configuration was used to produce this model:
36
-
37
- ```yaml
38
- base_model: mlabonne/NeuralDaredevil-8B-abliterated
39
- dtype: bfloat16
40
- merge_method: task_arithmetic
41
- slices:
42
- - sources:
43
- - layer_range: [0, 32]
44
- model: mlabonne/NeuralDaredevil-8B-abliterated
45
- - layer_range: [0, 32]
46
- model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
47
- parameters:
48
- weight: 0.3
49
- - layer_range: [0, 32]
50
- model: Hastagaras/Halu-OAS-8B-Llama3
51
- parameters:
52
- weight: 0.3
53
-
54
- ```
 
1
+ ---
2
+ base_model:
3
+ - mlabonne/NeuralDaredevil-8B-abliterated
4
+ - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
5
+ - Hastagaras/Halu-OAS-8B-Llama3
6
+ library_name: transformers
7
+ tags:
8
+ - mergekit
9
+ - merge
10
+ pipeline_tag: text-generation
11
+ license: cc-by-nc-4.0
12
+ ---
13
+ # Llama-3-Oasis-v1-OAS-8B-8bpw_h8_exl2
14
+
15
+ This is an 8bpw exl2 quant of [grimjim/Llama-3-Oasis-v1-OAS-8B](https://huggingface.co/grimjim/Llama-3-Oasis-v1-OAS-8B)
16
+
17
+ This model is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
+
19
+ Built with Meta Llama 3.
20
+
21
+ ## Merge Details
22
+ ### Merge Method
23
+
24
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [mlabonne/NeuralDaredevil-8B-abliterated](https://huggingface.co/mlabonne/NeuralDaredevil-8B-abliterated) as a base.
25
+
26
+ ### Models Merged
27
+
28
+ The following models were included in the merge:
29
+ * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS)
30
+ * [Hastagaras/Halu-OAS-8B-Llama3](https://huggingface.co/Hastagaras/Halu-OAS-8B-Llama3)
31
+
32
+ ### Configuration
33
+
34
+ The following YAML configuration was used to produce this model:
35
+
36
+ ```yaml
37
+ base_model: mlabonne/NeuralDaredevil-8B-abliterated
38
+ dtype: bfloat16
39
+ merge_method: task_arithmetic
40
+ slices:
41
+ - sources:
42
+ - layer_range: [0, 32]
43
+ model: mlabonne/NeuralDaredevil-8B-abliterated
44
+ - layer_range: [0, 32]
45
+ model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
46
+ parameters:
47
+ weight: 0.3
48
+ - layer_range: [0, 32]
49
+ model: Hastagaras/Halu-OAS-8B-Llama3
50
+ parameters:
51
+ weight: 0.3
52
+
53
+ ```