grimjim commited on
Commit
2304f1b
1 Parent(s): 22bcbc1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -56
README.md CHANGED
@@ -1,56 +1,51 @@
1
- ---
2
- base_model:
3
- - grimjim/llama-3-aaditya-OpenBioLLM-8B
4
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
5
- - cgato/L3-TheSpice-8b-v0.8.3
6
- library_name: transformers
7
- tags:
8
- - mergekit
9
- - merge
10
- pipeline_tag: text-generation
11
- license: llama3
12
- license_link: LICENSE
13
- ---
14
- # Llama-3-Luminurse-v0.2-OAS-8B-GGUF
15
-
16
- This repo contains GGUF quants of [Llama-3-Luminurse-v0.2-OAS-8B](https://huggingface.co/grimjim/Llama-3-Luminurse-v0.2-OAS-8B). For suggested sampler settings, refer to the model card of the original repo.
17
-
18
- This model is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
19
-
20
- Luminurse is a merge based on Lumimaid, enhanced with a biomedical model, with a dash of TheSpice thrown in to improve formatting of text generation.
21
-
22
- Built with Meta Llama 3.
23
-
24
- ## Merge Details
25
- ### Merge Method
26
-
27
- This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) as a base.
28
-
29
- ### Models Merged
30
-
31
- The following models were included in the merge:
32
- * [grimjim/llama-3-aaditya-OpenBioLLM-8B](https://huggingface.co/grimjim/llama-3-aaditya-OpenBioLLM-8B)
33
- * [cgato/L3-TheSpice-8b-v0.8.3](https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3)
34
-
35
- ### Configuration
36
-
37
- The following YAML configuration was used to produce this model:
38
-
39
- ```yaml
40
- base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
41
- slices:
42
- - sources:
43
- - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
44
- layer_range: [0,32]
45
- - model: grimjim/llama-3-aaditya-OpenBioLLM-8B
46
- layer_range: [0,32]
47
- parameters:
48
- weight: 0.2
49
- - model: cgato/L3-TheSpice-8b-v0.8.3
50
- layer_range: [0,32]
51
- parameters:
52
- weight: 0.04
53
- merge_method: task_arithmetic
54
- dtype: bfloat16
55
-
56
- ```
 
1
+ ---
2
+ base_model: grimjim/Llama-3-Luminurse-v0.2-OAS-8B
3
+ library_name: transformers
4
+ quanted_by: grimjim
5
+ pipeline_tag: text-generation
6
+ license: llama3
7
+ license_link: LICENSE
8
+ ---
9
+ # Llama-3-Luminurse-v0.2-OAS-8B-GGUF
10
+
11
+ This repo contains GGUF quants of [Llama-3-Luminurse-v0.2-OAS-8B](https://huggingface.co/grimjim/Llama-3-Luminurse-v0.2-OAS-8B). For suggested sampler settings, refer to the model card of the original repo.
12
+
13
+ This model is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ Luminurse is a merge based on Lumimaid, enhanced with a biomedical model, with a dash of TheSpice thrown in to improve formatting of text generation.
16
+
17
+ Built with Meta Llama 3.
18
+
19
+ ## Merge Details
20
+ ### Merge Method
21
+
22
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) as a base.
23
+
24
+ ### Models Merged
25
+
26
+ The following models were included in the merge:
27
+ * [grimjim/llama-3-aaditya-OpenBioLLM-8B](https://huggingface.co/grimjim/llama-3-aaditya-OpenBioLLM-8B)
28
+ * [cgato/L3-TheSpice-8b-v0.8.3](https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3)
29
+
30
+ ### Configuration
31
+
32
+ The following YAML configuration was used to produce this model:
33
+
34
+ ```yaml
35
+ base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
36
+ slices:
37
+ - sources:
38
+ - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
39
+ layer_range: [0,32]
40
+ - model: grimjim/llama-3-aaditya-OpenBioLLM-8B
41
+ layer_range: [0,32]
42
+ parameters:
43
+ weight: 0.2
44
+ - model: cgato/L3-TheSpice-8b-v0.8.3
45
+ layer_range: [0,32]
46
+ parameters:
47
+ weight: 0.04
48
+ merge_method: task_arithmetic
49
+ dtype: bfloat16
50
+
51
+ ```