etemiz commited on
Commit
77aa3ed
·
verified ·
1 Parent(s): 41720c8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -40
README.md CHANGED
@@ -1,48 +1,20 @@
 
 
1
  ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
 
8
- ---
9
- # pab-no-2502-2424m
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [Task Arithmetic](https://arxiv.org/abs/2212.04089) merge method using /home/dead/m/md100/pab-no-1316 as a base.
17
 
18
- ### Models Merged
19
 
20
- The following models were included in the merge:
21
- * /home/dead/m/md60/merged/pab-no-2502-2209
22
- * /home/dead/m/md60/merged/pab-no-2502-1512
23
- * /home/dead/merged/pab-no-2502-2308
24
- * /home/dead/m/md60/merged/pab-no-1608-hf
25
 
26
- ### Configuration
27
 
28
- The following YAML configuration was used to produce this model:
29
 
30
- ```yaml
31
- models:
32
- - model: /home/dead/merged/pab-no-2502-2308
33
- parameters:
34
- weight: 0.3
35
- - model: /home/dead/m/md60/merged/pab-no-2502-2209
36
- parameters:
37
- weight: 0.3
38
- - model: /home/dead/m/md60/merged/pab-no-2502-1512
39
- parameters:
40
- weight: 0.2
41
- - model: /home/dead/m/md60/merged/pab-no-1608-hf
42
- parameters:
43
- weight: 0.2
44
- merge_method: task_arithmetic
45
- base_model: /home/dead/m/md100/pab-no-1316
46
- dtype: bfloat16
47
 
48
- ```
 
 
 
 
 
 
1
+ base_model:
2
+ - meta-llama/Llama-3.1-8B
3
  ---
 
 
 
 
 
4
 
 
 
 
 
 
 
 
 
 
5
 
6
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6619d084eae5a60bb86b0b4f/uRvMOGNihQyQZVi50eb3b.png)
7
 
 
 
 
 
 
8
 
9
+ A model based on [Nostr](https://nostr.com) notes. Training is ongoing, expect updates to this same rep.
10
 
11
+ Notes come from about 7000 users.
12
 
13
+ Base model instruct fine tuned using:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
+ - nickrosh/Evol-Instruct-Code
16
+ - m-a-p/CodeFeedback-Filtered-Instruction
17
+ - yingyingzhang/metamath-qwen2-math
18
+ - cognitivecomputations/dolphin-coder
19
+ - iamtarun/python_code_instructions_18k_alpaca
20
+ - OpenCoder-LLM/opc-sft-stage2