ParasiticRogue commited on
Commit
7c9f807
1 Parent(s): 1868cdb

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +60 -0
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - nbeerbower/mistral-nemo-bophades-12B
4
+ - nbeerbower/mistral-nemo-gutenberg-12B-v3
5
+ - nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
6
+ - mistralai/Mistral-Nemo-Instruct-2407
7
+ - intervitens/mini-magnum-12b-v1.1
8
+ - Sao10K/MN-12B-Lyra-v1
9
+ license: apache-2.0
10
+ library_name: transformers
11
+ tags:
12
+ - merge
13
+ - roleplay
14
+ - not-for-all-audiences
15
+ - exl2
16
+ ---
17
+
18
+ # Instant-RP-Noodles-12B-v1.2
19
+
20
+ An RP/Story writing merge of 3 models that all use the mistral prompt and have seen some success at higher context levels. The original models used were Mistral Instruct, Mini-Magnum, and Lyra-v1. These models then had extra dpo/orpo training done on top to enhance there already good creative capabilities. This 1.2 version *should* fix some problems with formatting that occurred in the initial merge, as well as increase its smarts a bit too.
21
+
22
+ Big thanks to the MistralAI team, intervitens and his Anthracite team, along with Sao10K for the original models used, plus nbeerbower for the extra training done as well!
23
+
24
+ Original model:
25
+
26
+ https://huggingface.co/ParasiticRogue/Instant-RP-Noodles-12B-v1.2
27
+
28
+ Parquet used:
29
+
30
+ https://huggingface.co/datasets/ParasiticRogue/Fullmoon-Light
31
+
32
+ ## Settings
33
+
34
+ Temperature @ 0.7
35
+
36
+ Min-P @ 0.02
37
+
38
+ Smoothing Factor @ 0.3
39
+
40
+ DRY Multiplier (plus standard DRY settings) @ 0.8
41
+
42
+ Skip Special Tokens @ On
43
+
44
+ Everything else @ Off
45
+
46
+ ### Prompt Format: Nemo-Mistral
47
+
48
+ ```
49
+ [INST] user prompt[/INST] character response</s>[INST] user prompt[/INST]
50
+ ```
51
+
52
+ ### Models Merged
53
+
54
+ The following models were included in the merge:
55
+
56
+ https://huggingface.co/nbeerbower/mistral-nemo-bophades-12B
57
+
58
+ https://huggingface.co/nbeerbower/mistral-nemo-gutenberg-12B-v3
59
+
60
+ https://huggingface.co/nbeerbower/Lyra-Gutenberg-mistral-nemo-12B