KOJUNSEO commited on
Commit
a8b6a46
1 Parent(s): 5a4eee6

Create Modelfile

Browse files
Files changed (1) hide show
  1. Modelfile +22 -0
Modelfile ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM JEJUMA-002-Q8_0.gguf
2
+
3
+ TEMPLATE """<|start_header_id|>system<|end_header_id|>
4
+
5
+ {System}
6
+ <|eot_id|><|start_header_id|>user<|end_header_id|>
7
+
8
+ {User}
9
+ <|eot_id|><|start_header_id|>assistant<|end_header_id|>
10
+
11
+ {Assistant}
12
+ """
13
+
14
+ PARAMETER temperature 0.1
15
+ PARAMETER top_p 0.9
16
+ PARAMETER num_predict 3000
17
+ PARAMETER num_ctx 4096
18
+ PARAMETER stop "<|eot_id|>"
19
+ PARAMETER stop "<|start_header_id|>"
20
+ PARAMETER stop "<|end_header_id|>"
21
+ PARAMETER stop "<|begin_of_text|>"
22
+ PARAMETER stop "<|end_of_text|>"