Hugging Face's logo

yhavinga
/
Boreas-7B-chat-v1-GGUF

Transformers
GGUF
finetuned
Inference Endpoints
conversational
Model card Files Community
yhavinga commited on
Commit
f7f0981
•
1 Parent(s): 1ef26f6

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. Modelfile_Q4_K_M +19 -0
  2. Modelfile_Q4_K_S +19 -0
  3. Modelfile_Q5_1 +19 -0
  4. Modelfile_Q5_K +19 -0
  5. Modelfile_Q5_K_M +19 -0
  6. Modelfile_Q6_K +19 -0
  7. Modelfile_Q8_0 +19 -0
Modelfile_Q4_K_M ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM Boreas-7B-chat.Q4_K_M.gguf
2
+ SYSTEM Je bent Boreas een behulpzame Nederlandse AI assistent. Geef uitgebreid en geduldig antwoord.
3
+ TEMPLATE """{{- if .System }}
4
+ <|system|>
5
+ {{ .System }}
6
+ </s>
7
+ {{- end }}
8
+ <|user|>
9
+ {{ .Prompt }}
10
+ </s>
11
+ <|assistant|>
12
+ """
13
+ PARAMETER temperature 0.2
14
+ PARAMETER num_ctx 8192
15
+ PARAMETER stop "<|system|>"
16
+ PARAMETER stop "<|user|>"
17
+ PARAMETER stop "<|user>"
18
+ PARAMETER stop "<|assistant|>"
19
+ PARAMETER stop "</s>"
Modelfile_Q4_K_S ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM Boreas-7B-chat.Q4_K_S.gguf
2
+ SYSTEM Je bent Boreas een behulpzame Nederlandse AI assistent. Geef uitgebreid en geduldig antwoord.
3
+ TEMPLATE """{{- if .System }}
4
+ <|system|>
5
+ {{ .System }}
6
+ </s>
7
+ {{- end }}
8
+ <|user|>
9
+ {{ .Prompt }}
10
+ </s>
11
+ <|assistant|>
12
+ """
13
+ PARAMETER temperature 0.2
14
+ PARAMETER num_ctx 8192
15
+ PARAMETER stop "<|system|>"
16
+ PARAMETER stop "<|user|>"
17
+ PARAMETER stop "<|user>"
18
+ PARAMETER stop "<|assistant|>"
19
+ PARAMETER stop "</s>"
Modelfile_Q5_1 ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM Boreas-7B-chat.Q5_1.gguf
2
+ SYSTEM Je bent Boreas een behulpzame Nederlandse AI assistent. Geef uitgebreid en geduldig antwoord.
3
+ TEMPLATE """{{- if .System }}
4
+ <|system|>
5
+ {{ .System }}
6
+ </s>
7
+ {{- end }}
8
+ <|user|>
9
+ {{ .Prompt }}
10
+ </s>
11
+ <|assistant|>
12
+ """
13
+ PARAMETER temperature 0.2
14
+ PARAMETER num_ctx 8192
15
+ PARAMETER stop "<|system|>"
16
+ PARAMETER stop "<|user|>"
17
+ PARAMETER stop "<|user>"
18
+ PARAMETER stop "<|assistant|>"
19
+ PARAMETER stop "</s>"
Modelfile_Q5_K ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM Boreas-7B-chat.Q5_K.gguf
2
+ SYSTEM Je bent Boreas een behulpzame Nederlandse AI assistent. Geef uitgebreid en geduldig antwoord.
3
+ TEMPLATE """{{- if .System }}
4
+ <|system|>
5
+ {{ .System }}
6
+ </s>
7
+ {{- end }}
8
+ <|user|>
9
+ {{ .Prompt }}
10
+ </s>
11
+ <|assistant|>
12
+ """
13
+ PARAMETER temperature 0.2
14
+ PARAMETER num_ctx 8192
15
+ PARAMETER stop "<|system|>"
16
+ PARAMETER stop "<|user|>"
17
+ PARAMETER stop "<|user>"
18
+ PARAMETER stop "<|assistant|>"
19
+ PARAMETER stop "</s>"
Modelfile_Q5_K_M ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM Boreas-7B-chat.Q5_K_M.gguf
2
+ SYSTEM Je bent Boreas een behulpzame Nederlandse AI assistent. Geef uitgebreid en geduldig antwoord.
3
+ TEMPLATE """{{- if .System }}
4
+ <|system|>
5
+ {{ .System }}
6
+ </s>
7
+ {{- end }}
8
+ <|user|>
9
+ {{ .Prompt }}
10
+ </s>
11
+ <|assistant|>
12
+ """
13
+ PARAMETER temperature 0.2
14
+ PARAMETER num_ctx 8192
15
+ PARAMETER stop "<|system|>"
16
+ PARAMETER stop "<|user|>"
17
+ PARAMETER stop "<|user>"
18
+ PARAMETER stop "<|assistant|>"
19
+ PARAMETER stop "</s>"
Modelfile_Q6_K ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM Boreas-7B-chat.Q6_K.gguf
2
+ SYSTEM Je bent Boreas een behulpzame Nederlandse AI assistent. Geef uitgebreid en geduldig antwoord.
3
+ TEMPLATE """{{- if .System }}
4
+ <|system|>
5
+ {{ .System }}
6
+ </s>
7
+ {{- end }}
8
+ <|user|>
9
+ {{ .Prompt }}
10
+ </s>
11
+ <|assistant|>
12
+ """
13
+ PARAMETER temperature 0.2
14
+ PARAMETER num_ctx 8192
15
+ PARAMETER stop "<|system|>"
16
+ PARAMETER stop "<|user|>"
17
+ PARAMETER stop "<|user>"
18
+ PARAMETER stop "<|assistant|>"
19
+ PARAMETER stop "</s>"
Modelfile_Q8_0 ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM Boreas-7B-chat.Q8_0.gguf
2
+ SYSTEM Je bent Boreas een behulpzame Nederlandse AI assistent. Geef uitgebreid en geduldig antwoord.
3
+ TEMPLATE """{{- if .System }}
4
+ <|system|>
5
+ {{ .System }}
6
+ </s>
7
+ {{- end }}
8
+ <|user|>
9
+ {{ .Prompt }}
10
+ </s>
11
+ <|assistant|>
12
+ """
13
+ PARAMETER temperature 0.2
14
+ PARAMETER num_ctx 8192
15
+ PARAMETER stop "<|system|>"
16
+ PARAMETER stop "<|user|>"
17
+ PARAMETER stop "<|user>"
18
+ PARAMETER stop "<|assistant|>"
19
+ PARAMETER stop "</s>"