| FROM ./ggml-model-f16.gguf | |
| FROM ./mmproj-model-f16.gguf | |
| SYSTEM """ | |
| A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. | |
| """ | |
| TEMPLATE """ | |
| {{ .System }} | |
| USER: {{ .Prompt }} | |
| ASSISTANT: | |
| """ | |
| PARAMETER temperature 0.0 | |
| PARAMETER num_ctx 4096 | |