mike-ravkine commited on
Commit
fcc4a89
1 Parent(s): 0eb2f8e

Update prompt format

Browse files

Based on discussion #3 and this GIST https://gist.github.com/the-crypt-keeper/8d781a12ee515903edc89ef69383570f update the chat template to match https://github.com/facebookresearch/llama/blob/main/llama/generation.py#L213

Files changed (1) hide show
  1. README.md +7 -3
README.md CHANGED
@@ -48,9 +48,13 @@ GGML files are for CPU + GPU inference using [llama.cpp](https://github.com/gger
48
  ## Prompt template: Llama-2-Chat
49
 
50
  ```
51
- System: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
52
- User: {prompt}
53
- Assistant:
 
 
 
 
54
  ```
55
 
56
  <!-- compatibility_ggml start -->
 
48
  ## Prompt template: Llama-2-Chat
49
 
50
  ```
51
+ <s>[INST] <<SYS>>
52
+ You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.
53
+
54
+ If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
55
+ <</SYS>>
56
+
57
+ {prompt} [/INST]
58
  ```
59
 
60
  <!-- compatibility_ggml start -->