Hugging Face's logo

TheBloke
/
Llama-2-7B-Chat-GPTQ

Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-2
text-generation-inference
4-bit precision
gptq
Model card Files Community
36
float-trip commited on
Commit
31852af
•
1 Parent(s): 7579d9c

Update prompt format

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -45,7 +45,8 @@ Multiple GPTQ parameter permutations are provided; see Provided Files below for
45
  [INST] <<SYS>>
46
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
47
  <</SYS>>
48
- {prompt}[/INST]
 
49
  ```
50
 
51
  To continue a conversation:
@@ -54,8 +55,8 @@ To continue a conversation:
54
  [INST] <<SYS>>
55
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
56
  <</SYS>>
57
- {prompt}[/INST]{model_reply}
58
- [INST]{prompt}[/INST]
59
  ```
60
 
61
  ## Provided files
 
45
  [INST] <<SYS>>
46
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
47
  <</SYS>>
48
+
49
+ {prompt} [/INST]
50
  ```
51
 
52
  To continue a conversation:
 
55
  [INST] <<SYS>>
56
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
57
  <</SYS>>
58
+
59
+ {prompt} [/INST] {model_reply} [INST] {prompt} [/INST]
60
  ```
61
 
62
  ## Provided files