Fix the prompt format.
#20
by
float-trip
- opened
Two newlines after <</SYS>>: https://github.com/facebookresearch/llama/blob/main/llama/generation.py#L45
No newlines added after that, but [INST] and [/INST] always have a space around them (except for the last [/INST]): https://github.com/facebookresearch/llama/blob/main/llama/generation.py#L250
Thank you! Do you feel like doing the other -Chat-GPTQ models I have as well? :)
TheBloke
changed pull request status to
merged
Sure, I'll add PRs for those in a sec