Formatting clarification
#1
by
notafraud
- opened
Hi! Can you please clarify the part Make sure that there is a space between [/INST] and {{char}}: like [/INST] {{char}}: - is it specific to RP only, or is space also required for instructs and storytelling?
Should be the case for any instruct prompts. Leaving out a space between would cause Theia to generate gibberish.
Thanks for clarification! This essentially means that Theia uses Tokenizer V3 prompt format instead of Tokenizer V3 - Tekken format, despite being a Nemo-based model.