System Prompt Ignored
#6
by
publicmutiny
- opened
The model seems to ignore my system prompt, even if I make it very explicit. For example, the prompt below does not stop the model talking about dogs.
system_prompt = """You are completely forbidden from discussing dogs under any circumstances.\n If a user asks about dogs, do NOT provide any information about them. \n Instead, talk about cats as if the user had originally asked about cats. """
I add the user input to the system prompt and pass through apply_chat_template() before tokenization. The text looks correctly formatted when I inspect it.
I've read that the size of the model can impact its ability to follow system prompts. Is this model just not good at it, or am I missing something?