INST issue and instuction following

by Solsboer - opened Mar 1

Mar 1

•

I tested the GGUF version and found that the model is very poorly following instructions of small complexity. Here is my example:

Also I noticed that it mostly fails after the model gives a proper response but then INST appears and everything becomes chaotic (this is also what we can see in the example).

For a very simple or default system prompts model behavior is pretty ok. I hope maybe this will help to improve the model. Good luck

Karols

bards.ai org Mar 1

Thanks a lot for your feedback. We are trying to improve model performance :D

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment