Question (Why not ChatML?)

#5
by mrfakename - opened

Hi,
Great model! Random question: is there any particular reason why you chose not to use the ChatML prompt format? I noticed it can sometimes "ramble" and was wondering if ChatML might help with that.
Thanks!

Hey! I just updated the config — the sliding window should’ve been “null”.
Did you check with the updated config?
No particular reason for not going ChatML. I still see fragmented prompt formats in the community. I can go with ChatML if all of us agrees.

migtissera changed discussion status to closed

Ah, nice. I just downloaded a couple minutes ago, so I think I got the updated config!

Maybe I have to train with the updated config then. Will give it a go.

migtissera changed discussion status to open

OK, thanks!

Another vote for ChatML here.

mrfakename changed discussion title from Question to Question (Why not ChatML?)

Sign up or log in to comment