how to stop the generation of text by <|eot_id|>?
#4
by
becks
- opened
how to stop the generation of text by <|eot_id|>?
it depends on what you are using really, but most libraries/application have a feature called stop or stop strings which allows you to pass a list of string you think the model should stop generating once that's visible. Here is the LM Studio: