Template
#6
by
tugot17
- opened
For running the model directly via the .generate
, without wrapping it into the chat thing, what is the proper template for running the model?
<|begin▁of▁sentence|><|User|>How many r in strawberry? <|Assistant|>ssssssss
Is it possible to specify the compute budget in the system prompt?