Spaces:
Running
Running
Input validation error: `inputs` tokens + `max_new_tokens` must be <= 32768. Given: 61079 `inputs` tokens and 1024 `max_new_tokens` Make sure 'text-generation' task is supported by the model.
#6
by
tferhan
- opened
Thanks first for the contribution. I used your code in my own use, and I got this erro after running the app succesfully many times : Input validation error: inputs
tokens + max_new_tokens
must be <= 32768. Given: 61079 inputs
tokens and 1024 max_new_tokens
Make sure 'text-generation' task is supported by the model.
Thanks for your message. I believe the number of input tokens, between context and chat history, exceeded the maximum token limit. I can investigate further, however clearing the chatbot conversation should help when it happens.
thank you