Input validation error: `inputs` tokens + `max_new_tokens` must be <= 32768. Given: 61079 `inputs` tokens and 1024 `max_new_tokens` Make sure 'text-generation' task is supported by the model.

#6
by tferhan - opened

Thanks first for the contribution. I used your code in my own use, and I got this erro after running the app succesfully many times : Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 61079 inputs tokens and 1024 max_new_tokens
Make sure 'text-generation' task is supported by the model.

Thanks for your message. I believe the number of input tokens, between context and chat history, exceeded the maximum token limit. I can investigate further, however clearing the chatbot conversation should help when it happens.

thank you

Sign up or log in to comment