ValueError: The following model_kwargs are not used by the model: ['token_type_ids'] (note: typos in the generate arguments will also show up in this list)
#7
by
Imran1
- opened
I trained the falcon 7b instruct model but when I load them for inference they give me the following error.
ValueError: The following model_kwargs are not used by the model: ['token_type_ids'] (note: typos in the generate arguments will also show up in this list)
Set 'return_token_type_ids=False' in tokenizer()
Set 'return_token_type_ids=False' in tokenizer()
Thank you .
FalconLLM
changed discussion status to
closed
did it solve for you?
Thank you！
Set 'return_token_type_ids=False' in tokenizer()