Update tokenizer_config.json
#1
by
mishig
HF staff
- opened
As an intermediary fix, update "model_max_length": 512
until this github issue gets resolved
Xenova
changed pull request status to
merged
Thanks!