Update tokenizer_config.json

#1
by mishig HF staff - opened

As an intermediary fix, update "model_max_length": 512 until this github issue gets resolved

Xenova changed pull request status to merged

Thanks!

Sign up or log in to comment