model max length is 2048?
#7
by
yuchenlin
- opened
Hi , this line in tokenizer_config.json suggests that the model's max length is 2048, but shouldn't it be 8192?
https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1/blob/main/tokenizer_config.json#L63
Thanks!