deberta-v3-base / tokenizer_config.json
coreyhu's picture
Add model_max_length to tokenizer
d6986fe verified
raw
history blame
79 Bytes
{
"do_lower_case": false,
"vocab_type": "spm",
"model_max_length": 512
}