Arab_wordpiece / special_tokens_map.json
Respair's picture
Upload tokenizer
043ddd5 verified
{
"cls_token": "<CLS>",
"mask_token": "<MASK>",
"pad_token": "<pad>",
"sep_token": "<SEP>",
"unk_token": "<unk>"
}