UBC-NLP
/

AraT5-tweet-base

Arabic Machine Translation

Arabic Text Summarization

Arabic News Title and Question Generation

Arabic Paraphrasing and Transliteration

Arabic Code-Switched Translation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

AraT5-tweet-base / tokenizer_config.json

m-nagoudi's picture

Update tokenizer_config.json

3af8b5a over 2 years ago

history blame contribute delete

81 Bytes

{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "extra_ids": 0}