Adding Arabert
#3
by
wissamantoun
- opened
Hey is it possible if you have time to add the arabert tokenizers. You can make use of the arabert preprocessing code to make installation and tokenization easier. Thanks a lot for this resource
They are already there
Well when i visit the page and refresh even it doesn't appear
Also for the v1 and v2 models they need the arabert preprocessor