from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("israel/AmhWordPieceTokenizer")

encoding = tokenizer.encode("ኮሌጁ ቢያስተምርም ወደስራ የሚመድባቸው መንግስት ነው abcs")

encoding.tokens

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .