To load the tokeniser for this model, do not use AutoTokenizer. Instead, install TkTkT and run:

from tktkt.models.bpe.base import ClassicBPE
tokenizer = ClassicBPE.from_pretrained("Bauwens/RoBERTa-nl_BPE_39k")
Downloads last month
33
Safetensors
Model size
117M params
Tensor type
F32
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including Bauwens/RoBERTa-nl_BPE_39k