library_name: tokenizers tags: - Danish - Morphological Tokenization - LLaMA
A morphological tokenizer tailored for the LLaMA architecture, designed to enhance segmentation of Danish text by leveraging morphology-aware strategies.
