DaMorphTokenizers
Collection
DaMorph is a collection of experimental morphological tokenizers developed to explore the impact of morphological segmentation on Danish NLP.
•
6 items
•
Updated
_______ ___ .___ ___. ______ .______ .______ __ __
| \ / \ | \/ | / __ \ | _ \ | _ \ | | | |
| .--. | / ^ \ | \ / | | | | | | |_) | | |_) | | |__| |
| | | | / /_\ \ | |\/| | | | | | | / | ___/ | __ |
| '--' | / _____ \ | | | | | `--' | | |\ \----.| | | | | |
|_______/ /__/ \__\ |__| |__| \______/ | _| `._____|| _| |__| |__|
DA-MIXED-CEREBRAS-TOKEN
This tokenizer combines morphological and BPE tokenization strategies for use with the CerebrasGPT architecture, aiming to balance linguistic insights and subword efficiency.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.