metadata
library_name: transformers
tags:
- Danish
- BPE Tokenization
- LLaMA
A standard LLaMA-3.2 model trained with a pretrained Byte-Pair-Encoding (BPE) tokenizer. It provides a benchmark for evaluating the performance of more advanced tokenization approaches.
