📈 Scaling Laws with Vocabulary
Collection
Increase your vocabulary size when you scale up your language model
•
5 items
•
Updated
•
4
The trained BPE tokenziers with various vocabulary sizes, which uses to study how the vocabulary size affects the performance of language models.