meelu
/

DA-BPE-LLAMA3.2-TOKEN

BPE Tokenization

Model card Files Files and versions Community

DA-BPE-LLAMA3.2-TOKEN

1 contributor

History: 4 commits

MikkelWK's picture

Rename DA BPE Llama 3.2 Special Tokens Map.json to special_tokens_map.json

5c50ea3 verified 23 days ago

.gitattributes

1.52 kB

initial commit 23 days ago
DA BPE Llama 3.2 Tokenizer Config.json

730 Bytes

Upload 3 files 23 days ago
special_tokens_map.json

141 Bytes

Rename DA BPE Llama 3.2 Special Tokens Map.json to special_tokens_map.json 23 days ago
tokenizer.json

9.67 MB

Rename DA BPE LLAMA 3.2 Tokenizer.json to tokenizer.json 23 days ago