pietrolesci
/

tokenisers

Model card Files Files and versions Community

tokenisers / wordpiece32000minipile

1 contributor

History: 2 commits

pietrolesci's picture

Upload folder using huggingface_hub

a9481f6 verified about 18 hours ago

raw_tok_path.txt

72 Bytes

Upload folder using huggingface_hub about 18 hours ago
special_tokens_map.json

61 Bytes

Upload folder using huggingface_hub about 18 hours ago
tokenizer.json

768 kB

Upload folder using huggingface_hub about 18 hours ago
tokenizer_config.json

580 Bytes

Upload folder using huggingface_hub about 18 hours ago