michaelkrumdickkensho
/

gpt-neox-tokenizer-digits-whitespace

Model card Files Files and versions Community

gpt-neox-tokenizer-digits-whitespace / tokenizer_config.json

michaelkrumdickkensho's picture

michaelkrumdickkensho

Upload 4 files

b6a8151 about 1 year ago

history blame contribute delete

47 Bytes

	{"tokenizer_class": "PreTrainedTokenizerFast"}