gpt2-medium / special_tokens_map.json
byeongal's picture
gpt2-medium for teachable-nlp
601c1d9
raw
history blame contribute delete
90 Bytes
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}