qna_distilgpt2_dataset_2_v1 / added_tokens.json
kkasiviswanath's picture
Upload tokenizer
7e4bab8 verified
raw
history blame contribute delete
71 Bytes
{
"<|pad|>": 50259,
"<|sep|>": 50258,
"<|startoftext|>": 50257
}