qna_gp2_medium_Dataset_v2 / added_tokens.json
kkasiviswanath's picture
Upload tokenizer
ae5df51 verified
raw
history blame contribute delete
71 Bytes
{
"<|pad|>": 50259,
"<|sep|>": 50258,
"<|startoftext|>": 50257
}