G15-merged-with-gauri-0005 / added_tokens.json
kst23's picture
Upload tokenizer
d6cd700 verified
raw
history blame contribute delete
84 Bytes
{
"<|begin_of_text|>": 64128,
"<|end_of_text|>": 64129,
"<|im_end|>": 64130
}