CS6220-GPT / added_tokens.json
MichaelHu03's picture
Upload tokenizer
aa3eafd verified
raw
history blame
51 Bytes
{
"<|im_end|>": 40479,
"<|im_start|>": 40478
}