new_finetuned_model_xavier / added_tokens.json
xavier7778's picture
Upload tokenizer
f0a9ab1 verified
raw
history blame
53 Bytes
{
"<|end_of_turn|>": 32000,
"<|pad_0|>": 32001
}