starchat-beta-GPTQ / special_tokens_map.json
TheBloke's picture
Fix for special_tokens_map as per upstream repo
3de36c0
raw
history blame
199 Bytes
{
"additional_special_tokens": [
"<|system|>",
"<|user|>",
"<|assistant|>",
"<|end|>"
],
"bos_token": "<|endoftext|>",
"eos_token": "<|end|>",
"unk_token": "<|endoftext|>"
}