IntervitensInc
/

Mistral-Small-24B-Instruct-2501-chatml

Text Generation

Model card Files Files and versions Community

intervitens commited on about 17 hours ago

Commit

779700d

·

verified ·

1 Parent(s): c9dbf5e

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +2 -2

tokenizer_config.json CHANGED Viewed

@@ -8025,8 +8025,8 @@
     "[SYSTEM_PROMPT]",
     "[/SYSTEM_PROMPT]",
     "[TOOL_CONTENT]",
-    "<SPECIAL_20>",
-    "<SPECIAL_21>",
     "<SPECIAL_22>",
     "<SPECIAL_23>",
     "<SPECIAL_24>",

     "[SYSTEM_PROMPT]",
     "[/SYSTEM_PROMPT]",
     "[TOOL_CONTENT]",
+    "<|im_start|>",
+    "<|im_end|>",
     "<SPECIAL_22>",
     "<SPECIAL_23>",
     "<SPECIAL_24>",