EOS token should be <|end|>
#1
by
Mungert
- opened
Am I reading this correctly from your GUFF files tokenizer.ggml.eos_token_id is 199999 ... it should be 200020
Mungert
changed discussion status to
closed
Mungert
changed discussion status to
open
You're correct! I re-uploaded all versions! Thanks for spotting it! It looks like I might have forgotten to fix it whoops!
Error: llama runner process has terminated: error loading model: missing tensor 'output.weight'
Error: llama runner process has terminated: error loading model: missing tensor 'output.weight'
This is unlikely to be related to the issue in this discussion. Check you model file download is not corrupted
Mungert
changed discussion status to
closed