EOS token should be <|end|>

#1
by Mungert - opened

Am I reading this correctly from your GUFF files tokenizer.ggml.eos_token_id is 199999 ... it should be 200020

Mungert changed discussion status to closed
Mungert changed discussion status to open
Unsloth AI org

You're correct! I re-uploaded all versions! Thanks for spotting it! It looks like I might have forgotten to fix it whoops!

Error: llama runner process has terminated: error loading model: missing tensor 'output.weight'

Error: llama runner process has terminated: error loading model: missing tensor 'output.weight'

This is unlikely to be related to the issue in this discussion. Check you model file download is not corrupted

Mungert changed discussion status to closed

Sign up or log in to comment