Bazsalanszky

/

Mistral-7b-0.1-alpaca-hun-gemini

like 3

My transfomers package was old.

Did this fix the issue?

Partially :)
A got a new error message but I search the solution. Surely my fault but I don't know...

I think you are missing the base model (Mistral).

You can also use a quantized version with llama.cpp:
https://huggingface.co/Bazsalanszky/Mistral-7b-0.1-alpaca-hun-gemini/blob/main/Mistral-7b-0.1-alpaca-hun-gemini-unsloth.Q4_K_M.gguf