Assertion Error due to which Model is not being Loaded

#4
by ali00 - opened

I ran this before some weeks ago and it was working but now this error, how to work around it?

image.png

The AssertionError is related to how Llama's constructor __init__ method tries to set self.model, but received the value None. Assertions are used to check if conditions are true. Try to check if model_path is correctly set, either by debugging or just looking at the value of model_path before it is passed to the Llama class. Alternatively, post more of your code here so it would be easier to try to see what the problem is. My guess is that you might've changed model_path to a None value somewhere.

error is due to using ggml with llama cpp python which isn't supported anymore.

ali00 changed discussion status to closed

Sign up or log in to comment