Errors on The state dictionary

#4
by baconnier - opened

When i try:

RAG_used = RAGPretrainedModel.from_pretrained("jinaai/jina-colbert-v2")
I got :
ValueError: The state dictionary of the model you are trying to load is corrupted. Are you sure it was properly saved?

Jina AI org

hi @baconnier have you installed flash_attn as one of the dependency?

flash_attn has strict cuda, rocm requirement. Would it be possible to use the new model cpu only or even mps?

I got the same error when trying to initialize model with Colbert Checkpoint. flash-attn is installed and its version is 2.6.3. Is there any way to fix this?

Sign up or log in to comment