Usage in llamaindex

#12
by TungThanh94 - opened

Hello.
I'm using this in my llamaindex project. This is my code to load the model.

from llama_index.core import Settings
from llama_index.embeddings.huggingface import HuggingFaceEmbedding
Settings.embed_model = HuggingFaceEmbedding(model_name=embed_name_or_path)

In the terminal, I see this warning:
"Some weights of BertModel were not initialized from the model checkpoint at Snowflake/snowflake-arctic-embed-m and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference."

Can anyone help me on how to load the model correctly.
Thanks a lot!

Snowflake org

I have followed up with the llama index folks, who have updated their config not to include poolers. This should be fixed.

Snowflake org

Fixed

spacemanidol changed discussion status to closed

Sign up or log in to comment