Text Generation
Transformers
Safetensors
English
falcon_mamba
Eval Results
Inference Endpoints

RuntimeError: Tensor on device meta is not on the expected device cuda:0!

#6
by abcdata - opened

I get this error while running the model. Is there anyone knows about any solution for this situation?

"RuntimeError: Tensor on device meta is not on the expected device cuda:0!"

Technology Innovation Institute org

Hu @abcdata
Can you share the full error trace please? Also, how do you load the model?

Sign up or log in to comment