Hugging Face's logo

tiiuae
/
falcon-40b

Text Generation
Transformers
PyTorch
Safetensors
falcon
custom_code
text-generation-inference
Model card Files Community
115

Finetune Error using the notebook referred on the model page

#83
by hamad - opened
Discussion
hamad

I am following the notebook for fine tuning on my own hardware , but i get the error

RuntimeError: mat1 and mat2 shapes cannot be multiplied (2048x4544 and 1x10614784)

Notebook:
https://colab.research.google.com/drive/1BiQiw31DT7-cDp1-0ySXvvhzqomTdI-o?usp=sharing#scrollTo=_kbS7nRxcMt7

I have tried windows 11 RTX 3090 24GB setup aand also the Linux focal fossa 20.04 RTX 3060 12 GB setup

Sign up or log in to comment