Recommended Hardware requirements for running Llama 3.1 70B locally?

#16
by ArnavModanwal - opened

I am trying to determine the minimum hardware required to run llama 3.1 70B locally, through this website I have got some idea but still unsure if it will be enough or not?

https://llamaimodel.com/requirements/

Can someone help me in determining the best hardware (recommended not minimum) for running locally, so that I can invest my money in the right place instead of buying the wrong ones.

Thanks a lot @nbroad for the resource!

ArnavModanwal changed discussion status to closed

Sign up or log in to comment