Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 11.7k

Running on CPU Upgrade

Hi! If you are talking about the Gradio version, we are running on 4.9.

no talking about the transformers version. It was bumped to v.4.37.0 this morning so I was wondering if the leaderboard still runs on 4.36.2 or is already on 4.37.0
my point relates to phi-2 which has been integrated and does not require trust_remote_code=True anymore

Hi,
No, not yet, we'll probably transfer this during the week.

ok thanks. btw, would be great to put this info somewhere.

The info about all the dependencies of the project is in the requirements.txt.
I'll leave this issue open in order to not forget this upgrade.

any ETA? would be great for Qwen2 / Phi-2 based models. thanks.

Yep, we'll do an upgrade on Wednesday or Thursday this week at the latest, we're waiting for the latest transformers upgrade. Sorry for the very late answer.

Hi! Upgrade was done by @SaylorTwift today, you're getting Qwen2/Phi2 and Gemma all in one! :)