Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
New major refractor for LLM Evaluation Harness.
#488
by
acrastt
- opened
https://github.com/EleutherAI/lm-evaluation-harness/releases/tag/v0.4.0
@clefourrier @SaylorTwift You might wanna change the code and bump it to this version.
Hi!
We have been discussing this with the Eleuther team - we don't want to change the version of the code we are running, as we would need to be sure that it would give the exact same results as the one we are using now, to be fair to all models, but thanks a lot for the info!
clefourrier
changed discussion status to
closed