evaluation completed but results not available

#401
by fblgit - opened

Hi @clefourrier
I kinda noticed some malfunctioning these last couple days on the evaluation .. including the manual commits you are performing (thanks for this).

Do u know when the pipeline or the next manual upload of results will be done? there is anyway i can give you a hand?

Open LLM Leaderboard org

Hi!
Thank you for proposing your help :)

The result evaluation pushes should be be automatic, we are investigating why they are not at the moment. I'll probably do one manual push per day in the meantime while we look for a fix.

Understood, appreciate your help on this.
Discussion can be closed, have a nice day ahead.

fblgit changed discussion status to closed
Open LLM Leaderboard org

You too :)

@clefourrier sorry to bother you, it is the manual commit happening today?

interim, i drop here some chore cosmetics:

https://huggingface.co/datasets/open-llm-leaderboard/results/discussions/15
https://huggingface.co/datasets/open-llm-leaderboard/requests/discussions/29

Let me know if u want some changes done in this or u have some other pieces where I can contribute or somehow free-up you a bit to push the results into the repo if possible.

Open LLM Leaderboard org

I did one manual push this morning (CET) so next one will be tomorrow morning :)

Thank you very much for your changes! I'll take a deeper look and give you feedback in the PRs, and thank you for your kind offer!

Sign up or log in to comment