Gemma evaluation?
#4
by
brucethemoose
- opened
Can you submit gemma to the leaderboard? Whenever I try, its says "model not found on the hub," possibly because its behind a signup wall.
https://huggingface.co/google/gemma-7b-it
https://huggingface.co/google/gemma-7b
Also I can't seem to find you on Discord either.
Hello! I'd love to keep running evaluations but the compute cost is prohibitively expensive for me, feel free to fork this space and try out the code for yourself! If you need any help getting it setup don't hesitate to ask me about it.
P.S. my discord is still yeyito777, you should be able to find me in the huggingface server.