Hugging Face's logo
Nathan Habib's picture
157 14 29

Nathan Habib

SaylorTwift
lhoestq's profile picture Nosdivad's profile picture rizzware's profile picture
·

AI & ML interests

None yet

Articles

Organizations

Hugging Face's profile picture Evaluation datasets's profile picture HuggingFaceGECLM's profile picture BigCode's profile picture Hugging Face H4's profile picture BigCode Data's profile picture InternLM's profile picture Hugging Face Smol Cluster's profile picture Open LLM Leaderboard's profile picture huggingPartyParis's profile picture Qwen's profile picture gg-hf's profile picture Nanotron Research's profile picture HuggingFaceFW's profile picture HF-contamination-detection's profile picture hsramall's profile picture La Leaderboard's profile picture gg-tt's profile picture HuggingFaceEval's profile picture Novel Challenge's profile picture LLHF's profile picture SLLHF's profile picture lbhf's profile picture Lighteval testing org's profile picture

SaylorTwift's activity

New activity in hf-doc-build/doc-build about 2 months ago

Create lighteval/_versions.yml
#28 opened about 2 months ago by SaylorTwift
New activity in open-llm-leaderboard/open_llm_leaderboard 6 months ago

bump-transformers-to-4.41.1

2
#753 opened 6 months ago by alozowski

apply-ruff

7
#748 opened 6 months ago by alozowski
New activity in open-llm-leaderboard/GenerationVisualizer 6 months ago

bbh_math_fixes

1
#1 opened 6 months ago by alozowski
New activity in open-llm-leaderboard/open_llm_leaderboard 6 months ago

Understanding raw result data files

4
#729 opened 6 months ago by jerome-white

No good way to identify number of activated parameters causes MIxtral evaluation failures

32
#680 opened 7 months ago by 0-hero
New activity in open-llm-leaderboard/open_llm_leaderboard 7 months ago

GSM8K failure with Llama 3 finetunes

12
#703 opened 7 months ago by jeiku
New activity in open-llm-leaderboard-old/results 7 months ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B
#57 opened 7 months ago by SaylorTwift
New activity in open-llm-leaderboard-old/requests 7 months ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B
#102 opened 7 months ago by SaylorTwift
New activity in databricks/dbrx-base 7 months ago

Update README.md

1
#16 opened 7 months ago by SaylorTwift
New activity in open-llm-leaderboard/open_llm_leaderboard 8 months ago

Model evaluation failed after 2 days

17
#622 opened 8 months ago by migtissera

bigstral and bigyi both failed

1
#628 opened 8 months ago by ehartford
New activity in open-llm-leaderboard-old/results 8 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

2
#46 opened 9 months ago by SaylorTwift

Renaming Model gg-hf/gemma-7b to google/gemma-7b

2
#45 opened 9 months ago by SaylorTwift
New activity in google/gemma-7b 9 months ago

Fix typo
#15 opened 9 months ago by SaylorTwift
New activity in open-llm-leaderboard-old/details_google__gemma-2b 9 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b
#1 opened 9 months ago by SaylorTwift
New activity in open-llm-leaderboard-old/details_google__gemma-7b 9 months ago

Renaming Model gg-hf/gemma-7b to google/gemma-7b
#1 opened 9 months ago by SaylorTwift
New activity in open-llm-leaderboard-old/requests 9 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b
#59 opened 9 months ago by SaylorTwift

Renaming Model gg-hf/gemma-7b to google/gemma-7b
#58 opened 9 months ago by SaylorTwift
New activity in open-llm-leaderboard/open_llm_leaderboard 9 months ago

Model not found on hub

4
#584 opened 9 months ago by akshay326