OALL/requests
Updated
•
16.7k
Open Arabic LLM Leaderboard
non-profit
AI & ML interests
LLM Evaluation
Recent Activity
OALL's activity
Hamza-Alobeidli
updated
a
dataset
about 1 hour ago
amztheory
updated
a
dataset
about 1 hour ago
alielfilali01
updated
a
dataset
about 1 hour ago
Hamza-Alobeidli
updated
2
datasets
1 day ago
alielfilali01
updated
a
Space
1 day ago
Hamza-Alobeidli
updated
a
dataset
4 days ago
Hamza-Alobeidli
updated
a
dataset
9 days ago
alielfilali01
posted
an
update
12 days ago
Post
3298
Unpopular opinion: Open Source takes courage to do !
Not everyone is brave enough to release what they have done (the way they've done it) to the wild to be judged !
It really requires a high level of "knowing wth are you doing" ! It's kind of a super power !
Cheers to the heroes here who see this!
Not everyone is brave enough to release what they have done (the way they've done it) to the wild to be judged !
It really requires a high level of "knowing wth are you doing" ! It's kind of a super power !
Cheers to the heroes here who see this!
-
- 3 replies
FAQ
16
#1 opened 7 months ago
by
alielfilali01
Looks like someone else submitted sambanovasystems/SambaLingo-Arabic-Base with wrong precision
11
#2 opened 7 months ago
by
zolicsaki
Some ‘finished’ models aren't visible in the leaderboard (result file is missing)
2
#5 opened 5 months ago
by
CombinHorizon
There is a delay in model evaluation
1
#4 opened 7 months ago
by
airev-ae
Model eval request FAILED ... how do we know the root cause?
2
#7 opened 5 months ago
by
karimouda
Arabic MMLU
1
#9 opened 4 months ago
by
Malikeh1375
Delay in Evaluation of airev-ai/Amal-70b-v1.1
#8 opened 5 months ago
by
airev-ae
Own DataSet
1
#10 opened 3 months ago
by
mjalg
Issue with Model Size Selection Display
1
#12 opened about 2 months ago
by
Slim205
Add Aya Expanse Models
#11 opened about 2 months ago
by
alexrs
alielfilali01
posted
an
update
16 days ago
Post
1474
Apparently i forgot to put this here !
Well, this is a bit late but consider given our recent blog a read if you are interested in Evaluation.
You don't have to be into Arabic NLP in order to read it, the main contribution we are introducing is a new evaluation measure for NLG. We made the fisrt application of this measure on Arabic for now and we will be working with colleagues from the community to expand it to other languages.
Blog:
Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard
https://huggingface.co/blog/leaderboard-3c3h-aragen
Space:
inceptionai/AraGen-Leaderboard
Give it a read and let me know your thoughts 🤗
Well, this is a bit late but consider given our recent blog a read if you are interested in Evaluation.
You don't have to be into Arabic NLP in order to read it, the main contribution we are introducing is a new evaluation measure for NLG. We made the fisrt application of this measure on Arabic for now and we will be working with colleagues from the community to expand it to other languages.
Blog:
Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard
https://huggingface.co/blog/leaderboard-3c3h-aragen
Space:
inceptionai/AraGen-Leaderboard
Give it a read and let me know your thoughts 🤗