Evaluating Language Models as Synthetic Data Generators Paper • 2412.03679 • Published 20 days ago • 43
MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models Paper • 2410.17578 • Published Oct 23 • 1
Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languages Paper • 2410.16153 • Published Oct 21 • 43
Consent in Crisis: The Rapid Decline of the AI Data Commons Paper • 2407.14933 • Published Jul 20 • 12
Can Language Models Evaluate Human Written Text? Case Study on Korean Student Writing for Education Paper • 2407.17022 • Published Jul 24
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models Paper • 2406.05761 • Published Jun 9 • 2
Investigating How Large Language Models Leverage Internal Knowledge to Perform Complex Reasoning Paper • 2406.19502 • Published Jun 27 • 2
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models Paper • 2406.05761 • Published Jun 9 • 2
Aligning to Thousands of Preferences via System Message Generalization Paper • 2405.17977 • Published May 28 • 6
Aligning to Thousands of Preferences via System Message Generalization Paper • 2405.17977 • Published May 28 • 6
Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation Paper • 2401.06591 • Published Jan 12 • 3
Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision Paper • 2311.07362 • Published Nov 13, 2023
Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models Paper • 2405.01535 • Published May 2 • 119
Self-Explore to Avoid the Pit: Improving the Reasoning Capabilities of Language Models with Fine-grained Rewards Paper • 2404.10346 • Published Apr 16 • 1
Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models Paper • 2404.02575 • Published Apr 3 • 48
KMMLU: Measuring Massive Multitask Language Understanding in Korean Paper • 2402.11548 • Published Feb 18
Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once? Paper • 2402.11597 • Published Feb 18 • 1
LangBridge: Multilingual Reasoning Without Multilingual Supervision Paper • 2401.10695 • Published Jan 19 • 5
Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation Paper • 2401.06591 • Published Jan 12 • 3