MMMU

non-profit

https://mmmu-benchmark.github.io/

Activity Feed Request to join this org

AI & ML interests

Multimodal Model Evaluation

Recent Activity

RLSNLP authored a paper about 8 hours ago

MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI

RLSNLP authored a paper about 8 hours ago

iDesigner: A High-Resolution and Complex-Prompt Following Text-to-Image Diffusion Model for Interior Design

RLSNLP authored a paper about 8 hours ago

Lyrics: Boosting Fine-grained Language-Vision Alignment and Comprehension via Semantic-aware Visual Objects

View all activity

MMMU's activity

RLSNLP

authored 5 papers about 8 hours ago

MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI

Paper • 2311.16502 • Published Nov 27, 2023 • 35

iDesigner: A High-Resolution and Complex-Prompt Following Text-to-Image Diffusion Model for Interior Design

Paper • 2312.04326 • Published Dec 7, 2023 • 3

Lyrics: Boosting Fine-grained Language-Vision Alignment and Comprehension via Semantic-aware Visual Objects

Paper • 2312.05278 • Published Dec 8, 2023 • 3

Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset

Paper • 2408.09330 • Published Aug 18, 2024

Preference Leakage: A Contamination Problem in LLM-as-a-judge

Paper • 2502.01534 • Published 1 day ago • 20

yuexiang96

authored a paper 5 days ago

Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate

Paper • 2501.17703 • Published 6 days ago • 46

yuexiang96

authored a paper 11 days ago

Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videos

Paper • 2501.13826 • Published 12 days ago • 22

zhangysk

authored a paper 25 days ago

Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey

Paper • 2412.18619 • Published Dec 16, 2024 • 54

boyuanzheng010

authored a paper 29 days ago

Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents

Paper • 2411.06559 • Published Nov 10, 2024 • 13

gneubig

authored a paper about 2 months ago

TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks

Paper • 2412.14161 • Published Dec 18, 2024 • 50

wenhu

authored a paper about 2 months ago

MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale

Paper • 2412.05237 • Published Dec 6, 2024 • 47

gneubig

authored a paper about 2 months ago

MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale

Paper • 2412.05237 • Published Dec 6, 2024 • 47

yuexiang96

authored 4 papers about 2 months ago

JMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluation

Paper • 2410.17250 • Published Oct 22, 2024 • 14

Long Context Alignment with Short Instructions and Synthesized Positions

Paper • 2405.03939 • Published May 7, 2024

LIME: Less Is More for MLLM Evaluation

Paper • 2409.06851 • Published Sep 10, 2024

Machine Unlearning of Pre-trained Large Language Models

Paper • 2402.15159 • Published Feb 23, 2024

aaabiao

authored a paper about 2 months ago

MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale

Paper • 2412.05237 • Published Dec 6, 2024 • 47

yuexiang96

authored a paper about 2 months ago

MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale

Paper • 2412.05237 • Published Dec 6, 2024 • 47

yuexiang96

authored a paper 2 months ago

Evaluating Language Models as Synthetic Data Generators

Paper • 2412.03679 • Published Dec 4, 2024 • 46

gneubig

authored a paper 2 months ago

Evaluating Language Models as Synthetic Data Generators

Paper • 2412.03679 • Published Dec 4, 2024 • 46