MJ-Bench-DPO - a yichaodu Collection

yichaodu 's Collections

MJ-Bench-DPO

updated Jul 9

MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?

Paper • 2407.04842 • Published Jul 5 • 52

Note A novel benchmark which incorporates a comprehensive preference dataset to evaluate multimodal judges in providing feedback for image generation models across four key perspectives: Alignment, Safety, Image Quality (Aesthetics and Artifacts), and Bias.
yichaodu/DiffusionDPO-alignment-gemini-1.5

Text-to-Image • Updated Jul 9 • 9
yichaodu/DiffusionDPO-safety-internvl-1.5

Text-to-Image • Updated Jul 9 • 3
yichaodu/DiffusionDPO-alignment-gpt-4o

Text-to-Image • Updated Jul 9 • 7
yichaodu/DiffusionDPO-alignment-gpt-4v

Text-to-Image • Updated Jul 9 • 5
yichaodu/DiffusionDPO-alignment-internvl-1.5

Text-to-Image • Updated Jul 9 • 5
yichaodu/DiffusionDPO-alignment-hps-2.1

Text-to-Image • Updated Jul 9 • 6
yichaodu/DiffusionDPO-safety-claude3-opus

Text-to-Image • Updated Jul 9 • 4
yichaodu/DiffusionDPO-safety-gemini-1.5

Text-to-Image • Updated Jul 9 • 5
yichaodu/DiffusionDPO-safety-gpt-4o

Text-to-Image • Updated Jul 9 • 6
yichaodu/DiffusionDPO-alignment-claude3-opus

Text-to-Image • Updated Jul 9 • 8
yichaodu/DiffusionDPO-safety-gpt-4v

Text-to-Image • Updated Jul 9 • 5
yichaodu/DiffusionDPO-safety-hps-2.1

Text-to-Image • Updated Jul 9 • 6
yichaodu/DiffusionDPO-bias-claude3-opus

Text-to-Image • Updated Jul 9 • 7
yichaodu/DiffusionDPO-bias-gpt-4o

Text-to-Image • Updated Jul 9 • 6
yichaodu/DiffusionDPO-bias-gpt-4v

Text-to-Image • Updated Jul 9 • 5
yichaodu/DiffusionDPO-bias-gemini-1.5

Text-to-Image • Updated Jul 9 • 4 • 1
yichaodu/DiffusionDPO-bias-hps-2.1

Text-to-Image • Updated Jul 9 • 6
yichaodu/DiffusionDPO-bias-internvl-1.5

Text-to-Image • Updated Jul 9 • 8