Beyond Image Preferences - Rich Human Feedback for Text-to-Image Generation
•
13
Jason Corkill
jasoncorkill
AI & ML interests
Human data annotation
Recent Activity
liked
a dataset
about 1 hour ago
Rapidata/sora-video-generation-alignment-likert-scoring
liked
a dataset
about 2 hours ago
Rapidata/sora-video-generation-physics-likert-scoring
liked
a dataset
about 3 hours ago
Rapidata/Runway_Frames_t2i_human_preferences
Articles
Organizations
Posts
3
Post
2590
We benchmarked
@xai-org
's Aurora model, as far as we know the first public evaluation of the model at scale.
We collected 401k human annotations in over the past ~2 days for this, we have uploaded all of the annotation data here on huggingface with a fully permissive license
Rapidata/xAI_Aurora_t2i_human_preferences
We collected 401k human annotations in over the past ~2 days for this, we have uploaded all of the annotation data here on huggingface with a fully permissive license
Rapidata/xAI_Aurora_t2i_human_preferences
Post
1134
We uploaded huge human annotated preference dataset for image generation. Instead of just having people choose which model they preferer, we annotated an alignment score on a word by word basis for the prompt. rate the images on coherence, overall alignment and style preference. Those images that score badly were also given to annotators to highlight problem areas. Check it out!
Rapidata/text-2-image-Rich-Human-Feedback
We also wrote a blog post for those who want a bit more detail:
https://huggingface.co/blog/RapidataAI/beyond-image-preferences
We also wrote a blog post for those who want a bit more detail:
https://huggingface.co/blog/RapidataAI/beyond-image-preferences
models
None public yet
datasets
None public yet