World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models
Paper
•
2306.08685
•
Published
•
1
Berkeley-NLP
university
AI & ML interests
We work on a broad range of topics including structured prediction, grounded language, computational linguistics, model robustness, and HCI.
Recent Activity
View all activity
Berkeley-NLP's activity
Jiayi-Pan
authored
5
papers
23 days ago
Inversion-Free Image Editing with Natural Language
Paper
•
2312.04965
•
Published
•
2
ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL
Paper
•
2402.19446
•
Published
DANLI: Deliberative Agent for Following Natural Language Instructions
Paper
•
2210.12485
•
Published
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
Paper
•
2405.10292
•
Published
•
1
alsuhr
authored
4
papers
24 days ago
DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning
Paper
•
2406.11896
•
Published
•
20
Abstract Visual Reasoning with Tangram Shapes
Paper
•
2211.16492
•
Published
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
Paper
•
2405.10292
•
Published
•
1
A Corpus for Reasoning About Natural Language Grounded in Photographs
Paper
•
1811.00491
•
Published
alsuhr
authored
a
paper
4 months ago
Jiayi-Pan
authored
a
paper
6 months ago
Jiayi-Pan
authored
a
paper
7 months ago
alsuhr
authored
8
papers
8 months ago
Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Paper
•
2306.01693
•
Published
•
3
We're Afraid Language Models Aren't Modeling Ambiguity
Paper
•
2304.14399
•
Published
Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling
Paper
•
2301.12050
•
Published
What's In My Big Data?
Paper
•
2310.20707
•
Published
•
11
Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting
Paper
•
2310.11324
•
Published
•
1
Autonomous Evaluation and Refinement of Digital Agents
Paper
•
2404.06474
•
Published
•
2
UNcommonsense Reasoning: Abductive Reasoning about Uncommon Situations
Paper
•
2311.08469
•
Published
•
11
Continual Learning for Instruction Following from Realtime Feedback
Paper
•
2212.09710
•
Published