From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces.
Peter ShawMandar JoshiJames CohanJonathan BerantPanupong PasupatHexiang HuUrvashi KhandelwalKenton LeeKristina ToutanovaPublished in: NeurIPS (2023)
Keyphrases
- learning algorithm
- graphical user interfaces
- reinforcement learning
- user interface
- learning process
- learning systems
- visual representation
- input image
- knowledge acquisition
- artificial intelligence
- decision theoretic
- goal directed
- learning mechanisms
- online learning
- pixel values
- inductive inference
- learning mechanism
- active learning
- machine learning