From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces.
Peter ShawMandar JoshiJames CohanJonathan BerantPanupong PasupatHexiang HuUrvashi KhandelwalKenton LeeKristina ToutanovaPublished in: CoRR (2023)
Keyphrases
- graphical user interfaces
- learning systems
- learning tasks
- learning process
- online learning
- user interface
- reinforcement learning
- knowledge acquisition
- decision theoretic
- action selection
- learning algorithm
- active learning
- prior knowledge
- data mining
- domain independent
- decision trees
- goal directed
- learning mechanisms
- learned knowledge
- action models