Mapping Natural Language Instructions to Mobile UI Action Sequences.

Yang Li Jiacong He Xin Zhou Yuan Zhang Jason Baldridge

Published in: ACL (2020)

Keyphrases

action sequences
natural language
mobile devices
user interface
plan recognition
initial state
human actions
machine learning
context aware
knowledge representation
visual scene
sensor networks
object oriented
logic programming
reinforcement learning
learning algorithm
real time