OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web.
Raghav KapoorYash Parag ButalaMelisa RussakJing Yu KohKiran KambleWaseem AlShikhRuslan SalakhutdinovPublished in: CoRR (2024)
Keyphrases
- autonomous agents
- multi agent systems
- dynamic environments
- incomplete information
- multiagent systems
- website
- multi agent
- web applications
- complex environments
- changing environment
- web pages
- intelligent behavior
- coalition formation
- learning agents
- semantic web
- user interface
- control architecture
- multi agent environments
- mental states
- computational systems
- open systems
- agent behavior
- coordination mechanisms
- desktop search
- distributed artificial intelligence
- virtual humans
- multi attribute
- end users