MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI.
Xiang YueYuansheng NiKai ZhangTianyu ZhengRuoqi LiuGe ZhangSamuel StevensDongfu JiangWeiming RenYuxuan SunCong WeiBotao YuRuibin YuanRenliang SunMing YinBoyuan ZhengZhenzhu YangYibo LiuWenhao HuangHuan SunYu SuWenhu ChenPublished in: CoRR (2023)
Keyphrases
- artificial general intelligence
- subject matter
- information systems
- real world
- cognitive abilities
- human level
- solving problems
- intelligent systems
- multimodal interaction
- model based reasoning
- expert advice
- reasoning systems
- knowledge engineers
- general intelligence
- automated reasoning
- qualitative reasoning
- probabilistic reasoning
- spatial reasoning
- neural network
- comparative analysis
- audio visual
- domain experts
- information processing
- software engineering
- knowledge representation
- computer science
- multimedia
- decision making
- social networks
- artificial intelligence
- multimodal information