On the Representation Collapse of Sparse Mixture of Experts.
Zewen ChiLi DongShaohan HuangDamai DaiShuming MaBarun PatraSaksham SinghalPayal BajajXia SongFuru WeiPublished in: CoRR (2022)
Keyphrases
- domain experts
- mixture model
- knowledge acquisition
- dictionary learning for sparse
- sparsity constraints
- domain specific
- face recognition
- high dimensional
- expectation maximization
- image representation
- image segmentation
- spatial relations
- dictionary learning
- symbolic representation
- representation scheme
- information systems
- real time