Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably).
Yu HuangJunyang LinChang ZhouHongxia YangLongbo HuangPublished in: ICML (2022)
Keyphrases
- multi modal
- deep learning
- deep architectures
- restricted boltzmann machine
- multi modality
- high dimensional
- machine learning
- cross modal
- unsupervised feature learning
- training set
- unsupervised learning
- single modality
- multiple modalities
- video search
- uni modal
- mental models
- model selection
- supervised learning
- high level
- computer vision