Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks.
Wei HuLechao XiaoJeffrey PenningtonPublished in: CoRR (2020)
Keyphrases
- network structure
- network analysis
- social networks
- cellular networks
- network design
- closed form
- automatic initialization
- network parameters
- telecommunication networks
- nonlinear functions
- linear constraints
- heterogeneous networks
- linear systems
- computer networks
- complex networks
- information retrieval
- social network analysis
- complex systems
- probability distribution
- multiresolution
- multiscale
- image segmentation
- knowledge base
- search engine
- learning algorithm