Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks.

Wei Hu Lechao Xiao Jeffrey Pennington

Published in: ICLR (2020)

Keyphrases

social networks
telecommunication networks
complex networks
neural network
multiscale
linear programming
end to end
network design
linear constraints
cellular networks
network size
automatic initialization