Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks.
Lei HuangXianglong LiuBo LangAdams Wei YuBo LiPublished in: CoRR (2017)
Keyphrases
- neural network
- optimization method
- euclidean space
- optimization procedure
- pattern recognition
- artificial neural networks
- optimization problems
- multi layer
- genetic algorithm
- stochastic programming
- decision variables
- robust optimization
- recurrent neural networks
- closed form
- optimization algorithm
- optimization process
- neural network model
- evolutionary strategy
- high dimensional