Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations.
Behnam NeyshaburYuhuai WuRuslan SalakhutdinovNati SrebroPublished in: NIPS (2016)
Keyphrases
- recurrent neural networks
- neural network
- feed forward
- echo state networks
- optimization algorithm
- recurrent networks
- complex valued
- reservoir computing
- neural model
- artificial neural networks
- feedforward neural networks
- optimization problems
- optimization methods
- shortest path
- multi objective
- global optimization
- nonlinear dynamic systems
- artificial intelligence