Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations.
Behnam NeyshaburYuhuai WuRuslan SalakhutdinovNathan SrebroPublished in: CoRR (2016)
Keyphrases
- recurrent neural networks
- feed forward
- neural network
- echo state networks
- recurrent networks
- complex valued
- feedforward neural networks
- hebbian learning
- reservoir computing
- artificial neural networks
- optimization algorithm
- global optimization
- neural model
- long short term memory
- cascade correlation
- optimization process
- optimization method
- nonlinear dynamic systems
- evolutionary algorithm
- real time
- dynamic environments
- knowledge base