The effect of the forget gate on bifurcation boundaries and dynamics in Recurrent Neural Networks and its implications for gradient-based optimization.
Alexander RehmerAndreas KrollPublished in: IJCNN (2022)
Keyphrases
- recurrent neural networks
- recurrent networks
- neural network
- echo state networks
- feed forward
- complex valued
- reservoir computing
- optimization algorithm
- neural model
- long short term memory
- optimization problems
- global optimization
- cascade correlation
- artificial neural networks
- feedforward neural networks
- optimization method
- real time
- hebbian learning
- evolutionary algorithm
- biologically inspired
- nonlinear dynamic systems
- probabilistic model
- chaotic time series