Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks.
Minmin ChenJeffrey PenningtonSamuel S. SchoenholzPublished in: CoRR (2018)
Keyphrases
- recurrent neural networks
- long short term memory
- feed forward
- neural network
- hidden layer
- echo state networks
- complex valued
- reservoir computing
- recurrent networks
- feedforward neural networks
- artificial neural networks
- signal processing
- neural model
- neuro fuzzy
- cascade correlation
- markov random field
- vector field
- hebbian learning
- non stationary
- high frequency
- nonlinear dynamic systems
- support vector
- belief networks
- data mining