Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics.
Giancarlo KergKyle GoyetteMaximilian Puelma TouzelGauthier GidelEugene VorontsovYoshua BengioGuillaume LajoiePublished in: NeurIPS (2019)
Keyphrases
- recurrent neural networks
- recurrent networks
- learning process
- feed forward
- cascade correlation
- learning systems
- learning algorithm
- feedforward neural networks
- reservoir computing
- prior knowledge
- online learning
- inductive inference
- learning tasks
- complex valued
- neural model
- steady state
- mobile learning
- knowledge acquisition
- reinforcement learning