Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics.
Giancarlo KergKyle GoyetteMaximilian Puelma TouzelGauthier GidelEugene VorontsovYoshua BengioGuillaume LajoiePublished in: CoRR (2019)
Keyphrases
- recurrent neural networks
- recurrent networks
- learning algorithm
- feedforward neural networks
- learning process
- online learning
- steady state
- feed forward
- learning systems
- neural network
- decision making
- knowledge acquisition
- supervised learning
- prior knowledge
- biologically inspired
- reinforcement learning
- echo state networks
- cascade correlation