Gated recurrent neural networks discover attention.
Nicolas ZucchetSeijin KobayashiYassir AkramJohannes von OswaldMaxime LarcherAngelika StegerJoão SacramentoPublished in: CoRR (2023)
Keyphrases
- recurrent neural networks
- neural network
- feedforward neural networks
- feed forward
- recurrent networks
- complex valued
- reservoir computing
- cascade correlation
- long short term memory
- hidden layer
- neural model
- echo state networks
- artificial neural networks
- hebbian learning
- nonlinear dynamic systems
- machine learning
- chaotic time series
- mathematical model