Resurrecting Recurrent Neural Networks for Long Sequences.
Antonio OrvietoSamuel L. SmithAlbert GuAnushan FernandoÇaglar GülçehreRazvan PascanuSoham DePublished in: ICML (2023)
Keyphrases
- recurrent neural networks
- long sequences
- feed forward
- neural network
- reservoir computing
- hidden layer
- complex valued
- echo state networks
- recurrent networks
- data streams
- feedforward neural networks
- neural model
- mining sequential patterns
- artificial neural networks
- hebbian learning
- nonlinear dynamic systems
- real time
- long term
- neural models
- back propagation
- long short term memory