Untangling tradeoffs between recurrence and self-attention in neural networks.
Giancarlo KergBhargav KanuparthiAnirudh GoyalKyle GoyetteYoshua BengioGuillaume LajoiePublished in: CoRR (2020)
Keyphrases
- neural network
- pattern recognition
- fuzzy systems
- genetic algorithm
- multi layer
- artificial neural networks
- fuzzy logic
- recurrent neural networks
- computational intelligence
- back propagation
- fault diagnosis
- soft computing
- real time
- design decisions
- real world
- neural network model
- feed forward
- visual attention
- expert systems
- neural nets
- video sequences
- database
- rule extraction
- feedforward neural networks
- neural network is trained