Gradient Starvation: A Learning Proclivity in Neural Networks.
Mohammad PezeshkiSékou-Oumar KabaYoshua BengioAaron C. CourvilleDoina PrecupGuillaume LajoiePublished in: NeurIPS (2021)
Keyphrases
- neural network
- learning algorithm
- learning process
- learning systems
- learning capabilities
- incremental learning
- learning tasks
- online learning
- learning rules
- learning scenarios
- artificial neural networks
- bayesian networks
- prior knowledge
- neural network model
- pattern recognition
- neural nets
- decision trees
- genetic algorithm