Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization.
Difan ZouYuan CaoYuanzhi LiQuanquan GuPublished in: CoRR (2021)
Keyphrases
- neural network
- learning algorithm
- learning process
- neural nets
- pattern recognition
- unsupervised learning
- incremental learning
- learning systems
- prior knowledge
- artificial neural networks
- background knowledge
- training process
- efficient learning
- online learning
- knowledge acquisition
- fuzzy logic
- back propagation
- feed forward
- feature selection
- inductive inference
- learning machines