Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration.
Congliang ChenLi ShenFangyu ZouWei LiuPublished in: CoRR (2021)
Keyphrases
- theoretical developments
- theoretical basis
- mathematical foundations
- general theory
- real world
- iterative algorithms
- practical application
- data structure
- database
- theoretical framework
- computational model
- active learning
- reasoning about physical systems
- theoretical foundation
- convergence rate
- semi supervised
- expert systems
- decision making
- feature selection
- search engine
- machine learning
- neural network
- databases
- data sets
- real time