On the Convergence of Adam under Non-uniform Smoothness: Separability from SGDM and Beyond.
Bohan WangHuishuai ZhangQi MengRuoyu SunZhi-Ming MaWei ChenPublished in: CoRR (2024)
Keyphrases
- convergence rate
- image sequences
- convergence property
- cost function
- dimensionality reduction
- data sets
- real time
- rapid convergence
- objective function
- general regression neural networks
- asymptotic convergence
- smoothing parameter
- global convergence
- faster convergence
- iterative algorithms
- initial conditions
- convergence speed
- data points
- multi objective
- prior knowledge
- pattern recognition
- feature selection
- social networks
- artificial intelligence
- information retrieval