Demystifying the Myths and Legends of Nonconvex Convergence of SGD.
Aritra DuttaEl Houcine BergouSoumia BoucherouiteNicklas WergeMelih KandemirXin LiPublished in: CoRR (2023)
Keyphrases
- stationary points
- global optimization
- optimization problems
- global convergence
- objective function
- globally convergent
- convergence speed
- stochastic gradient descent
- convergence rate
- neural network
- nonlinear programming
- multi objective
- update rule
- initial conditions
- cross validation
- pairwise
- image restoration and reconstruction