Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness.
Vien V. MaiMikael JohanssonPublished in: ICML (2021)
Keyphrases
- stochastic gradient
- lipschitz continuity
- set valued
- linear complementarity problem
- variational inequalities
- semidefinite
- step size
- convergence rate
- sufficient conditions
- nearest neighbor classifier
- stochastic gradient descent
- cost function
- convergence speed
- machine learning
- dominance relation
- belief functions
- convex sets
- objective function