Law of Balance and Stationary Distribution of Stochastic Gradient Descent.
Ziyin LiuHongchao LiMasahito UedaPublished in: CoRR (2023)
Keyphrases
- stationary distribution
- stochastic gradient descent
- markov chain
- least squares
- matrix factorization
- random walk
- loss function
- importance sampling
- step size
- random forests
- initial state
- transition probabilities
- queue length
- queueing networks
- online algorithms
- sufficient conditions
- regularization parameter
- service times
- support vector machine
- weight vector
- steady state
- missing data
- online learning
- state space
- support vector
- image restoration
- graphical models