Accelerating Minibatch Stochastic Gradient Descent Using Typicality Sampling.
Xinyu PengLi LiFei-Yue WangPublished in: IEEE Trans. Neural Networks Learn. Syst. (2020)
Keyphrases
- stochastic gradient descent
- least squares
- importance sampling
- matrix factorization
- loss function
- step size
- monte carlo
- random forests
- random sampling
- online algorithms
- weight vector
- support vector machine
- sample size
- regularization parameter
- multiple kernel learning
- linear combination
- optical flow
- decision trees
- markov chain monte carlo
- approximate inference
- image processing
- parameter space
- kalman filter
- cost function