Accelerating Deep Neural Network Training with Inconsistent Stochastic Gradient Descent.
Linnan WangYi YangMartin Renqiang MinSrimat T. ChakradharPublished in: CoRR (2016)
Keyphrases
- neural network training
- stochastic gradient descent
- training algorithm
- least squares
- neural network
- step size
- loss function
- matrix factorization
- random forests
- support vector machine
- importance sampling
- optimization method
- regularization parameter
- weight vector
- multiple kernel learning
- online algorithms
- particle swarm optimisation
- back propagation
- convergence rate
- cost function