On the Stochastic Gradient Descent and Inverse Variance-flatness Relation in Artificial Neural Networks.
Xia XiongYong-Cong ChenChunxiao ShiPing AoPublished in: CoRR (2022)
Keyphrases
- stochastic gradient descent
- artificial neural networks
- least squares
- loss function
- step size
- matrix factorization
- support vector machine
- neural network
- random forests
- online algorithms
- weight vector
- learning algorithm
- multiple kernel learning
- optimal solution
- semi supervised
- markov chain
- genetic algorithm ga
- regularization parameter
- machine learning