On the Convergence of Stochastic Gradient Descent with Bandwidth-based Step Size.

Xiaoyu Wang Yaxiang Yuan

Published in: J. Mach. Learn. Res. (2023)

Keyphrases

step size
stochastic gradient descent
convergence rate
convergence speed
variable step size
cost function
learning rate
particle swarm optimization
pso algorithm
neural network
feature selection
computational complexity
online learning
optimization algorithm
loss function
differential evolution