Modified Step Size for Enhanced Stochastic Gradient Descent: Convergence and Experiments.

M. Soheil Shamaee S. Fathi Hafshejani

Published in: CoRR (2023)

Keyphrases

step size
stochastic gradient descent
convergence rate
convergence speed
variable step size
cost function
learning rate
least squares
differential evolution
particle swarm optimization
neural network
objective function
collaborative filtering
pso algorithm
random forests