Improved Overparametrization Bounds for Global Convergence of SGD for Shallow Neural Networks.
Bartlomiej PolaczykJacek CyrankaPublished in: Trans. Mach. Learn. Res. (2023)
Keyphrases
- global convergence
- neural network
- convergence analysis
- global optimum
- optimization methods
- convergence rate
- convex minimization
- convergence speed
- constrained optimization problems
- lower bound
- line search
- artificial neural networks
- coordinate ascent
- upper bound
- genetic algorithm
- fuzzy logic
- particle swarm
- linear combination
- cost function
- stochastic gradient descent
- search algorithm