A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta.
Maksim VelikanovDenis KuznedelevDmitry YarotskyPublished in: CoRR (2022)
Keyphrases
- phase transition
- constraint satisfaction
- random constraint satisfaction problems
- satisfiability problem
- combinatorial problems
- randomly generated
- hard problems
- np complete
- random instances
- sufficient conditions
- sat problem
- cellular automata
- genetic algorithm
- scheduling problem
- random graphs
- stochastic local search