Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD.

Jiayi Wang Shiqiang Wang Rong-Rong Chen Mingyue Ji

Published in: AAAI (2022)

Keyphrases

convergence analysis
global convergence
optimality conditions
newton method
approximation methods
optimization methods
convergence speed
stochastic gradient descent