Decentralized SGD and Average-direction SAM are Asymptotically Equivalent.

Tongtian Zhu Fengxiang He Kaixuan Chen Mingli Song Dacheng Tao

Published in: CoRR (2023)

Keyphrases

cooperative
data sets
standard deviation
decision making
distributed systems
peer to peer
peer to peer systems
machine learning
genetic algorithm
bayesian networks
multi agent
dynamic programming
mobile robot
upper bound
sample size