Decentralized SGD and Average-direction SAM are Asymptotically Equivalent.

Tongtian Zhu Fengxiang He Kaixuan Chen Mingli Song Dacheng Tao

Published in: ICML (2023)

Keyphrases

cooperative
worst case
information systems
sample size
machine learning
social networks
multi agent
probability distribution
distributed systems
peer to peer
loss function