Accelerating Distributed K-FAC with Efficient Collective Communication and Scheduling.

Lin Zhang Shaohuai Shi Bo Li

Published in: INFOCOM (2023)

Keyphrases

communication overhead
communication cost
lightweight
cooperative
dynamic scheduling
neural network
distributed systems
resource allocation
resource constraints
fully distributed
mobile agents
communication systems
parallel machines
multimedia communication
distributed control