Scaling Distributed Training with Adaptive Summation.
Saeed MalekiMadan MusuvathiTodd MytkowiczOlli SaarikiviTianju XuVadim EksarevskiyJaliya EkanayakeEmad BarsoumPublished in: MLSys (2021)
Keyphrases
- distributed systems
- computer networks
- peer to peer
- training set
- online learning
- data mining
- communication overhead
- distributed environment
- mobile agents
- test set
- evolutionary algorithm
- cooperative
- multi agent
- information retrieval
- digital libraries
- training samples
- multiscale
- image sequences
- e learning
- training algorithm
- distributed data
- database
- distributed architecture
- heterogeneous environments
- cmac neural network