Scaling Distributed Training with Adaptive Summation.
Saeed MalekiMadan MusuvathiTodd MytkowiczOlli SaarikiviTianju XuVadim EksarevskiyJaliya EkanayakeEmad BarsoumPublished in: CoRR (2020)
Keyphrases
- distributed systems
- cooperative
- training process
- multi agent
- online learning
- lightweight
- databases
- communication overhead
- adaptive learning
- data driven
- distributed environment
- distributed processing
- communication cost
- fault tolerant
- training examples
- virtual environment
- training set
- digital libraries
- search engine
- artificial intelligence
- information retrieval
- data mining