Pathways: Asynchronous Distributed Dataflow for ML.
Paul BarhamAakanksha ChowdheryJeff DeanSanjay GhemawatSteven HandDan HurtMichael IsardHyeontaek LimRuoming PangSudip RoyBrennan SaetaParker SchuhRyan SepassiLaurent El ShafeyChandramohan A. ThekkathYonghui WuPublished in: MLSys (2022)
Keyphrases
- distributed systems
- distributed constraint satisfaction
- cooperative
- distributed constraint satisfaction problems
- peer to peer
- parallel execution
- data sets
- distributed environment
- data flow
- maximum likelihood
- neural network
- parallel algorithm
- constraint satisfaction problems
- parallel computing
- loosely coupled
- control flow
- distributed network
- asynchronous communication
- data model
- graph transformation