Wrht: Efficient All-reduce for Distributed DNN Training in Optical Interconnect Systems.
Fei DaiYawen ChenZhiyi HuangHaibo ZhangPublished in: ICPP (2023)
Keyphrases
- distributed systems
- training process
- computer systems
- information systems
- computing environments
- distributed environment
- retrieval systems
- complex systems
- high speed
- neural network
- lightweight
- supervised learning
- parallel algorithm
- management system
- expert systems
- distributed database systems
- data intensive
- distributed computation