HetPipe: Enabling Large DNN Training on (Whimpy) Heterogeneous GPU Clusters through Integration of Pipelined Model Parallelism and Data Parallelism.
Jay H. ParkGyeongchan YunChang M. YiNguyen T. NguyenSeungmin LeeJaesik ChoiSam H. NohYoung-ri ChoiPublished in: CoRR (2020)