GSPMD: General and Scalable Parallelization for ML Computation Graphs.

Yuanzhong Xu HyoukJoong Lee Dehao Chen Blake A. Hechtman Yanping Huang Rahul Joshi Maxim Krikun Dmitry Lepikhin Andy Ly Marcello Maggioni Ruoming Pang Noam Shazeer Shibo Wang Tao Wang Yonghui Wu Zhifeng Chen

Published in: CoRR (2021)

Keyphrases