Shuai Zheng

Publication Activity (10 Years)

Years Active: 2013-2024
Publications (10 Years): 22

Top Topics

Variance Reduction

Top Venues

Proc. VLDB Endow.

Publications

Jun Huang, Zhen Zhang, Shuai Zheng, Feng Qin, Yida Wang
DISTMM: Accelerating Distributed Multimodal Model Training. NSDI (2024)
Chenyu Jiang, Ye Tian, Zhen Jia, Shuai Zheng, Chuan Wu, Yida Wang
Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping. MLSys (2024)
Hongzheng Chen, Cody Hao Yu, Shuai Zheng, Zhen Zhang, Zhiru Zhang, Yida Wang
Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training. ASPLOS (2) (2024)
Chenyu Jiang, Ye Tian, Zhen Jia, Shuai Zheng, Chuan Wu, Yida Wang
Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping. CoRR (2024)
Chenyu Jiang, Zhen Jia, Shuai Zheng, Yida Wang, Chuan Wu
DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines. EuroSys (2024)
Hongzheng Chen, Cody Hao Yu, Shuai Zheng, Zhen Zhang, Zhiru Zhang, Yida Wang
Decoupled Model Schedule for Deep Learning Training. CoRR (2023)
Zhen Zhang, Shuai Zheng, Yida Wang, Justin Chiu, George Karypis, Trishul Chilimbi, Mu Li, Xin Jin
MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud. Proc. VLDB Endow. 16 (1) (2022)
M. Saiful Bari, Aston Zhang, Shuai Zheng, Xingjian Shi, Yi Zhu, Shafiq Joty, Mu Li
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning. CoRR (2022)
Chaoyang He, Shuai Zheng, Aston Zhang, George Karypis, Trishul Chilimbi, Mahdi Soltanolkotabi, Salman Avestimehr
SMILE: Scaling Mixture-of-Experts with Efficient Bi-level Routing. CoRR (2022)
Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng, Yi Zhu
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. J. Mach. Learn. Res. 21 (2020)
Shuai Zheng, Ziyue Huang, James T. Kwok
Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback. NeurIPS (2019)
Shuai Zheng, Ziyue Huang, James T. Kwok
Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback. CoRR (2019)
Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. CoRR (2019)
Shuai Zheng, James T. Kwok
Blockwise Adaptivity: Faster Training and Better Generalization in Deep Learning. CoRR (2019)
Shuai Zheng, James T. Kwok
Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data. CoRR (2018)
Shuai Zheng, James Tin-Yau Kwok
Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data. ICML (2018)
Shuai Zheng, James T. Kwok
Follow the Moving Leader in Deep Learning. ICML (2017)
Shuai Zheng, James T. Kwok
Fast-and-Light Stochastic ADMM. IJCAI (2016)
Ruiliang Zhang, Shuai Zheng, James T. Kwok
Asynchronous Distributed Semi-Stochastic Gradient Optimization. AAAI (2016)
Shuai Zheng, Ruiliang Zhang, James Tin-Yau Kwok
Fast Nonsmooth Regularized Risk Minimization with Continuation. CoRR (2016)
Shuai Zheng, Ruiliang Zhang, James T. Kwok
Fast Nonsmooth Regularized Risk Minimization with Continuation. AAAI (2016)
Shuai Zheng, James T. Kwok
Fast-and-Light Stochastic ADMM. CoRR (2016)
Ruiliang Zhang, Shuai Zheng, James T. Kwok
Fast Distributed Asynchronous SGD with Variance Reduction. CoRR (2015)
Shuai Zheng, James T. Kwok
Accurate Integration of Aerosol Predictions by Smoothing on a Manifold. AAAI (2014)
Shuai Zheng, Luis Herranz, Shuqiang Jiang
Flexible navigation in smartphones and tablets using scalable storyboards. ICMR (2013)