Shenggui Li

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 15

Top Topics

Top Venues

IEEE Trans. Parallel Distributed Syst.

Publications

Cunxiao Du, Jing Jiang, Yuanchen Xu, Jiawei Wu, Sicheng Yu, Yongqi Li, Shenggui Li, Kai Xu, Liqiang Nie, Zhaopeng Tu, Yang You
GliDe with a CaPE: A Low-Hassle Method to Accelerate Speculative Decoding. CoRR (2024)
Yuliang Liu, Shenggui Li, Jiarui Fang, Yanjun Shao, Boyuan Yao, Yang You
Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models. CoRR (2023)
Jiarui Fang, Zilin Zhu, Shenggui Li, Hui Su, Yang Yu, Jie Zhou, Yang You
Parallel Training of Pre-Trained Models via Chunk-Based Dynamic Memory Management. IEEE Trans. Parallel Distributed Syst. 34 (1) (2023)
Shenggui Li, Fuzhao Xue, Chaitanya Baranwal, Yongbin Li, Yang You
Sequence Parallelism: Long Sequence Training from System Perspective. ACL (1) (2023)
Shenggui Li, Hongxin Liu, Zhengda Bian, Jiarui Fang, Haichen Huang, Yuliang Liu, Boxiang Wang, Yang You
Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training. ICPP (2023)
Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You
EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models. CoRR (2022)
Shenggui Li, Bu-Sung Lee
Critique of "MemXCT: Memory-Centric X-Ray CT Reconstruction With Massive Parallelization" by SCC Team From Nanyang Technological University. IEEE Trans. Parallel Distributed Syst. 33 (9) (2022)
Jiarui Fang, Geng Zhang, Jiatong Han, Shenggui Li, Zhengda Bian, Yongbin Li, Jin Liu, Yang You
A Frequency-aware Software Cache for Large Recommendation System Embeddings. CoRR (2022)
Haichen Huang, Jiarui Fang, Hongxin Liu, Shenggui Li, Yang You
Elixir: Train a Large Language Model on a Small GPU Cluster. CoRR (2022)
Jie Zhu, Shenggui Li, Yang You
Sky Computing: Accelerating Geo-distributed Computing in Federated Learning. CoRR (2022)
Jiarui Fang, Yang Yu, Shenggui Li, Yang You, Jie Zhou
PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management. CoRR (2021)
Qifan Xu, Shenggui Li, Chaoyu Gong, Yang You
An Efficient 2D Method for Training Super-Large Deep Learning Models. CoRR (2021)
Shenggui Li, Fuzhao Xue, Yongbin Li, Yang You
Sequence Parallelism: Making 4D Parallelism Possible. CoRR (2021)
Zhengda Bian, Shenggui Li, Wei Wang, Yang You
Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters. CoRR (2021)
Zhengda Bian, Shenggui Li, Wei Wang, Yang You
Online evolutionary batch size orchestration for scheduling deep learning workloads in GPU clusters. SC (2021)