Shengwei Li

Publication Activity (10 Years)

Years Active: 2009-2024
Publications (10 Years): 19

Top Topics

Neural Network Training

Keyword Spotting

Training Examples

Improved Accuracy

Top Venues

IEEE Trans. Parallel Distributed Syst.

Publications

Dongsheng Li, Shengwei Li, Zhiquan Lai, Yongquan Fu, Xiangyu Ye, Lei Cai, Linbo Qiao
A Memory-Efficient Hybrid Parallel Framework for Deep Neural Network Training. IEEE Trans. Parallel Distributed Syst. 35 (4) (2024)
Shengwei Li, Kai Lu, Zhiquan Lai, Weijie Liu, Keshi Ge, Dong Sheng Li
A Multidimensional Communication Scheduling Method for Hybrid Parallel DNN Training. IEEE Trans. Parallel Distributed Syst. 35 (8) (2024)
Zhiquan Lai, Shengwei Li, Xudong Tang, Keshi Ge, Weijie Liu, Yabo Duan, Linbo Qiao, Dongsheng Li
Merak: An Efficient Distributed DNN Training Framework With Automated 3D Parallelism for Giant Foundation Models. IEEE Trans. Parallel Distributed Syst. 34 (5) (2023)
Wei Wang, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Yujie Liu, Ao Shen, Dongsheng Li
Prophet: Fine-grained Load Balancing for Parallel Training of Large-scale MoE Models. CLUSTER (2023)
Zhiquan Lai, Yanqi Hao, Shengwei Li, Dongsheng Li
Communication Analysis for Multidimensional Parallel Training of Large-scale DNN Models. HPCC/DSS/SmartCity/DependSys (2023)
Shengwei Li, Huajun Zhang
Keyword Spotting Based on CTC and Similarity Matching for Chinese Speech. ICIS (2023)
Shengwei Li, Zhiquan Lai, Yanqi Hao, Weijie Liu, Keshi Ge, Xiaoge Deng, Dongsheng Li, Kai Lu
Automated Tensor Model Parallelism with Overlapped Communication for Efficient Foundation Model Training. CoRR (2023)
Chunlin Jin, Yong Xue, Tao Yuan, Shengwei Li, Botao He, Liang Zhao
Observing Anthropogenic CO2 Emissions with TanSat in Northeast China. IGARSS (2023)
Tao Yuan, Yong Xue, Liang Zhao, Chunlin Jin, Shengwei Li, Pei Li
Improved Accuracy of XCO2 Retrieval Based on OCO-2 Rtretrieval Framework Model. IGARSS (2023)
Xiaoge Deng, Li Shen, Shengwei Li, Tao Sun, Dongsheng Li, Dacheng Tao
Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent. CoRR (2023)
Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li
Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD. AAAI (2023)
Botao He, Yong Xue, Xi Lu, Chunlin Jin, Shengwei Li, Wenhao Liu, Peng Wang, Xiangkai Wang, Pei Li
Monitoring of Xch4 Changes and Anomaly in Hebei Province, China Based on Tropomi. IGARSS (2023)
Shengwei Li, Zhiquan Lai, Dongsheng Li, Yiming Zhang, Xiangyu Ye, Yabo Duan
EmbRace: Accelerating Sparse Communication for Distributed Training of Deep Neural Networks. ICPP (2022)
Zhiquan Lai, Shengwei Li, Xudong Tang, Keshi Ge, Weijie Liu, Yabo Duan, Linbo Qiao, Dongsheng Li
Merak: An Efficient Distributed DNN Training Framework with Automated 3D Parallelism for Giant Foundation Models. CoRR (2022)
Weijie Liu, Zhiquan Lai, Shengwei Li, Yabo Duan, Keshi Ge, Dongsheng Li
AutoPipe: A Fast Pipeline Parallelism Approach with Balanced Partitioning and Micro-batch Slicing. CLUSTER (2022)
Yabo Duan, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Peng Liang, Dongsheng Li
HPH: Hybrid Parallelism on Heterogeneous Clusters for Accelerating Large-scale DNNs Training. CLUSTER (2022)
Lizhi Zhang, Zhiquan Lai, Shengwei Li, Yu Tang, Feng Liu, Dongsheng Li
2PGraph: Accelerating GNN Training over Large Graphs on GPU Clusters. CLUSTER (2021)
Shengwei Li, Zhiquan Lai, Dongsheng Li, Xiangyu Ye, Yabo Duan
EmbRace: Accelerating Sparse Communication for Distributed Training of NLP Neural Networks. CoRR (2021)
Xiangyu Ye, Zhiquan Lai, Shengwei Li, Lei Cai, Ding Sun, Linbo Qiao, Dongsheng Li
Hippie: A Data-Paralleled Pipeline Approach to Improve Memory-Efficiency and Scalability for Large DNN Training. ICPP (2021)
Shengwei Li, Lingsheng Li, Chong Han
Mining closed frequent itemset based on FP-Tree. GrC (2009)