Shangchun Zhao

Publication Activity (10 Years)

Years Active: 2023-2024
Publications (10 Years): 5

Top Topics

Parallel Processing

Training Process

Recommender Systems

Top Venues

Publications

Diandian Gu, Peng Sun, Qinghao Hu, Ting Huang, Xun Chen, Yingtong Xiong, Guoteng Wang, Qiaoling Chen, Shangchun Zhao, Jiarui Fang, Yonggang Wen, Tianwei Zhang, Xin Jin, Xuanzhe Liu
LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism. CoRR (2024)
Youshao Xiao, Shangchun Zhao, Zhenglei Zhou, Zhaoxin Huan, Lin Ju, Xiaolu Zhang, Lin Wang, Jun Zhou
G-Meta: Distributed Meta Learning in GPU Clusters for Large-Scale Recommender Systems. CoRR (2024)
Jiarui Fang, Shangchun Zhao
USP: A Unified Sequence Parallelism Approach for Long Context Generative AI. CoRR (2024)
Youshao Xiao, Shangchun Zhao, Zhenglei Zhou, Zhaoxin Huan, Lin Ju, Xiaolu Zhang, Lin Wang, Jun Zhou
G-Meta: Distributed Meta Learning in GPU Clusters for Large-Scale Recommender Systems. CIKM (2023)
Youshao Xiao, Weichang Wu, Zhenglei Zhou, Fagui Mao, Shangchun Zhao, Lin Ju, Lei Liang, Xiaolu Zhang, Jun Zhou
An Adaptive Placement and Parallelism Framework for Accelerating RLHF Training. CoRR (2023)