Pinxue Zhao

Publication Activity (10 Years)

Years Active: 2022-2024
Publications (10 Years): 2

Top Topics

Training Process

Distributed Data

Top Venues

Publications

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui
Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs. CoRR (2024)
Xiaonan Nie, Pinxue Zhao, Xupeng Miao, Tong Zhao, Bin Cui
HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System. CoRR (2022)