Xiaonan Nie

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 21

Top Topics

Semantically Heterogeneous

High Scalability

Motion Field Estimation

Top Venues

Proc. VLDB Endow.

SIGMOD Conference

Proc. ACM Manag. Data

Publications

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui
Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs. CoRR (2024)
Hailin Zhang, Xiaodong Ji, Yilin Chen, Fangcheng Fu, Xupeng Miao, Xiaonan Nie, Weipeng Chen, Bin Cui
PQCache: Product Quantization-based KVCache for Long Context LLM Inference. CoRR (2024)
Bin Xiao, Chunan Shi, Xiaonan Nie, Fan Yang, Xiangwei Deng, Lei Su, Weipeng Chen, Bin Cui
Clover: Regressive Lightweight Speculative Decoding with Sequential Knowledge. CoRR (2024)
Xiaonan Nie, Yi Liu, Fangcheng Fu, Jinbao Xue, Dian Jiao, Xupeng Miao, Yangyu Tao, Bin Cui
Angel-PTM: A Scalable and Economical Large-scale Pre-training System in Tencent. CoRR (2023)
Xiaonan Nie, Xupeng Miao, Zilong Wang, Zichao Yang, Jilong Xue, Lingxiao Ma, Gang Cao, Bin Cui
FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement. CoRR (2023)
Xiaonan Nie, Yi Liu, Fangcheng Fu, Jinbao Xue, Dian Jiao, Xupeng Miao, Yangyu Tao, Bin Cui
Angel-PTM: A Scalable and Economical Large-scale Pre-training System in Tencent. Proc. VLDB Endow. 16 (12) (2023)
Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Xiaonan Nie, Bin Cui
Improving Automatic Parallel Training via Balanced Memory Workload Optimization. CoRR (2023)
Xiaonan Nie, Xupeng Miao, Zilong Wang, Zichao Yang, Jilong Xue, Lingxiao Ma, Gang Cao, Bin Cui
FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement. Proc. ACM Manag. Data 1 (1) (2023)
Youhe Jiang, Fangcheng Fu, Xupeng Miao, Xiaonan Nie, Bin Cui
OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning. CoRR (2023)
Youhe Jiang, Fangcheng Fu, Xupeng Miao, Xiaonan Nie, Bin Cui
OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning. IJCAI (2023)
Xupeng Miao, Xiaonan Nie, Hailin Zhang, Tong Zhao, Bin Cui
Hetu: a highly efficient automatic parallel distributed deep learning system. Sci. China Inf. Sci. 66 (1) (2023)
Xiaonan Nie, Xupeng Miao, Zhi Yang, Bin Cui
TSPLIT: Fine-grained GPU Memory Management for Efficient DNN Training via Tensor Splitting. ICDE (2022)
Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui
Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism. CoRR (2022)
Youhe Jiang, Xupeng Miao, Xiaonan Nie, Bin Cui
OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning. CoRR (2022)
Xiaonan Nie, Pinxue Zhao, Xupeng Miao, Tong Zhao, Bin Cui
HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System. CoRR (2022)
Xupeng Miao, Yining Shi, Hailin Zhang, Xin Zhang, Xiaonan Nie, Zhi Yang, Bin Cui
HET-GMP: A Graph-based System Approach to Scaling Large Embedding Model Training. SIGMOD Conference (2022)
Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui
Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism. Proc. VLDB Endow. 16 (3) (2022)
Xupeng Miao, Xiaonan Nie, Yingxia Shao, Zhi Yang, Jiawei Jiang, Lingxiao Ma, Bin Cui
Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce. SIGMOD Conference (2021)
Xiaonan Nie, Shijie Cao, Xupeng Miao, Lingxiao Ma, Jilong Xue, Youshan Miao, Zichao Yang, Zhi Yang, Bin Cui
Dense-to-Sparse Gate for Mixture-of-Experts. CoRR (2021)
Xupeng Miao, Hailin Zhang, Yining Shi, Xiaonan Nie, Zhi Yang, Yangyu Tao, Bin Cui
HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework. CoRR (2021)
Xupeng Miao, Hailin Zhang, Yining Shi, Xiaonan Nie, Zhi Yang, Yangyu Tao, Bin Cui
HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework. Proc. VLDB Endow. 15 (2) (2021)