Haibin Lin

Publication Activity (10 Years)

Years Active: 2013-2024
Publications (10 Years): 35

Top Topics

Database Management

Training Examples

Top Venues

EMNLP/IJCNLP (2)

Publications

Hanpeng Hu, Junwei Su, Juntao Zhao, Yanghua Peng, Yibo Zhu, Haibin Lin, Chuan Wu
CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programs. EuroSys (2024)
Li-Wen Chang, Wenlei Bao, Qi Hou, Chengquan Jiang, Ningxin Zheng, Yinmin Zhong, Xuanrun Zhang, Zuquan Song, Ziheng Jiang, Haibin Lin, Xin Jin, Xin Liu
FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion. CoRR (2024)
Ziheng Jiang, Haibin Lin, Yinmin Zhong, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu
MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs. NSDI (2024)
Juntao Zhao, Borui Wan, Yanghua Peng, Haibin Lin, Yibo Zhu, Chuan Wu
QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices. IPDPS (2024)
Ziheng Jiang, Haibin Lin, Yinmin Zhong, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu
MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs. CoRR (2024)
Borui Wan, Mingji Han, Yiyao Sheng, Zhichao Lai, Mofan Zhang, Junda Zhang, Yanghua Peng, Haibin Lin, Xin Liu, Chuan Wu
ByteCheckpoint: A Unified Checkpointing System for LLM Development. CoRR (2024)
Juntao Zhao, Borui Wan, Yanghua Peng, Haibin Lin, Chuan Wu
LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization. CoRR (2024)
Yite Wang, Jiahao Su, Hanlin Lu, Cong Xie, Tianyi Liu, Jianbo Yuan, Haibin Lin, Ruoyu Sun, Hongxia Yang
LEMON: Lossless model expansion. ICLR (2024)
Juntao Zhao, Borui Wan, Chuan Wu, Yanghua Peng, Haibin Lin
POSTER: LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization. PPoPP (2024)
Juntao Zhao, Borui Wan, Yanghua Peng, Haibin Lin, Yibo Zhu, Chuan Wu
QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices. CoRR (2024)
Hanpeng Hu, Junwei Su, Juntao Zhao, Yanghua Peng, Yibo Zhu, Haibin Lin, Chuan Wu
CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programs. CoRR (2023)
Zhuang Wang, Haibin Lin, Yibo Zhu, T. S. Eugene Ng
Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies. EuroSys (2023)
Yite Wang, Jiahao Su, Hanlin Lu, Cong Xie, Tianyi Liu, Jianbo Yuan, Haibin Lin, Ruoyu Sun, Hongxia Yang
LEMON: Lossless model expansion. CoRR (2023)
Zhuang Wang, Haibin Lin, Yibo Zhu, T. S. Eugene Ng
Espresso: Revisiting Gradient Compression from the System Perspective. CoRR (2022)
Hang Zhang, Chongruo Wu, Zhongyue Zhang, Yi Zhu, Haibin Lin, Zhi Zhang, Yue Sun, Tong He, Jonas Mueller, R. Manmatha, Mu Li, Alexander J. Smola
ResNeSt: Split-Attention Networks. CVPR Workshops (2022)
Yangrui Chen, Cong Xie, Meng Ma, Juncheng Gu, Yanghua Peng, Haibin Lin, Chuan Wu, Yibo Zhu
SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training. NeurIPS (2022)
Hanpeng Hu, Chenyu Jiang, Yuchen Zhong, Yanghua Peng, Chuan Wu, Yibo Zhu, Haibin Lin, Chuanxiong Guo
dPRO: A Generic Performance Diagnosis and Optimization Toolkit for Expediting Distributed DNN Training. MLSys (2022)
Hanpeng Hu, Chenyu Jiang, Yuchen Zhong, Yanghua Peng, Chuan Wu, Yibo Zhu, Haibin Lin, Chuanxiong Guo
dPRO: A Generic Profiling and Optimization System for Expediting Distributed DNN Training. CoRR (2022)
Yuchen Zhong, Cong Xie, Shuai Zheng, Haibin Lin
Compressed Communication for Distributed Training: Adaptive Methods and System. CoRR (2021)
Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng, Yi Zhu
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. J. Mach. Learn. Res. 21 (2020)
Hang Zhang, Chongruo Wu, Zhongyue Zhang, Yi Zhu, Zhi Zhang, Haibin Lin, Yue Sun, Tong He, Jonas Mueller, R. Manmatha, Mu Li, Alexander J. Smola
ResNeSt: Split-Attention Networks. CoRR (2020)
Shuai Zheng, Haibin Lin, Sheng Zha, Mu Li
Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes. CoRR (2020)
Zhen Zhang, Chaokun Chang, Haibin Lin, Yida Wang, Raman Arora, Xin Jin
Is Network the Bottleneck of Distributed Training? CoRR (2020)
Zhen Zhang, Chaokun Chang, Haibin Lin, Yida Wang, Raman Arora, Xin Jin
Is Network the Bottleneck of Distributed Training? NetAI@SIGCOMM (2020)
Yifei Ma, Balakrishnan (Murali) Narayanaswamy, Haibin Lin, Hao Ding
Temporal-Contextual Recommendation in Real-Time. KDD (2020)
Cong Xie, Shuai Zheng, Oluwasanmi Koyejo, Indranil Gupta, Mu Li, Haibin Lin
CSER: Communication-efficient SGD with Error Reset. CoRR (2020)
Cong Xie, Shuai Zheng, Oluwasanmi Koyejo, Indranil Gupta, Mu Li, Haibin Lin
CSER: Communication-efficient SGD with Error Reset. NeurIPS (2020)
Minjie Wang, Lingfan Yu, Da Zheng, Quan Gan, Yu Gai, Zihao Ye, Mufei Li, Jinjing Zhou, Qi Huang, Chao Ma, Ziyue Huang, Qipeng Guo, Hao Zhang, Haibin Lin, Junbo Zhao, Jinyang Li, Alexander J. Smola, Zheng Zhang
Deep Graph Library: Towards Efficient and Scalable Deep Learning on Graphs. CoRR (2019)
Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. CoRR (2019)
Haibin Lin, Hang Zhang, Yifei Ma, Tong He, Zhi Zhang, Sheng Zha, Mu Li
Dynamic Mini-batch SGD for Elastic Distributed Training: Learning in the Limbo of Resources. CoRR (2019)
Sheng Zha, Ziheng Jiang, Haibin Lin, Zhi Zhang
Just-in-Time Dynamic-Batching. CoRR (2019)
Dawei Du, Yue Zhang, Zexin Wang, Zhikang Wang, Zichen Song, Ziming Liu, Liefeng Bo, Hailin Shi, Rui Zhu, Aashish Kumar, Aijin Li, Almaz Zinollayev, Anuar Askergaliyev, Arne Schumann, Binjie Mao, Pengfei Zhu, Byeongwon Lee, Chang Liu, Changrui Chen, Chunhong Pan, Chunlei Huo, Da Yu, Dechun Cong, Dening Zeng, Dheeraj Reddy Pailla, Di Li, Longyin Wen, Dong Wang, Donghyeon Cho, Dongyu Zhang, Furui Bai, George Jose, Guangyu Gao, Guizhong Liu, Haitao Xiong, Hao Qi, Haoran Wang, Xiao Bian, Heqian Qiu, Hongliang Li, Huchuan Lu, Ildoo Kim, Jaekyum Kim, Jane Shen, Jihoon Lee, Jing Ge, Jingjing Xu, Jingkai Zhou, Haibin Lin, Jonas Meier, Jun Won Choi, Junhao Hu, Junyi Zhang, Junying Huang, Kaiqi Huang, Keyang Wang, Lars Sommer, Lei Jin, Lei Zhang, Qinghua Hu, Lianghua Huang, Lin Sun, Lucas Steinmann, Meixia Jia, Nuo Xu, Pengyi Zhang, Qiang Chen, Qingxuan Lv, Qiong Liu, Qishang Cheng, Tao Peng, Sai Saketh Chennamsetty, Shuhao Chen, Shuo Wei, Srinivas S. S. Kruthiventi, Sungeun Hong, Sungil Kang, Tong Wu, Tuo Feng, Varghese Alex Kollerathu, Wanqi Li, Jiayu Zheng, Wei Dai, Weida Qin, Weiyang Wang, Xiaorui Wang, Xiaoyu Chen, Xin Chen, Xin Sun, Xin Zhang, Xin Zhao, Xindi Zhang, Xinyao Wang, Xinyu Zhang, Xuankun Chen, Xudong Wei, Xuzhang Zhang, Yanchao Li, Yifu Chen, Yu Heng Toh, Yu Zhang, Yu Zhu, Yunxin Zhong
VisDrone-DET2019: The Vision Meets Drone Object Detection in Image Challenge Results. ICCV Workshops (2019)
Cong Xie, Oluwasanmi Koyejo, Indranil Gupta, Haibin Lin
Local AdaAlter: Communication-Efficient Stochastic Gradient Descent with Adaptive Learning Rates. CoRR (2019)
Haibin Lin, Xingjian Shi, Leonard Lausen, Aston Zhang, He He, Sheng Zha, Alexander J. Smola
Dive into Deep Learning for Natural Language Processing. EMNLP/IJCNLP (2) (2019)
Andrew Pavlo, Gustavo Angulo, Joy Arulraj, Haibin Lin, Jiexi Lin, Lin Ma, Prashanth Menon, Todd C. Mowry, Matthew Perron, Ian Quah, Siddharth Santurkar, Anthony Tomasic, Skye Toor, Dana Van Aken, Ziqi Wang, Yingjun Wu, Ran Xian, Tieying Zhang
Self-Driving Database Management Systems. CIDR (2017)
Yongwei Miao, Haibin Lin
3D reconstruction of complex geometric solids from 2D line drawings. SIGGRAPH ASIA Posters (2013)
Yongwei Miao, Haibin Lin
Salience-based feature preserving resizing for 3D models. SIGGRAPH ASIA Posters (2013)
Yongwei Miao, Haibin Lin
Visual Saliency Guided Global and Local Resizing for 3D Models. CAD/Graphics (2013)