Wei Lin

Publication Activity (10 Years)

Years Active: 2009-2024
Publications (10 Years): 69

Top Topics

Efficient Inference

Top Venues

Proc. VLDB Endow.

IEEE Trans. Parallel Distributed Syst.

Publications

Jiatong Li, Renjun Hu, Kunzhe Huang, Yan Zhuang, Qi Liu, Mengxiao Zhu, Xing Shi, Wei Lin
PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations. CoRR (2024)
Yi Cheng, Renjun Hu, Haochao Ying, Xing Shi, Jian Wu, Wei Lin
Arithmetic Feature Interaction Is Necessary for Deep Tabular Learning. CoRR (2024)
Biao Sun, Ziming Huang, Hanyu Zhao, Wencong Xiao, Xinyi Zhang, Yong Li, Wei Lin
Llumnix: Dynamic Scheduling for Large Language Model Serving. OSDI (2024)
Shiwei Zhang, Lansong Diao, Chuan Wu, Zongyan Cao, Siyu Wang, Wei Lin
HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. CoRR (2024)
Yi Cheng, Renjun Hu, Haochao Ying, Xing Shi, Jian Wu, Wei Lin
Arithmetic Feature Interaction Is Necessary for Deep Tabular Learning. AAAI (2024)
Jiandong Mu, Mengdi Wang, Feiwen Zhu, Jun Yang, Wei Lin, Wei Zhang
Boosting the Convergence of Reinforcement Learning-Based Auto-Pruning Using Historical Data. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 43 (2) (2024)
Biao Sun, Ziming Huang, Hanyu Zhao, Wencong Xiao, Xinyi Zhang, Yong Li, Wei Lin
Llumnix: Dynamic Scheduling for Large Language Model Serving. CoRR (2024)
Bin Lin, Tao Peng, Chen Zhang, Minmin Sun, Lanbo Li, Hanyu Zhao, Wencong Xiao, Qi Xu, Xiafei Qiu, Shen Li, Zhigang Ji, Yong Li, Wei Lin
Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache. CoRR (2024)
Xiufeng Shu, Ruidong Han, Xiang Li, Wei Lin
Adaptive Utilization of Cross-scenario Information for Multi-scenario Recommendation. CoRR (2024)
Donglin Zhuang, Zhen Zheng, Haojun Xia, Xiafei Qiu, Junjie Bai, Wei Lin, Shuaiwen Leon Song
MonoNN: Enabling a New Monolithic Optimization Space for Neural Network Inference Tasks on Modern GPU-Centric Architectures. OSDI (2024)
Shiwei Zhang, Lansong Diao, Chuan Wu, Zongyan Cao, Siyu Wang, Wei Lin
HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. EuroSys (2024)
Shiwei Zhang, Xiaodong Yi, Lansong Diao, Chuan Wu, Siyu Wang, Wei Lin
Expediting Distributed DNN Training With Device Topology-Aware Graph Deployment. IEEE Trans. Parallel Distributed Syst. 34 (4) (2023)
Hanyu Zhao, Zhi Yang, Yu Cheng, Chao Tian, Shiru Ren, Wencong Xiao, Man Yuan, Langshi Chen, Kaibo Liu, Yang Zhang, Yong Li, Wei Lin
GoldMiner: Elastic Scaling of Training Data Pre-Processing Pipelines for Deep Learning. Proc. ACM Manag. Data 1 (2) (2023)
Zhen Zheng, Zaifeng Pan, Dalin Wang, Kai Zhu, Wenyi Zhao, Tianyou Guo, Xiafei Qiu, Minmin Sun, Junjie Bai, Feng Zhang, Xiaoyong Du, Jidong Zhai, Wei Lin
BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach. Proc. ACM Manag. Data 1 (3) (2023)
Haojun Xia, Zhen Zheng, Yuchao Li, Donglin Zhuang, Zhongzhu Zhou, Xiafei Qiu, Yong Li, Wei Lin, Shuaiwen Leon Song
Flash-LLM: Enabling Low-Cost and Highly-Efficient Large Generative Model Inference With Unstructured Sparsity. Proc. VLDB Endow. 17 (2) (2023)
Ziji Shi, Le Jiang, Ang Wang, Jie Zhang, Xianyan Jia, Yong Li, Chencan Wu, Jialin Li, Wei Lin
TAP: Accelerating Large-Scale DNN Training Through Tensor Automatic Parallelisation. CoRR (2023)
Zaifeng Pan, Zhen Zheng, Feng Zhang, Ruofan Wu, Hao Liang, Dalin Wang, Xiafei Qiu, Junjie Bai, Wei Lin, Xiaoyong Du
RECom: A Compiler Approach to Accelerating Recommendation Model Inference with Massive Embedding Columns. ASPLOS (4) (2023)
Shiwei Zhang, Xiaodong Yi, Lansong Diao, Chuan Wu, Siyu Wang, Wei Lin
Expediting Distributed DNN Training with Device Topology-Aware Graph Deployment. CoRR (2023)
Siyu Wang, Zongyan Cao, Chang Si, Lansong Diao, Jiamang Wang, Wei Lin
Ada-Grouper: Accelerating Pipeline Parallelism in Preempted Network by Adaptive Group-Scheduling for Micro-Batches. CoRR (2023)
Shiwei Zhang, Lansong Diao, Siyu Wang, Zongyan Cao, Yiliang Gu, Chang Si, Ziji Shi, Zhen Zheng, Chuan Wu, Wei Lin
Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform. CoRR (2023)
Shiwei Zhang, Lansong Diao, Chuan Wu, Siyu Wang, Wei Lin
Accelerating large-scale distributed neural network training with SPMD parallelism. SoCC (2022)
Xiaodong Yi, Shiwei Zhang, Lansong Diao, Chuan Wu, Zhen Zheng, Shiqing Fan, Siyu Wang, Jun Yang, Wei Lin
Optimizing DNN Compilation for Distributed Training With Joint OP and Tensor Fusion. IEEE Trans. Parallel Distributed Syst. 33 (12) (2022)
Xianyan Jia, Le Jiang, Ang Wang, Wencong Xiao, Ziji Shi, Jie Zhang, Xinyuan Li, Langshi Chen, Yong Li, Zhen Zheng, Xiaoyong Liu, Wei Lin
Whale: Efficient Giant Model Training over Heterogeneous GPUs. USENIX Annual Technical Conference (2022)
Ziyue Luo, Xiaodong Yi, Guoping Long, Shiqing Fan, Chuan Wu, Jun Yang, Wei Lin
Efficient Pipeline Planning for Expedited Distributed DNN Training. CoRR (2022)
Xiaodong Yi, Shiwei Zhang, Lansong Diao, Chuan Wu, Zhen Zheng, Shiqing Fan, Siyu Wang, Jun Yang, Wei Lin
Optimizing DNN Compilation for Distributed Training with Joint OP and Tensor Fusion. CoRR (2022)
Chengyu Wang, Minghui Qiu, Taolin Zhang, Tingting Liu, Lei Li, Jianing Wang, Ming Wang, Jun Huang, Wei Lin
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing. EMNLP (Demos) (2022)
Zhen Zheng, Xuanda Yang, Pengzhan Zhao, Guoping Long, Kai Zhu, Feiwen Zhu, Wenyi Zhao, Xiaoyong Liu, Jun Yang, Jidong Zhai, Shuaiwen Leon Song, Wei Lin
AStitch: enabling a new multi-dimensional optimization space for memory-intensive ML training and inference on modern SIMT architectures. ASPLOS (2022)
Ziyue Luo, Xiaodong Yi, Guoping Long, Shiqing Fan, Chuan Wu, Jun Yang, Wei Lin
Efficient Pipeline Planning for Expedited Distributed DNN Training. INFOCOM (2022)
Chengyu Wang, Minghui Qiu, Taolin Zhang, Tingting Liu, Lei Li, Jianing Wang, Ming Wang, Jun Huang, Wei Lin
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing. CoRR (2022)
Yuexiang Xie, Zhen Wang, Yaliang Li, Bolin Ding, Nezihe Merve Gürel, Ce Zhang, Minlie Huang, Wei Lin, Jingren Zhou
FIVES: Feature Interaction Via Edge Search for Large-Scale Tabular Data. KDD (2021)
Jiandong Mu, Mengdi Wang, Feiwen Zhu, Jun Yang, Wei Lin, Wei Zhang
Boosting the Convergence of Reinforcement Learning-based Auto-pruning Using Historical Data. CoRR (2021)
Junyang Lin, Rui Men, An Yang, Chang Zhou, Ming Ding, Yichang Zhang, Peng Wang, Ang Wang, Le Jiang, Xianyan Jia, Jie Zhang, Jianwei Zhang, Xu Zou, Zhikang Li, Xiaodong Deng, Jie Liu, Jinbao Xue, Huiling Zhou, Jianxin Ma, Jin Yu, Yong Li, Wei Lin, Jingren Zhou, Jie Tang, Hongxia Yang
M6: A Chinese Multimodal Pretrainer. CoRR (2021)
Minghui Qiu, Peng Li, Chengyu Wang, Haojie Pan, Ang Wang, Cen Chen, Xianyan Jia, Yaliang Li, Jun Huang, Deng Cai, Wei Lin
EasyTransfer: A Simple and Scalable Deep Transfer Learning Platform for NLP Applications. CIKM (2021)
Shiqing Fan, Yi Rong, Chen Meng, Zongyan Cao, Siyu Wang, Zhen Zheng, Chuan Wu, Guoping Long, Jun Yang, Lixue Xia, Lansong Diao, Xiaoyong Liu, Wei Lin
DAPPLE: a pipelined data parallel approach for training large models. PPoPP (2021)
An Yang, Junyang Lin, Rui Men, Chang Zhou, Le Jiang, Xianyan Jia, Ang Wang, Jie Zhang, Jiamang Wang, Yong Li, Di Zhang, Wei Lin, Lin Qu, Jingren Zhou, Hongxia Yang
Exploring Sparse Expert Models and Beyond. CoRR (2021)
Kai Zhu, Wenyi Zhao, Zhen Zheng, Tianyou Guo, Pengzhan Zhao, Junjie Bai, Jun Yang, Xiaoyong Liu, Lansong Diao, Wei Lin
DISC: A Dynamic Shape Compiler for Machine Learning Workloads. CoRR (2021)
Kai Zhu, Wenyi Zhao, Zhen Zheng, Tianyou Guo, Pengzhan Zhao, Junjie Bai, Jun Yang, Xiaoyong Liu, Lansong Diao, Wei Lin
DISC: A Dynamic Shape Compiler for Machine Learning Workloads. EuroMLSys@EuroSys (2021)
Yingda Chen, Jiamang Wang, Yifeng Lu, Ying Han, Zhiqiang Lv, Xuebin Min, Hua Cai, Wei Zhang, Haochuan Fan, Chao Li, Tao Guan, Wei Lin, Yangqing Jia, Jingren Zhou
Fangorn: Adaptive Execution Framework for Heterogeneous Workloads on Shared Clusters. Proc. VLDB Endow. 14 (12) (2021)
Qiangpeng Yang, Jun Huang, Wei Lin
SwapText: Image Based Texts Transfer in Scenes. CVPR (2020)
Mengli Cheng, Minghui Qiu, Xing Shi, Jun Huang, Wei Lin
One-shot Text Field Labeling using Attention and Belief Propagation for Structure Information Extraction. CoRR (2020)
Zhen Zheng, Pengzhan Zhao, Guoping Long, Feiwen Zhu, Kai Zhu, Wenyi Zhao, Lansong Diao, Jun Yang, Wei Lin
FusionStitching: Boosting Memory Intensive Computations for Deep Learning Workloads. CoRR (2020)
Minghui Qiu, Peng Li, Hanjie Pan, Chengyu Wang, Ang Wang, Cen Chen, Yaliang Li, Dehong Gao, Jun Huang, Yong Li, Jun Yang, Deng Cai, Wei Lin
EasyTransfer - A Simple and Scalable Deep Transfer Learning Platform for NLP Applications. CoRR (2020)
Qiangpeng Yang, Hongsheng Jin, Jun Huang, Wei Lin
SwapText: Image Based Texts Transfer in Scenes. CoRR (2020)
Mengli Cheng, Minghui Qiu, Xing Shi, Jun Huang, Wei Lin
One-shot Text Field labeling using Attention and Belief Propagation for Structure Information Extraction. ACM Multimedia (2020)
Daoyuan Chen, Yaliang Li, Minghui Qiu, Zhen Wang, Bofang Li, Bolin Ding, Hongbo Deng, Jun Huang, Wei Lin, Jingren Zhou
AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search. IJCAI (2020)
Xiaodong Yi, Ziyue Luo, Chen Meng, Mengdi Wang, Guoping Long, Chuan Wu, Jun Yang, Wei Lin
Fast Training of Deep Learning Models over Multiple GPUs. Middleware (2020)
Wencong Xiao, Shiru Ren, Yong Li, Yang Zhang, Pengyang Hou, Zhi Li, Yihui Feng, Wei Lin, Yangqing Jia
AntMan: Dynamic Scaling on GPU Clusters for Deep Learning. OSDI (2020)
Yuexiang Xie, Zhen Wang, Yaliang Li, Bolin Ding, Nezihe Merve Gürel, Ce Zhang, Minlie Huang, Wei Lin, Jingren Zhou
Interactive Feature Generation via Learning Adjacency Tensor of Feature Graph. CoRR (2020)
Yiwu Yao, Yuchao Li, Chengyu Wang, Tianhang Yu, Houjiang Chen, Xiaotang Jiang, Jun Yang, Jun Huang, Wei Lin, Hui Shu, Chengfei Lv
INT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices. CoRR (2020)
Jiandong Mu, Mengdi Wang, Lanbo Li, Jun Yang, Wei Lin, Wei Zhang
A History-Based Auto-Tuning Framework for Fast and High-Performance DNN Design on GPU. DAC (2020)
Daoyuan Chen, Yaliang Li, Minghui Qiu, Zhen Wang, Bofang Li, Bolin Ding, Hongbo Deng, Jun Huang, Wei Lin, Jingren Zhou
AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search. CoRR (2020)
Ang Wang, Xianyan Jia, Le Jiang, Jie Zhang, Yong Li, Wei Lin
Whale: A Unified Distributed Training Framework. CoRR (2020)
Siyu Wang, Yi Rong, Shiqing Fan, Zhen Zheng, Lansong Diao, Guoping Long, Jun Yang, Xiaoyong Liu, Wei Lin
Auto-MAP: A DQN Framework for Exploring Distributed Execution Plans for DNN Workloads. CoRR (2020)
Xiaodong Yi, Shiwei Zhang, Ziyue Luo, Guoping Long, Lansong Diao, Chuan Wu, Zhen Zheng, Jun Yang, Wei Lin
Optimizing distributed training deployment in heterogeneous GPU clusters. CoNEXT (2020)
Shiqing Fan, Yi Rong, Chen Meng, Zongyan Cao, Siyu Wang, Zhen Zheng, Chuan Wu, Guoping Long, Jun Yang, Lixue Xia, Lansong Diao, Xiaoyong Liu, Wei Lin
DAPPLE: A Pipelined Data Parallel Approach for Training Large Models. CoRR (2020)
Mengdi Wang, Chen Meng, Guoping Long, Chuan Wu, Jun Yang, Wei Lin, Yangqing Jia
Characterizing Deep Learning Training Workloads on Alibaba-PAI. CoRR (2019)
Rong Zhu, Kun Zhao, Hongxia Yang, Wei Lin, Chang Zhou, Baole Ai, Yong Li, Jingren Zhou
AliGraph: A Comprehensive Graph Neural Network Platform. CoRR (2019)
Qiangpeng Yang, Hongsheng Jin, Mengli Cheng, Wenmeng Zhou, Jun Huang, Wei Lin
Scene Text Recognition with Auto-Aligned Feature Generator. ICDM (2019)
Guoping Long, Jun Yang, Wei Lin
FusionStitching: Boosting Execution Efficiency of Memory Intensive Computations for DL Workloads. CoRR (2019)
Rong Zhu, Kun Zhao, Hongxia Yang, Wei Lin, Chang Zhou, Baole Ai, Yong Li, Jingren Zhou
AliGraph: A Comprehensive Graph Neural Network Platform. Proc. VLDB Endow. 12 (12) (2019)
Mengdi Wang, Chen Meng, Guoping Long, Chuan Wu, Jun Yang, Wei Lin, Yangqing Jia
Characterizing Deep Learning Training Workloads on Alibaba-PAI. IISWC (2019)
Qing Zhang, Mengru Zhang, Mengdi Wang, Wanchen Sui, Chen Meng, Jun Yang, Weidan Kong, Xiaoyuan Cui, Wei Lin
Efficient Deep Learning Inference Based on Model Compression. CVPR Workshops (2018)
Guoping Long, Jun Yang, Kai Zhu, Wei Lin
FusionStitching: Deep Fusion and Code Generation for Tensorflow Computations on GPUs. CoRR (2018)
Mengdi Wang, Qing Zhang, Jun Yang, Xiaoyuan Cui, Wei Lin
Graph-Adaptive Pruning for Efficient Inference of Convolutional Neural Networks. CoRR (2018)
Minghui Qiu, Liu Yang, Feng Ji, Wei Zhou, Jun Huang, Haiqing Chen, W. Bruce Croft, Wei Lin
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce. ACL (2) (2018)
Minghui Qiu, Liu Yang, Feng Ji, Weipeng Zhao, Wei Zhou, Jun Huang, Haiqing Chen, W. Bruce Croft, Wei Lin
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce. CoRR (2018)
Qiangpeng Yang, Mengli Cheng, Wenmeng Zhou, Yan Chen, Minghui Qiu, Wei Lin
IncepText: A New Inception-Text Module with Deformable PSROI Pooling for Multi-Oriented Scene Text Detection. IJCAI (2018)
Qiangpeng Yang, Mengli Cheng, Wenmeng Zhou, Yan Chen, Minghui Qiu, Wei Lin, Wei Chu
IncepText: A New Inception-Text Module with Deformable PSROI Pooling for Multi-Oriented Scene Text Detection. CoRR (2018)
Wei Lin, Haochuan Fan, Zhengping Qian, Junwei Xu, Sen Yang, Jingren Zhou, Lidong Zhou
StreamScope: Continuous Reliable Distributed Processing of Big Data Streams. NSDI (2016)
Xuepeng Fan, Zhenyu Guo, Hai Jin, Xiaofei Liao, Jiaxing Zhang, Hucheng Zhou, Sean McDirmid, Wei Lin, Jingren Zhou, Lidong Zhou
Spotting Code Optimizations in Data-Parallel Pipelines through PeriSCOPE. IEEE Trans. Parallel Distributed Syst. 26 (6) (2015)
Eric Boutin, Jaliya Ekanayake, Wei Lin, Bing Shi, Jingren Zhou, Zhengping Qian, Ming Wu, Lidong Zhou
Apollo: Scalable and Coordinated Scheduling for Cloud-Scale Computing. OSDI (2014)
Tian Xiao, Jiaxing Zhang, Hucheng Zhou, Zhenyu Guo, Sean McDirmid, Wei Lin, Wenguang Chen, Lidong Zhou
Nondeterminism in MapReduce considered harmful? an empirical study on non-commutative aggregators in MapReduce programs. ICSE Companion (2014)
Tian Xiao, Zhenyu Guo, Hucheng Zhou, Jiaxing Zhang, Xu Zhao, Chencheng Ye, Xi Wang, Wei Lin, Wenguang Chen, Lidong Zhou
Cybertron: pushing the limit on I/O reduction in data-parallel programs. OOPSLA (2014)
Sihan Li, Hucheng Zhou, Haoxiang Lin, Tian Xiao, Haibo Lin, Wei Lin, Tao Xie
A characteristic study on failures of production distributed data-parallel programs. ICSE (2013)
Jingren Zhou, Nicolas Bruno, Wei Lin
Advanced partitioning techniques for massively distributed computation. SIGMOD Conference (2012)
Zhenyu Guo, Xuepeng Fan, Rishan Chen, Jiaxing Zhang, Hucheng Zhou, Sean McDirmid, Chang Liu, Wei Lin, Jingren Zhou, Lidong Zhou
Spotting Code Optimizations in Data-Parallel Pipelines through PeriSCOPE. OSDI (2012)
Jiaxing Zhang, Hucheng Zhou, Rishan Chen, Xuepeng Fan, Zhenyu Guo, Haoxiang Lin, Jack Y. Li, Wei Lin, Jingren Zhou, Lidong Zhou
Optimizing Data Shuffling in Data-Parallel Computation by Understanding User-Defined Functions. NSDI (2012)
Bingsheng He, Mao Yang, Zhenyu Guo, Rishan Chen, Bing Su, Wei Lin, Lidong Zhou
Comet: batched stream processing for data intensive distributed computing. SoCC (2010)
Bingsheng He, Mao Yang, Zhenyu Guo, Rishan Chen, Wei Lin, Bing Su, Hongyi Wang, Lidong Zhou
Wave Computing in the Cloud. HotOS (2009)