Lingxiao Ma

Publication Activity (10 Years)

Years Active: 2005-2024
Publications (10 Years): 28

Top Topics

Extended Abstract

Matrix Multiplication

Top Venues

USENIX Annual Technical Conference

Proc. ACM Manag. Data

Publications

Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, Furu Wei
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. CoRR (2024)
Jianyu Wei, Shijie Cao, Ting Cao, Lingxiao Ma, Lei Wang, Yanyong Zhang, Mao Yang
T-MAC: CPU Renaissance via Table Lookup for Low-Bit LLM Deployment on Edge. CoRR (2024)
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation. OSDI (2024)
Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores. PPoPP (2024)
Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo
Optimizing Dynamic Neural Networks with Brainstorm. OSDI (2023)
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
BitNet: Scaling 1-bit Transformers for Large Language Models. CoRR (2023)
Xiaonan Nie, Xupeng Miao, Zilong Wang, Zichao Yang, Jilong Xue, Lingxiao Ma, Gang Cao, Bin Cui
FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement. CoRR (2023)
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation. SOSP (2023)
Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
Efficient GPU Kernels for N: M-Sparse Weights in Deep Learning. MLSys (2023)
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Yuqing Yang, Lingxiao Ma, Fan Yang, Lili Qiu, Mao Yang, Lidong Zhou
SparDA: Accelerating Dynamic Sparse Deep Neural Networks via Sparse-Dense Transformation. CoRR (2023)
Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
Welder: Scheduling Deep Learning Memory Access via Tile-graph. OSDI (2023)
Xiaonan Nie, Xupeng Miao, Zilong Wang, Zichao Yang, Jilong Xue, Lingxiao Ma, Gang Cao, Bin Cui
FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement. Proc. ACM Manag. Data 1 (1) (2023)
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning. OSDI (2023)
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute. OSDI (2022)
Hongyu Zhu, Ruofan Wu, Yijia Diao, Shanbin Ke, Haoyu Li, Chen Zhang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon, Gennady Pekhimenko
ROLLER: Fast and Efficient Tensor Compilation for Deep Learning. OSDI (2022)
Xupeng Miao, Lingxiao Ma, Zhi Yang, Yingxia Shao, Bin Cui, Lele Yu, Jiawei Jiang
CuWide: Towards Efficient Flow-Based Training for Sparse Wide Models on GPUs. IEEE Trans. Knowl. Data Eng. 34 (9) (2022)
Xupeng Miao, Xiaonan Nie, Yingxia Shao, Zhi Yang, Jiawei Jiang, Lingxiao Ma, Bin Cui
Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce. SIGMOD Conference (2021)
Xiaonan Nie, Shijie Cao, Xupeng Miao, Lingxiao Ma, Jilong Xue, Youshan Miao, Zichao Yang, Zhi Yang, Bin Cui
Dense-to-Sparse Gate for Mixture-of-Experts. CoRR (2021)
Xupeng Miao, Lingxiao Ma, Zhi Yang, Yingxia Shao, Bin Cui, Lele Yu, Jiawei Jiang
CuWide: Towards Efficient Flow-based Training for Sparse Wide Models on GPUs (Extended Abstract). ICDE (2021)
Taehyun Kim, Changho Hwang, KyoungSoo Park, Zhiqi Lin, Peng Cheng, Youshan Miao, Lingxiao Ma, Yongqiang Xiong
Accelerating GNN training with locality-aware partial execution. APSys (2021)
Chao Tian, Lingxiao Ma, Zhi Yang, Yafei Dai
PCGCN: Partition-Centric Processing for Accelerating Graph Convolutional Network. IPDPS (2020)
Zhihui Zhang, Jingwen Leng, Lingxiao Ma, Youshan Miao, Chao Li, Minyi Guo
Architectural Implications of Graph Neural Networks. CoRR (2020)
Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks. OSDI (2020)
Zhihui Zhang, Jingwen Leng, Lingxiao Ma, Youshan Miao, Chao Li, Minyi Guo
Architectural Implications of Graph Neural Networks. IEEE Comput. Archit. Lett. 19 (1) (2020)
Shijie Cao, Lingxiao Ma, Wencong Xiao, Chen Zhang, Yunxin Liu, Lintao Zhang, Lanshun Nie, Zhi Yang
SeerNet: Predicting Convolutional Neural Network Feature-Map Sparsity Through Low-Bit Quantization. CVPR (2019)
Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
NeuGraph: Parallel Deep Neural Network Computation on Large Graphs. USENIX Annual Technical Conference (2019)
Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
Towards Efficient Large-Scale Graph Neural Network Computing. CoRR (2018)
Lingxiao Ma, Zhi Yang, Han Chen, Jilong Xue, Yafei Dai
Garaph: Efficient GPU-accelerated Graph Processing on a Single Machine with Balanced Replication. USENIX Annual Technical Conference (2017)
Jianwei Yin, Weipeng Yao, Lingxiao Ma, Jinxiang Dong
CoopStreaming: A Novel Peer-to-Peer System for Fast Live Media Streaming. WAIM (2005)