Zhuohan Li

Publication Activity (10 Years)

Years Active: 2011-2024
Publications (10 Years): 34

Top Topics

Distributed Systems

Document Ranking

Top Venues

Int. J. Comput. Appl. Technol.

Publications

Bowen Deng, Yunyeong Choi, Peichen Zhong, Janosh Riebesell, Shashwat Anand, Zhuohan Li, KyuJung Jun, Kristin A. Persson, Gerbrand Ceder
Overcoming systematic softening in universal machine learning interatomic potentials by fine-tuning. CoRR (2024)
Ying Sheng, Shiyi Cao, Dacheng Li, Banghua Zhu, Zhuohan Li, Danyang Zhuo, Joseph E. Gonzalez, Ion Stoica
Fairness in Serving Large Language Models. CoRR (2024)
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark W. Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang
High-throughput Generative Inference of Large Language Models with a Single GPU. CoRR (2023)
Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving. OSDI (2023)
Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving. CoRR (2023)
Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph Gonzalez, Hao Zhang, Ion Stoica
Efficient Memory Management for Large Language Model Serving with PagedAttention. SOSP (2023)
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Tianle Li, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zhuohan Li, Zi Lin, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset. CoRR (2023)
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU. ICML (2023)
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
Judging LLM-as-a-judge with MT-Bench and Chatbot Arena. CoRR (2023)
Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, Ion Stoica
Efficient Memory Management for Large Language Model Serving with PagedAttention. CoRR (2023)
Xiaoxuan Liu, Siddharth Jha, Chuyan Zhu, Zhuohan Li, Alvin Cheung
What is the State of Memory Saving for Model Training? CoRR (2023)
Lianmin Zheng, Zhuohan Li, Hao Zhang, Yonghao Zhuang, Zhifeng Chen, Yanping Huang, Yida Wang, Yuanzhong Xu, Danyang Zhuo, Joseph E. Gonzalez, Ion Stoica
Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning. CoRR (2022)
Yonghao Zhuang, Hexu Zhao, Lianmin Zheng, Zhuohan Li, Eric P. Xing, Qirong Ho, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
On Optimizing the Communication of Model Parallelism. CoRR (2022)
Lianmin Zheng, Zhuohan Li, Hao Zhang, Yonghao Zhuang, Zhifeng Chen, Yanping Huang, Yida Wang, Yuanzhong Xu, Danyang Zhuo, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica
Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning. OSDI (2022)
Hao Zhang, Zhuohan Li, Lianmin Zheng, Ion Stoica
Simple and Automatic Distributed Machine Learning on Ray. KDD (2021)
Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica
TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models. CoRR (2021)
Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica
TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models. ICML (2021)
Danyang Zhuo, Kaiyuan Zhang, Zhuohan Li, Siyuan Zhuang, Stephanie Wang, Ang Chen, Ion Stoica
Rearchitecting In-Memory Object Stores for Low Latency. Proc. VLDB Endow. 15 (3) (2021)
Siyuan Zhuang, Zhuohan Li, Danyang Zhuo, Stephanie Wang, Eric Liang, Robert Nishihara, Philipp Moritz, Ion Stoica
Hoplite: efficient and fault-tolerant collective communication for task-based distributed systems. SIGCOMM (2021)
Siyuan Zhuang, Zhuohan Li, Danyang Zhuo, Stephanie Wang, Eric Liang, Robert Nishihara, Philipp Moritz, Ion Stoica
Hoplite: Efficient Collective Communication for Task-Based Distributed Systems. CoRR (2020)
Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, Kurt Keutzer, Dan Klein, Joey Gonzalez
Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers. ICML (2020)
Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, Kurt Keutzer, Dan Klein, Joseph E. Gonzalez
Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers. CoRR (2020)
Zhiqing Sun, Zhuohan Li, Haoqing Wang, Di He, Zi Lin, Zhi-Hong Deng
Fast Structured Decoding for Sequence Models. NeurIPS (2019)
Zhuohan Li, Zi Lin, Di He, Fei Tian, Tao Qin, Liwei Wang, Tie-Yan Liu
Hint-Based Training for Non-Autoregressive Machine Translation. EMNLP/IJCNLP (1) (2019)
Zhuohan Li, Zi Lin, Di He, Fei Tian, Tao Qin, Liwei Wang, Tie-Yan Liu
Hint-Based Training for Non-Autoregressive Machine Translation. CoRR (2019)
Linyuan Gong, Di He, Zhuohan Li, Tao Qin, Liwei Wang, Tie-Yan Liu
Efficient Training of BERT by Progressively Stacking. ICML (2019)
Zhiqing Sun, Zhuohan Li, Haoqing Wang, Zi Lin, Di He, Zhi-Hong Deng
Fast Structured Decoding for Sequence Models. CoRR (2019)
Yiping Lu, Zhuohan Li, Di He, Zhiqing Sun, Bin Dong, Tao Qin, Liwei Wang, Tie-Yan Liu
Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View. CoRR (2019)
Yi An, Xiaoli Zhou, Zhuohan Li, Cheng Shao
Earth pressure prediction in the chamber for earth pressure balanced shield machines. Int. J. Comput. Appl. Technol. 57 (4) (2018)
Zhuohan Li, Di He, Fei Tian, Wei Chen, Tao Qin, Liwei Wang, Tie-Yan Liu
Towards Binary-Valued Gates for Robust LSTM Training. ICML (2018)
Zhuohan Li, Di He, Fei Tian, Wei Chen, Tao Qin, Liwei Wang, Tie-Yan Liu
Towards Binary-Valued Gates for Robust LSTM Training. CoRR (2018)
Zhenxin Fu, Lei Yang, Wenbin Hou, Zhuohan Li, Yifan Wu, Yihua Cheng, Xiaolin Wang, Yun Liang
Student Cluster Competition 2017, Team Peking University: Reproducing vectorization of the Tersoff multi-body potential on the Intel Broadwell architecture. Parallel Comput. 78 (2018)
Lei Yang, Yilong Li, Zhenxin Fu, Zhuohan Li, Wenbin Hou, Haoze Wu, Xiaolin Wang, Yun Liang
ParConnect reproducibility report. Parallel Comput. 70 (2017)
Yi An, Peng Zhao, Zhuohan Li, Cheng Shao
Self-adaptive polygon mesh reconstruction based on ball-pivoting algorithm. Int. J. Comput. Appl. Technol. 54 (1) (2016)
Zhuohan Li, C. He, T. Song, Cheng Shao, Yi An
A novel information exchange method for industrial heterogeneous fieldbuses. Int. J. Comput. Appl. Technol. 48 (4) (2013)
Zhuohan Li, Cheng Shao, Yi An, Chengge Sun, Youwen Lin, Xiaofang Wang
Three-phase high voltage power supply design for electrostatic precipitator based on phase sequence self-adaption and redundant spark detection. iCAST (2011)
Yi An, Cheng Shao, Xiaoliang Wang, Zhuohan Li
Geometric properties estimation from discrete curves using discrete derivatives. Comput. Graph. 35 (4) (2011)