Zhenheng Tang

Publication Activity (10 Years)

Years Active: 2019-2024
Publications (10 Years): 30

Top Topics

Unsupervised Learning

Disease Diagnosis

Intrinsic Dimension

Top Venues

Publications

Peijie Dong, Lujun Li, Zhenheng Tang, Xiang Liu, Xinglin Pan, Qiang Wang, Xiaowen Chu
Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models. CoRR (2024)
Zhenheng Tang, Yonggang Zhang, Shaohuai Shi, Xinmei Tian, Tongliang Liu, Bo Han, Xiaowen Chu
FedImpro: Measuring and Improving Client Update in Federated Learning. CoRR (2024)
Yuxin Wang, Yuhan Chen, Zeyu Li, Zhenheng Tang, Rui Guo, Xin Wang, Qiang Wang, Amelie Chi Zhou, Xiaowen Chu
Towards Efficient and Reliable LLM Serving: A Real-World Workload Study. CoRR (2024)
Zichen Tang, Junlin Huang, Rudan Yan, Yuxin Wang, Zhenheng Tang, Shaohuai Shi, Amelie Chi Zhou, Xiaowen Chu
Bandwidth-Aware and Overlap-Weighted Compression for Communication-Efficient Federated Learning. ICPP (2024)
Yujin Tang, Peijie Dong, Zhenheng Tang, Xiaowen Chu, Junwei Liang
VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting. CoRR (2024)
Zhenheng Tang, Yonggang Zhang, Shaohuai Shi, Xinmei Tian, Tongliang Liu, Bo Han, Xiaowen Chu
FedImpro: Measuring and Improving Client Update in Federated Learning. ICLR (2024)
Zhenheng Tang, Shaohuai Shi, Bo Li, Xiaowen Chu
GossipFL: A Decentralized Federated Learning Framework With Sparsified and Adaptive Communication. IEEE Trans. Parallel Distributed Syst. 34 (3) (2023)
Yuxin Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Xinglin Pan, Yang Zheng, Xiaoyu Wu, Amelie Chi Zhou, Bingsheng He, Xiaowen Chu
Reliable and Efficient In-Memory Fault Tolerance of Large Language Model Pretraining. CoRR (2023)
Zhenheng Tang, Yuxin Wang, Xin He, Longteng Zhang, Xinglin Pan, Qiang Wang, Rongfei Zeng, Kaiyong Zhao, Shaohuai Shi, Bingsheng He, Xiaowen Chu
FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs. CoRR (2023)
Xin He, Jiangchao Yao, Yuxin Wang, Zhenheng Tang, Ka Chun Cheung, Simon See, Bo Han, Xiaowen Chu
NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension. AAAI (2023)
Zhenheng Tang, Xiaowen Chu, Ryan Yide Ran, Sunwoo Lee, Shaohuai Shi, Yonggang Zhang, Yuxin Wang, Alex Qiaozhong Liang, Salman Avestimehr, Chaoyang He
FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training. CoRR (2023)
Zhenheng Tang, Yonggang Zhang, Shaohuai Shi, Xin He, Bo Han, Xiaowen Chu
Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learning. CoRR (2022)
Xin He, Jiangchao Yao, Yuxin Wang, Zhenheng Tang, Ka Chun Cheung, Simon See, Bo Han, Xiaowen Chu
NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension. CoRR (2022)
Zhenheng Tang, Yonggang Zhang, Shaohuai Shi, Xin He, Bo Han, Xiaowen Chu
Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learning. ICML (2022)
Chaoyang He, Alay Dilipbhai Shah, Zhenheng Tang, Di Fan, Adarshan Naiynar Sivashunmugam, Keerti Bhogaraju, Mita Shimpi, Li Shen, Xiaowen Chu, Mahdi Soltanolkotabi, Salman Avestimehr
FedCV: A Federated Learning Framework for Diverse Computer Vision Tasks. CoRR (2021)
Shaohuai Shi, Zhenheng Tang, Xiaowen Chu, Chengjian Liu, Wei Wang, Bo Li
A Quantitative Survey of Communication Optimizations in Distributed Deep Learning. IEEE Netw. 35 (3) (2021)
Shaohuai Shi, Zhenheng Tang, Qiang Wang, Kaiyong Zhao, Xiaowen Chu
Layer-Wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees. ECAI (2020)
Zhenheng Tang, Shaohuai Shi, Xiaowen Chu, Wei Wang, Bo Li
Communication-Efficient Distributed Deep Learning: A Comprehensive Survey. CoRR (2020)
Zhenheng Tang, Shaohuai Shi, Xiaowen Chu
Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection. CoRR (2020)
Shaohuai Shi, Zhenheng Tang, Xiaowen Chu, Chengjian Liu, Wei Wang, Bo Li
Communication-Efficient Distributed Deep Learning: Survey, Evaluation, and Challenges. CoRR (2020)
Yuxin Wang, Qiang Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Kaiyong Zhao, Xiaowen Chu
Benchmarking the Performance and Energy Efficiency of AI Accelerators for AI Training. CCGRID (2020)
Zhenheng Tang, Shaohuai Shi, Xiaowen Chu
Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection. ICDCS (2020)
Shaohuai Shi, Qiang Wang, Kaiyong Zhao, Zhenheng Tang, Yuxin Wang, Xiang Huang, Xiaowen Chu
A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks. ICDCS (2019)
Xin He, Xiaoming Liu, Zhili Wu, Wu Yu, Xiaowen Chu, Shihao Wang, Shaohuai Shi, Zhenheng Tang, Yuxin Wang, Zhihao Zhao, Jing Dai, Ronghao Ni, Xiaofeng Zhang
Computer-Aided Clinical Skin Disease Diagnosis Using CNN and Object Detection Models. IEEE BigData (2019)
Shaohuai Shi, Zhenheng Tang, Qiang Wang, Kaiyong Zhao, Xiaowen Chu
Layer-wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees. CoRR (2019)
Zhenheng Tang, Yuxin Wang, Qiang Wang, Xiaowen Chu
The Impact of GPU DVFS on the Energy and Performance of Deep Learning: an Empirical Study. CoRR (2019)
Xin He, Shihao Wang, Shaohuai Shi, Zhenheng Tang, Yuxin Wang, Zhihao Zhao, Jing Dai, Ronghao Ni, Xiaofeng Zhang, Xiaoming Liu, Zhili Wu, Wu Yu, Xiaowen Chu
Computer-Aided Clinical Skin Disease Diagnosis Using CNN and Object Detection Models. CoRR (2019)
Zhenheng Tang, Yuxin Wang, Qiang Wang, Xiaowen Chu
The Impact of GPU DVFS on the Energy and Performance of Deep Learning: an Empirical Study. e-Energy (2019)
Shaohuai Shi, Kaiyong Zhao, Qiang Wang, Zhenheng Tang, Xiaowen Chu
A Convergence Analysis of Distributed SGD with Communication-Efficient Gradient Sparsification. IJCAI (2019)
Shaohuai Shi, Qiang Wang, Kaiyong Zhao, Zhenheng Tang, Yuxin Wang, Xiang Huang, Xiaowen Chu
A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks. CoRR (2019)