Shengen Yan

Publication Activity (10 Years)

Years Active: 2012-2024
Publications (10 Years): 36

Top Topics

Heterogeneous Distributed

Simulation Platform

Diffusion Models

Convolutional Neural Networks

Top Venues

IEEE Trans. Parallel Distributed Syst.

Publications

Enshu Liu, Junyi Zhu, Zinan Lin, Xuefei Ning, Matthew B. Blaschko, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang
Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs. CoRR (2024)
Tianyu Fu, Haofeng Huang, Xuefei Ning, Genghan Zhang, Boju Chen, Tianqi Wu, Hongyi Wang, Zixiao Huang, Shiyao Li, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang
MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression. CoRR (2024)
Si Xu, Zixiao Huang, Yan Zeng, Shengen Yan, Xuefei Ning, Haolin Ye, Sipei Gu, Chunsheng Shui, Zhezheng Lin, Hao Zhang, Sheng Wang, Guohao Dai, Yu Wang
HetHub: A Heterogeneous distributed hybrid training system for large-scale models. CoRR (2024)
Tianchen Zhao, Xuefei Ning, Tongcheng Fang, Enshu Liu, Guyue Huang, Zinan Lin, Shengen Yan, Guohao Dai, Yu Wang
MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization. CoRR (2024)
Tianchen Zhao, Tongcheng Fang, Enshu Liu, Rui Wan, Widyadewi Soedarmadji, Shiyao Li, Zinan Lin, Guohao Dai, Shengen Yan, Huazhong Yang, Xuefei Ning, Yu Wang
ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation. CoRR (2024)
Zhihang Yuan, Pu Lu, Hanling Zhang, Xuefei Ning, Linfeng Zhang, Tianchen Zhao, Shengen Yan, Guohao Dai, Yu Wang
DiTFastAttn: Attention Compression for Diffusion Transformer Models. CoRR (2024)
Enshu Liu, Junyi Zhu, Zinan Lin, Xuefei Ning, Matthew B. Blaschko, Sergey Yekhanin, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang
Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better. CoRR (2024)
Tao Yuan, Xuefei Ning, Dong Zhou, Zhijie Yang, Shiyao Li, Minghui Zhuang, Zheyue Tan, Zhuyu Yao, Dahua Lin, Boxun Li, Guohao Dai, Shengen Yan, Yu Wang
LV-Eval: A Balanced Long-Context Benchmark with 5 Length Levels Up to 256K. CoRR (2024)
Shiyao Li, Xuefei Ning, Luning Wang, Tengxuan Liu, Xiangsheng Shi, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang
Evaluating Quantized Large Language Models. CoRR (2024)
Zixuan Zhou, Xuefei Ning, Ke Hong, Tianyu Fu, Jiaming Xu, Shiyao Li, Yuming Lou, Luning Wang, Zhihang Yuan, Xiuhong Li, Shengen Yan, Guohao Dai, Xiao-Ping Zhang, Yuhan Dong, Yu Wang
A Survey on Efficient Inference for Large Language Models. CoRR (2024)
Jiangfei Duan, Xiuhong Li, Ping Xu, Xingcheng Zhang, Shengen Yan, Yun Liang, Dahua Lin
Proteus: Simulating the Performance of Distributed DNN Training. CoRR (2023)
Size Zheng, Siyuan Chen, Peidi Song, Renze Chen, Xiuhong Li, Shengen Yan, Dahua Lin, Jingwen Leng, Yun Liang
Chimera: An Analytical Optimizing Framework for Effective Compute-intensive Operators Fusion. HPCA (2023)
Peng Sun, Yonggang Wen, Ruobing Han, Wansen Feng, Shengen Yan
GradientFlow: Optimizing Network Performance for Large-Scale Distributed DNN Training. IEEE Trans. Big Data 8 (2) (2022)
Ruofan Liang, Bingsheng He, Shengen Yan, Peng Sun
A Simulation Platform for Multi-tenant Machine Learning Services on Thousands of GPUs. CoRR (2022)
Size Zheng, Renze Chen, Yicheng Jin, Anjiang Wei, Bingyang Wu, Xiuhong Li, Shengen Yan, Yun Liang
NeoFlow: A Flexible Framework for Enabling Efficient Compilation for High Performance DNN Training. IEEE Trans. Parallel Distributed Syst. 33 (11) (2022)
Lijuan Jiang, Ping Xu, Qianchao Zhu, Xiuhong Li, Shengen Yan, Xingcheng Zhang, Dahua Lin, Wenjing Ma, Zhouyang Li, Jun Liu, Jinming Ma, Minxi Jin, Chao Yang
EasyView: Enabling and Scheduling Tensor Views in Deep Learning Compilers. ICPP (2022)
Xiuhong Li, Shengen Yan, Lijuan Jiang, Ping Xu, Jinming Ma, Xingcheng Zhang, Dahua Lin
LongTail-Bench: A Benchmark Suite for Domain-Specific Operators in Deep Learning. IISWC (2022)
Zhisheng Ye, Peng Sun, Wei Gao, Tianwei Zhang, Xiaolin Wang, Shengen Yan, Yingwei Luo
Astraea: A Fair Deep Learning Scheduler for Multi-Tenant GPU Clusters. IEEE Trans. Parallel Distributed Syst. 33 (11) (2022)
Size Zheng, Renze Chen, Anjiang Wei, Yicheng Jin, Qin Han, Liqiang Lu, Bingyang Wu, Xiuhong Li, Shengen Yan, Yun Liang
AMOS: enabling automatic mapping for tensor computations on spatial accelerators with hardware abstraction. ISCA (2022)
Lipeng Wang, Qiong Luo, Shengen Yan
DIESEL+: Accelerating Distributed Deep Learning Tasks on Image Datasets. IEEE Trans. Parallel Distributed Syst. 33 (5) (2022)
Qinghao Hu, Peng Sun, Shengen Yan, Yonggang Wen, Tianwei Zhang
Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenters. CoRR (2021)
Qinghao Hu, Peng Sun, Shengen Yan, Yonggang Wen, Tianwei Zhang
Characterization and prediction of deep learning workloads in large-scale GPU datacenters. SC (2021)
Lipeng Wang, Qiong Luo, Shengen Yan
Accelerating Deep Learning Tasks with Optimized GPU-assisted Image Decoding. ICPADS (2020)
Lei Xie, Jidong Zhai, Baodong Wu, Yuanbo Wang, Xingcheng Zhang, Peng Sun, Shengen Yan
Elan: Towards Generic and Efficient Elastic Training for Deep Learning. ICDCS (2020)
Yun Liang, Liqiang Lu, Qingcheng Xiao, Shengen Yan
Evaluating Fast Algorithms for Convolutional Neural Networks on FPGAs. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 39 (4) (2020)
Lipeng Wang, Songgao Ye, Baichen Yang, Youyou Lu, Hequan Zhang, Shengen Yan, Qiong Luo
DIESEL: A Dataset-Based Distributed Storage and Caching System for Large-Scale Deep Learning Training. ICPP (2020)
Liancheng Jia, Yun Liang, Xiuhong Li, Liqiang Lu, Shengen Yan
Enabling Efficient Fast Convolution Algorithms on GPUs via MegaKernels. IEEE Trans. Computers 69 (7) (2020)
Peng Sun, Wansen Feng, Ruobing Han, Shengen Yan, Yonggang Wen
Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes. CoRR (2019)
Yiran Zhang, Long Chen, Xiangzhe An, Shengen Yan
面向GPU计算平台的归约算法的性能优化研究 (Study on Performance Optimization of Reduction Algorithm Targeting GPU Computing Platform). 计算机科学 46 (2) (2019)
Xiuhong Li, Yun Liang, Shengen Yan, Liancheng Jia, Yinghan Li
A coordinated tiling and batching framework for efficient GEMM on GPUs. PPoPP (2019)
Liqiang Lu, Yun Liang, Qingcheng Xiao, Shengen Yan
Evaluating Fast Algorithms for Convolutional Neural Networks on FPGAs. FCCM (2017)
Peng Sun, Yonggang Wen, Ta Nguyen Binh Duong, Shengen Yan
Towards Distributed Machine Learning in Shared Clusters: A Dynamically-Partitioned Approach. CoRR (2017)
Qingcheng Xiao, Yun Liang, Liqiang Lu, Shengen Yan, Yu-Wing Tai
Exploring Heterogeneous Algorithms for Accelerating Deep Convolutional Neural Networks on FPGAs. DAC (2017)
Peng Sun, Yonggang Wen, Ta Nguyen Binh Duong, Shengen Yan
Towards Distributed Machine Learning in Shared Clusters: A Dynamically-Partitioned Approach. SMARTCOMP (2017)
Peng Sun, Yonggang Wen, Ta Nguyen Binh Duong, Shengen Yan
Timed Dataflow: Reducing Communication Overhead for Distributed Machine Learning Systems. ICPADS (2016)
Yunquan Zhang, Shigang Li, Shengen Yan, Huiyang Zhou
A Cross-Platform SpMV Framework on Many-Core Architectures. ACM Trans. Archit. Code Optim. 13 (4) (2016)
Chao Li, Yi Yang, Hongwen Dai, Shengen Yan, Frank Mueller, Huiyang Zhou
Understanding the tradeoffs between software-managed vs. hardware-managed caches in GPUs. ISPASS (2014)
Shengen Yan, Chao Li, Yunquan Zhang, Huiyang Zhou
yaSpMV: yet another SpMV framework on GPUs. PPOPP (2014)
Qingqing Dang, Shengen Yan, Ren Wu
A fast integral image generation algorithm on GPUs. ICPADS (2014)
Shengen Yan, Guoping Long, Yunquan Zhang
StreamScan: fast scan algorithms for GPUs without global barrier synchronization. PPOPP (2013)
Weiyan Wang, Yunquan Zhang, Guoping Long, Shengen Yan, Haipeng Jia
CLSIFT: An Optimization Study of the Scale Invariance Feature Transform on GPUs. HPCC/EUC (2013)
Haipeng Jia, Yunquan Zhang, Guoping Long, Shengen Yan
An Insightful Program Performance Tuning Chain for GPU Computing. ICA3PP (1) (2012)
Haipeng Jia, Yunquan Zhang, Guoping Long, Jianliang Xu, Shengen Yan, Yan Li
GPURoofline: A Model for Guiding Performance Optimizations on GPUs. Euro-Par (2012)