Weilin Zhao

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 27

Top Topics

Highly Specialized

Top Venues

Publications

Ning Ding, Yulin Chen, Ganqu Cui, Xingtai Lv, Weilin Zhao, Ruobing Xie, Bowen Zhou, Zhiyuan Liu, Maosong Sun
Mastering Text, Code and Math Simultaneously via Fusing Highly Specialized Language Models. CoRR (2024)
Sun Ao, Weilin Zhao, Xu Han, Cheng Yang, Zhiyuan Liu, Chuan Shi, Maosong Sun, Shengnan Wang, Teng Su
BurstAttention: An Efficient Distributed Attention Framework for Extremely Long Sequences. CoRR (2024)
Weilin Zhao, Yuxiang Huang, Xu Han, Chaojun Xiao, Zhiyuan Liu, Maosong Sun
Ouroboros: Speculative Decoding with Large Model Enhanced Drafting. CoRR (2024)
Jiaxin Zhang, Wei Wang, Haifeng Ye, Runyu Huang, Chen Liu, Weilin Zhao, Yanli Shi
Ultra-Broadband Ultraviolet-Visible Light-Short Wavelength Infrared InGaAs Focal Plane Arrays via n-InP Contact Layer Removal. Sensors 24 (5) (2024)
Shengding Hu, Yuge Tu, Xu Han, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, Xinrong Zhang, Zhen Leng Thai, Kai Zhang, Chongyi Wang, Yuan Yao, Chenyang Zhao, Jie Zhou, Jie Cai, Zhongwu Zhai, Ning Ding, Chao Jia, Guoyang Zeng, Dahai Li, Zhiyuan Liu, Maosong Sun
MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies. CoRR (2024)
Xinrong Zhang, Yingfa Chen, Shengding Hu, Xu Han, Zihang Xu, Yuanwei Xu, Weilin Zhao, Maosong Sun, Zhiyuan Liu
Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Models. CoRR (2024)
Ao Sun, Weilin Zhao, Xu Han, Cheng Yang, Zhiyuan Liu, Chuan Shi, Maosong Sun
Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training. CoRR (2024)
Shengding Hu, Xin Liu, Xu Han, Xinrong Zhang, Chaoqun He, Weilin Zhao, Yankai Lin, Ning Ding, Zebin Ou, Guoyang Zeng, Zhiyuan Liu, Maosong Sun
Predicting Emergent Abilities with Infinite Resolution Evaluation. ICLR (2024)
Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, Yi Ren Fung, Yusheng Su, Huadong Wang, Cheng Qian, Runchu Tian, Kunlun Zhu, Shihao Liang, Xingyu Shen, Bokai Xu, Zhen Zhang, Yining Ye, Bowen Li, Ziwei Tang, Jing Yi, Yuzhang Zhu, Zhenning Dai, Lan Yan, Xin Cong, Yaxi Lu, Weilin Zhao, Yuxiang Huang, Junxi Yan, Xu Han, Xian Sun, Dahai Li, Jason Phang, Cheng Yang, Tongshuang Wu, Heng Ji, Zhiyuan Liu, Maosong Sun
Tool Learning with Foundation Models. CoRR (2023)
Weilin Zhao, Yuxiang Huang, Xu Han, Zhiyuan Liu, Zhengyan Zhang, Maosong Sun
CPET: Effective Parameter-Efficient Tuning for Compressed Large Language Models. CoRR (2023)
Yuzhong Wang, Xu Han, Weilin Zhao, Guoyang Zeng, Zhiyuan Liu, Maosong Sun
H3T: Efficient Integration of Memory Optimization and Parallelism for Large-scale Transformer Training. NeurIPS (2023)
Shengding Hu, Ning Ding, Weilin Zhao, Xingtai Lv, Zhen Zhang, Zhiyuan Liu, Maosong Sun
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models. ACL (demo) (2023)
Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li, Maosong Sun
Parameter-efficient fine-tuning of large-scale pre-trained language models. Nat. Mac. Intell. 5 (3) (2023)
Shengding Hu, Ning Ding, Weilin Zhao, Xingtai Lv, Zhen Zhang, Zhiyuan Liu, Maosong Sun
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models. CoRR (2023)
Shengding Hu, Xin Liu, Xu Han, Xinrong Zhang, Chaoqun He, Weilin Zhao, Yankai Lin, Ning Ding, Zebin Ou, Guoyang Zeng, Zhiyuan Liu, Maosong Sun
Unlock Predictable Scaling from Emergent Abilities. CoRR (2023)
Zhengyan Zhang, Baitao Gong, Yingfa Chen, Xu Han, Guoyang Zeng, Weilin Zhao, Yanxu Chen, Zhiyuan Liu, Maosong Sun
BMCook: A Task-agnostic Compression Toolkit for Big Models. EMNLP (Demos) (2022)
Ning Ding, Shengding Hu, Weilin Zhao, Yulin Chen, Zhiyuan Liu, Haitao Zheng, Maosong Sun
OpenPrompt: An Open-source Framework for Prompt-learning. ACL (demo) (2022)
Xu Han, Weilin Zhao, Ning Ding, Zhiyuan Liu, Maosong Sun
PTR: Prompt Tuning with Rules for Text Classification. AI Open 3 (2022)
Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li, Maosong Sun
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models. CoRR (2022)
Biru Zhu, Yujia Qin, Ganqu Cui, Yangyi Chen, Weilin Zhao, Chong Fu, Yangdong Deng, Zhiyuan Liu, Jingang Wang, Wei Wu, Maosong Sun, Ming Gu
Moderate-fitting as a Natural Backdoor Defender for Pre-trained Language Models. NeurIPS (2022)
Xu Han, Guoyang Zeng, Weilin Zhao, Zhiyuan Liu, Zhengyan Zhang, Jie Zhou, Jun Zhang, Jia Chao, Maosong Sun
BMInf: An Efficient Toolkit for Big Model Inference and Tuning. ACL (demo) (2022)
Xu Han, Weilin Zhao, Ning Ding, Zhiyuan Liu, Maosong Sun
PTR: Prompt Tuning with Rules for Text Classification. CoRR (2021)
Ning Ding, Shengding Hu, Weilin Zhao, Yulin Chen, Zhiyuan Liu, Hai-Tao Zheng, Maosong Sun
OpenPrompt: An Open-source Framework for Prompt-learning. CoRR (2021)
Weidang Lu, Weilin Zhao, Hong Peng, Su Hu, Yuan Gao
Energy Efficiency Optimization in OFDM based Two-Way DF Relaying Networks with Energy Harvesting. IWCMC (2019)
Weilin Zhao, Weidang Lu, Yu Zhang, Bo Li, Xin Liu, Zhenyu Na
Half-Duplex Two-Way AF Relaying Network with Energy Harvesting. WISATS (1) (2019)
Weidang Lu, Weilin Zhao, Su Hu, Xin Liu, Bo Li, Yi Gong
OFDM Based SWIPT for Two-Way AF Relaying Network. IEEE Access 6 (2018)
Weilin Zhao, Weidang Lu, Hong Peng, Zhijiang Xu, Jingyu Hua
OFDM Based SWIPT in a Two-Way Relaying Network. MLICOM (2018)
Weilin Zhao
Service innovation development through china's new urbanization: An economic policy perspective. IEEM (2015)