Pengcheng He

ORCID

Publication Activity (10 Years)

Years Active: 2012-2024
Publications (10 Years): 115

Top Venues

Publications

Yixiao Li, Yifan Yu, Chen Liang, Nikos Karampatziakis, Pengcheng He, Weizhu Chen, Tuo Zhao
LoftQ: LoRA-Fine-Tuning-aware Quantization for Large Language Models. ICLR (2024)
Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models. ICLR (2024)
Huangjie Zheng, Zhendong Wang, Jianbo Yuan, Guanghan Ning, Pengcheng He, Quanzeng You, Hongxia Yang, Mingyuan Zhou
Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling. ICLR (2024)
Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan
PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization. LREC/COLING (2024)
Tianwei Zhou, Wenwen Zhang, Ben Niu, Pengcheng He, Guanghui Yue
Parameter Control Framework for Multiobjective Evolutionary Computation Based on Deep Reinforcement Learning. Int. J. Intell. Syst. 2024 (2024)
Shujian Zhang, Korawat Tanwisuth, Chengyue Gong, Pengcheng He, Mingyuan Zhou
Switchable Decision: Dynamic Neural Generation Networks. CoRR (2024)
Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He
Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective. ICLR (2024)
Wen Xiao, Yujia Xie, Giuseppe Carenini, Pengcheng He
Personalized Abstractive Summarization by Tri-agent Generation Pipeline. EACL (Findings) (2024)
Zhendong Wang, Yifan Jiang, Huangjie Zheng, Peihao Wang, Pengcheng He, Zhangyang Wang, Weizhu Chen, Mingyuan Zhou
Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models. CoRR (2023)
Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan
Query Rewriting for Retrieval-Augmented Large Language Models. CoRR (2023)
Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Pengcheng He, Chenguang Zhu, Michael Zeng
LMGQS: A Large-scale Dataset for Query-focused Summarization. EMNLP (Findings) (2023)
Pengcheng He, Baolin Peng, Song Wang, Yang Liu, Ruochen Xu, Hany Hassan, Yu Shi, Chenguang Zhu, Wayne Xiong, Michael Zeng, Jianfeng Gao, Xuedong Huang
Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization. ACL (1) (2023)
Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, Tuo Zhao
Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning. ICLR (2023)
Korawat Tanwisuth, Shujian Zhang, Huangjie Zheng, Pengcheng He, Mingyuan Zhou
POUF: Prompt-oriented unsupervised fine-tuning for large pre-trained models. CoRR (2023)
Korawat Tanwisuth, Shujian Zhang, Huangjie Zheng, Pengcheng He, Mingyuan Zhou
POUF: Prompt-Oriented Unsupervised Fine-tuning for Large Pre-trained Models. ICML (2023)
Zekun Li, Baolin Peng, Pengcheng He, Michel Galley, Jianfeng Gao, Xifeng Yan
Guiding Large Language Models via Directional Stimulus Prompting. CoRR (2023)
Alexander Bukharin, Yixiao Li, Pengcheng He, Weizhu Chen, Tuo Zhao
Deep Reinforcement Learning from Hierarchical Weak Preference Feedback. CoRR (2023)
Zhendong Wang, Yifan Jiang, Yadong Lu, Yelong Shen, Pengcheng He, Weizhu Chen, Zhangyang (Atlas) Wang, Mingyuan Zhou
In-Context Learning Unlocked for Diffusion Models. NeurIPS (2023)
Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation. ICML (2023)
Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen
HyperTuning: Toward Adapting Large Language Models without Back-propagation. ICML (2023)
Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan
PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization. CoRR (2023)
Zhendong Wang, Yifan Jiang, Huangjie Zheng, Peihao Wang, Pengcheng He, Zhangyang Wang, Weizhu Chen, Mingyuan Zhou
Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models. NeurIPS (2023)
Pengcheng He, Yijia Tang, Fan Xu, Qingjiang Shi
Cellular Network Optimization Using Unfolding-Based Graph Neural Networks. SPAWC (2023)
Zhendong Wang, Yifan Jiang, Yadong Lu, Yelong Shen, Pengcheng He, Weizhu Chen, Zhangyang Wang, Mingyuan Zhou
In-Context Learning Unlocked for Diffusion Models. CoRR (2023)
Pengcheng He, Jianfeng Gao, Weizhu Chen
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing. ICLR (2023)
Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He
Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective. CoRR (2023)
Lesly Miculicich, Yujia Xie, Song Wang, Pengcheng He
Summarization with Precise Length Control. CoRR (2023)
Wen Xiao, Yujia Xie, Giuseppe Carenini, Pengcheng He
ChatGPT-steered Editing Instructor for Customization of Abstractive Summarization. CoRR (2023)
Zekun Li, Baolin Peng, Pengcheng He, Michel Galley, Jianfeng Gao, Xifeng Yan
Guiding Large Language Models via Directional Stimulus Prompting. NeurIPS (2023)
Tianwei Zhou, Pengcheng He, Ben Niu, Guanghui Yue, Hong Wang
A novel competitive constrained dual-archive dual-stage evolutionary algorithm for constrained multiobjective optimization. Swarm Evol. Comput. 83 (2023)
Baolin Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback. CoRR (2023)
Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders. ICLR (2023)
Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao
Less is More: Task-aware Layer-wise Distillation for Language Model Compression. ICML (2023)
Huangjie Zheng, Zhendong Wang, Jianbo Yuan, Guanghan Ning, Pengcheng He, Quanzeng You, Hongxia Yang, Mingyuan Zhou
Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling. CoRR (2023)
Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, Tuo Zhao
Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning. CoRR (2023)
Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
Instruction Tuning with GPT-4. CoRR (2023)
Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation. CoRR (2023)
Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models. CoRR (2023)
Yu Li, Baolin Peng, Pengcheng He, Michel Galley, Zhou Yu, Jianfeng Gao
DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization. ACL (1) (2023)
Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan
Query Rewriting in Retrieval-Augmented Large Language Models. EMNLP (2023)
Korawat Tanwisuth, Shujian Zhang, Pengcheng He, Mingyuan Zhou
A Prototype-Oriented Clustering for Domain Shift with Source Privacy. CoRR (2023)
Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models. CoRR (2023)
Sumit Asthana, Sagih Hilleli, Pengcheng He, Aaron Halfaker
Summaries, Highlights, and Action items: Design, implementation and evaluation of an LLM-powered meeting recap system. CoRR (2023)
Zekun Li, Baolin Peng, Pengcheng He, Xifeng Yan
Do you really follow me? Adversarial Instructions for Evaluating the Robustness of Large Language Models. CoRR (2023)
Yujia Xie, Xun Wang, Si-Qing Chen, Wayne Xiong, Pengcheng He
Interactive Editing for Text Summarization. CoRR (2023)
Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
Diffusion-GAN: Training GANs with Diffusion. ICLR (2023)
Zhengbao Jiang, Yi Mao, Pengcheng He, Graham Neubig, Weizhu Chen
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering. NAACL-HLT (2022)
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog. CoRR (2022)
Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs. CoRR (2022)
Shujian Zhang, Chengyue Gong, Xingchao Liu, Pengcheng He, Weizhu Chen, Mingyuan Zhou
ALLSH: Active Learning Guided by Local Sensitivity and Hardness. NAACL-HLT (Findings) (2022)
Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
Diffusion-GAN: Training GANs with Diffusion. CoRR (2022)
Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models. CoRR (2022)
Qingru Zhang, Simiao Zuo, Chen Liang, Alexander Bukharin, Pengcheng He, Weizhu Chen, Tuo Zhao
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance. CoRR (2022)
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention. IJCAI (2022)
Shujian Zhang, Chengyue Gong, Xingchao Liu, Pengcheng He, Weizhu Chen, Mingyuan Zhou
ALLSH: Active Learning Guided by Local Sensitivity and Hardness. CoRR (2022)
Tianwei Zhou, Wenwen Zhang, Pengcheng He, Guanghui Yue
A Learned Multi-objective Bacterial Foraging Optimization Algorithm with Continuous Deep Q-Learning. ML4CS (3) (2022)
Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
Truncated Diffusion Probabilistic Models. CoRR (2022)
Yu Li, Baolin Peng, Pengcheng He, Michel Galley, Zhou Yu, Jianfeng Gao
DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization. CoRR (2022)
Wen Xiao, Lesly Miculicich, Yang Liu, Pengcheng He, Giuseppe Carenini
Attend to the Right Context: A Plug-and-Play Module for Content-Controllable Summarization. CoRR (2022)
Qingru Zhang, Simiao Zuo, Chen Liang, Alexander Bukharin, Pengcheng He, Weizhu Chen, Tuo Zhao
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance. ICML (2022)
Pengcheng He, Siyuan Lu, Xin Guan, Yibin Kang, Qingjiang Shi
A Zeroth-Order Block Coordinate Gradient Descent Method For Cellular Network Optimization. ISWCS (2022)
Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen
MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation. NAACL-HLT (2022)
Chen Liang, Pengcheng He, Yelong Shen, Weizhu Chen, Tuo Zhao
CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing. CoRR (2022)
Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen
MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation. CoRR (2022)
Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen
HyperTuning: Toward Adapting Large Language Models without Back-propagation. CoRR (2022)
Tianwei Zhou, Wenwen Zhang, Junrui Lu, Pengcheng He, Keqin Yao
Reinforced Event-Driven Evolutionary Algorithm Based on Double Deep Q-network. ICSI (1) (2022)
Tianwei Zhou, Pengcheng He, Churong Zhang, Yichen Lai, Huifen Zhong, Xusheng Wu
An Improved Particle Swarm Optimization Algorithm for Irregular Flight Recovery Problem. ICSI (1) (2022)
Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao
Less is More: Task-aware Layer-wise Distillation for Language Model Compression. CoRR (2022)
Xingxing Zhang, Yiran Liu, Xun Wang, Pengcheng He, Yang Yu, Si-Qing Chen, Wayne Xiong, Furu Wei
Momentum Calibration for Text Generation. CoRR (2022)
Chen Liang, Pengcheng He, Yelong Shen, Weizhu Chen, Tuo Zhao
CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing. ACL (1) (2022)
Jin Sun, Jing Liu, Hao Chen, Pengcheng He, Huihong Yuan, Ze Yan
Experiences and Lessons Learned From DR Resources Participating in the US and UK Capacity Markets: Mechanisms, Status, Dilemmas and Recommendations. IEEE Access 10 (2022)
Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models. ICLR (2022)
Pengcheng He, Baolin Peng, Liyang Lu, Song Wang, Jie Mei, Yang Liu, Ruochen Xu, Hany Hassan Awadalla, Yu Shi, Chenguang Zhu, Wayne Xiong, Michael Zeng, Jianfeng Gao, Xuedong Huang
Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization. CoRR (2022)
Zhengbao Jiang, Yi Mao, Pengcheng He, Graham Neubig, Weizhu Chen
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering. CoRR (2022)
Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization. CoRR (2021)
Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization. ACL/IJCNLP (1) (2021)
Yuhui Wang, Pengcheng He, Xiaoyang Tan
Greedy Multi-step Off-Policy Reinforcement Learning. CoRR (2021)
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen
Deberta: decoding-Enhanced Bert with Disentangled Attention. ICLR (2021)
Pengcheng He, Jianfeng Gao, Weizhu Chen
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing. CoRR (2021)
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen
Generation-Augmented Retrieval for Open-Domain Question Answering. ACL/IJCNLP (1) (2021)
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
UnitedQA: A Hybrid Approach for Open Domain Question Answering. ACL/IJCNLP (1) (2021)
Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Tuo Zhao
Token-wise Curriculum Learning for Neural Machine Translation. EMNLP (Findings) (2021)
Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
ARCH: Efficient Adversarial Regularized Training with Caching. CoRR (2021)
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
Adversarial Training as Stackelberg Game: An Unrolled Optimization Approach. CoRR (2021)
Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
ARCH: Efficient Adversarial Regularized Training with Caching. EMNLP (Findings) (2021)
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach. EMNLP (1) (2021)
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
UnitedQA: A Hybrid Approach for Open Domain Question Answering. CoRR (2021)
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen
Reader-Guided Passage Reranking for Open-Domain Question Answering. CoRR (2021)
Sewon Min, Jordan L. Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick S. H. Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Sejr Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned. CoRR (2021)
Tianwei Zhou, Junrui Lu, Wenwen Zhang, Pengcheng He, Ben Niu
Irregular Flight Timetable Recovery Under COVID-19: An Approach Based on Genetic Algorithm. DMBD (1) (2021)
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen
Reader-Guided Passage Reranking for Open-Domain Question Answering. ACL/IJCNLP (Findings) (2021)
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention. CoRR (2021)
Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Tuo Zhao
Token-wise Curriculum Learning for Neural Machine Translation. CoRR (2021)
Pengcheng He, Kehui Sun, Congxu Zhu
A Novel Image Encryption Algorithm Based on the Delayed Maps and Permutation-Confusion-Diffusion Architecture. Secur. Commun. Networks 2021 (2021)
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding. ACL (demo) (2020)
Pengcheng He, Xiaohu Jiang, Qingjiang Shi
Robust TOA-Based Source Self-Positioning With Clock Imperfection. WCNC (2020)
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen
DeBERTa: Decoding-enhanced BERT with Disentangled Attention. CoRR (2020)
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen
Generation-Augmented Retrieval for Open-domain Question Answering. CoRR (2020)
Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, Weizhu Chen
Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning. CoRR (2020)
Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, Weizhu Chen
Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning. EMNLP (1) (2020)

Pengcheng He.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Pengcheng He