Pengfei Liu

ORCID

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 131

Top Venues

Publications

Junlong Li, Fan Zhou, Shichao Sun, Yikai Zhang, Hai Zhao, Pengfei Liu
Dissecting Human and LLM Preferences. ACL (1) (2024)
Steffi Chern, Zhulin Hu, Yuqing Yang, Ethan Chern, Yuan Guo, Jiahe Jin, Binjie Wang, Pengfei Liu
BeHonest: Benchmarking Honesty of Large Language Models. CoRR (2024)
Shichao Sun, Ruifeng Yuan, Ziqiang Cao, Wenjie Li, Pengfei Liu
Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization. CoRR (2024)
Zhen Huang, Zengzhi Wang, Shijie Xia, Pengfei Liu
OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far? CoRR (2024)
Mianxin Liu, Jinru Ding, Jie Xu, Weiguo Hu, Xiaoyang Li, Lifeng Zhu, Zhian Bai, Xiaoming Shi, Benyou Wang, Haitao Song, Pengfei Liu, Xiaofan Zhang, Shanshan Wang, Kang Li, Haofen Wang, Tong Ruan, Xuanjing Huang, Xin Sun, Shaoting Zhang
MedBench: A Comprehensive, Standardized, and Reliable Benchmarking System for Evaluating Chinese Medical Large Language Models. CoRR (2024)
Yixin Liu, Pengfei Liu, Arman Cohan
Understanding Reference Policies in Direct Preference Optimization. CoRR (2024)
Ruijie Xu, Zengzhi Wang, Run-Ze Fan, Pengfei Liu
Benchmarking Benchmark Leakage in Large Language Models. CoRR (2024)
Ethan Chern, Jiadi Su, Yan Ma, Pengfei Liu
ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generation. CoRR (2024)
Yiyuan Li, Shichao Sun, Pengfei Liu
FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models. CoRR (2024)
Weizhe Yuan, Pengfei Liu, Matthias Gallé
LLMCrit: Teaching Large Language Models to Use Criteria. ACL (Findings) (2024)
Binjie Wang, Steffi Chern, Ethan Chern, Pengfei Liu
Halu-J: Critique-Based Hallucination Judge. CoRR (2024)
Jinlan Fu, See-Kiong Ng, Zhengbao Jiang, Pengfei Liu
GPTScore: Evaluate as You Desire. NAACL-HLT (2024)
Run-Ze Fan, Xuefeng Li, Haoyang Zou, Junlong Li, Shwai He, Ethan Chern, Jiewen Hu, Pengfei Liu
Reformatted Alignment. CoRR (2024)
Shichao Sun, Ruifeng Yuan, Ziqiang Cao, Wenjie Li, Pengfei Liu
Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization. ACL (Findings) (2024)
Yuqing Yang, Yan Ma, Pengfei Liu
Weak-to-Strong Reasoning. CoRR (2024)
Yixin Liu, Kejian Shi, Katherine He, Longtian Ye, Alexander R. Fabbri, Pengfei Liu, Dragomir Radev, Arman Cohan
On Learning to Summarize with Large Language Models as References. NAACL-HLT (2024)
Shijie Xia, Xuefeng Li, Yixin Liu, Tongshuang Wu, Pengfei Liu
Evaluating Mathematical Reasoning Beyond Accuracy. CoRR (2024)
Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, Dong Yu
InFoBench: Evaluating Instruction Following Ability in Large Language Models. ACL (Findings) (2024)
Zhen Huang, Zengzhi Wang, Shijie Xia, Xuefeng Li, Haoyang Zou, Ruijie Xu, Run-Ze Fan, Lyumanshan Ye, Ethan Chern, Yixin Ye, Yikai Zhang, Yuqing Yang, Ting Wu, Binjie Wang, Shichao Sun, Yang Xiao, Yiyuan Li, Fan Zhou, Steffi Chern, Yiwei Qin, Yan Ma, Jiadi Su, Yixiu Liu, Yuxiang Zheng, Shaoting Zhang, Dahua Lin, Yu Qiao, Pengfei Liu
OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI. CoRR (2024)
Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, Dong Yu
InFoBench: Evaluating Instruction Following Ability in Large Language Models. CoRR (2024)
Steffi Chern, Ethan Chern, Graham Neubig, Pengfei Liu
Can Large Language Models be Trusted for Evaluation? Scalable Meta-Evaluation of LLMs as Evaluators via Agent Debate. CoRR (2024)
Weizhe Yuan, Pengfei Liu, Matthias Gallé
LLMCRIT: Teaching Large Language Models to Use Criteria. CoRR (2024)
Ting Wu, Xuefeng Li, Pengfei Liu
Progress or Regress? Self-Improvement Reversal in Post-training. CoRR (2024)
Yan Ma, Yu Qiao, Pengfei Liu
MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation. ACL (1) (2024)
Junlong Li, Shichao Sun, Weizhe Yuan, Run-Ze Fan, Hai Zhao, Pengfei Liu
Generative Judge for Evaluating Alignment. ICLR (2024)
Yueqi Song, Catherine Cui, Simran Khanuja, Pengfei Liu, Fahim Faisal, Alissa Ostapenko, Genta Indra Winata, Alham Fikri Aji, Samuel Cahyawijaya, Yulia Tsvetkov, Antonios Anastasopoulos, Graham Neubig
GlobalBench: A Benchmark for Global Progress in Natural Language Processing. CoRR (2023)
Sameer Jain, Vaishakh Keshava, Swarnashree Mysore Sathyendra, Patrick Fernandes, Pengfei Liu, Graham Neubig, Chunting Zhou
Multi-Dimensional Evaluation of Text Summarization with In-Context Learning. ACL (Findings) (2023)
Sameer Jain, Vaishakh Keshava, Swarnashree Mysore Sathyendra, Patrick Fernandes, Pengfei Liu, Graham Neubig, Chunting Zhou
Multi-Dimensional Evaluation of Text Summarization with In-Context Learning. CoRR (2023)
Vijay Viswanathan, Luyu Gao, Tongshuang Wu, Pengfei Liu, Graham Neubig
DataFinder: Scientific Dataset Recommendation from Natural Language Descriptions. ACL (1) (2023)
Jinlan Fu, See-Kiong Ng, Zhengbao Jiang, Pengfei Liu
GPTScore: Evaluate as You Desire. CoRR (2023)
Yiwei Qin, Weizhe Yuan, Graham Neubig, Pengfei Liu
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics. EMNLP (Findings) (2023)
Junlong Li, Shichao Sun, Weizhe Yuan, Run-Ze Fan, Hai Zhao, Pengfei Liu
Generative Judge for Evaluating Alignment. CoRR (2023)
I-Chun Chern, Zhiruo Wang, Sanjan Das, Bhavuk Sharma, Pengfei Liu, Graham Neubig
Improving Factuality of Abstractive Summarization via Contrastive Reward Learning. CoRR (2023)
Yueqi Song, Simran Khanuja, Pengfei Liu, Fahim Faisal, Alissa Ostapenko, Genta Winata, Alham Fikri Aji, Samuel Cahyawijaya, Yulia Tsvetkov, Antonios Anastasopoulos, Graham Neubig
GlobalBench: A Benchmark for Global Progress in Natural Language Processing. EMNLP (2023)
Yuqing Yang, Ethan Chern, Xipeng Qiu, Graham Neubig, Pengfei Liu
Alignment for Honesty. CoRR (2023)
Luyu Gao, Aman Madaan, Shuyan Zhou, Uri Alon, Pengfei Liu, Yiming Yang, Jamie Callan, Graham Neubig
PAL: Program-aided Language Models. ICML (2023)
Shiqi Chen, Yiran Zhao, Jinghan Zhang, I-Chun Chern, Siyang Gao, Pengfei Liu, Junxian He
FELM: Benchmarking Factuality Evaluation of Large Language Models. NeurIPS (2023)
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, Graham Neubig
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing. ACM Comput. Surv. 55 (9) (2023)
I-Chun Chern, Steffi Chern, Shiqi Chen, Weizhe Yuan, Kehua Feng, Chunting Zhou, Junxian He, Graham Neubig, Pengfei Liu
FacTool: Factuality Detection in Generative AI - A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios. CoRR (2023)
Shiqi Chen, Yiran Zhao, Jinghan Zhang, I-Chun Chern, Siyang Gao, Pengfei Liu, Junxian He
FELM: Benchmarking Factuality Evaluation of Large Language Models. CoRR (2023)
Jinlan Fu, See-Kiong Ng, Pengfei Liu
Polyglot Prompt: Multilingual Multitask Prompt Training. EMNLP (2022)
Yang Xiao, Jinlan Fu, Weizhe Yuan, Vijay Viswanathan, Zhoumianze Liu, Yixin Liu, Graham Neubig, Pengfei Liu
DataLab: A Platform for Data Analysis and Intervention. ACL (demo) (2022)
Weizhe Yuan, Pengfei Liu, Graham Neubig
Can We Automate Scientific Reviewing? J. Artif. Intell. Res. 75 (2022)
Yixin Liu, Pengfei Liu, Dragomir R. Radev, Graham Neubig
BRIO: Bringing Order to Abstractive Summarization. ACL (1) (2022)
Yang Xiao, Jinlan Fu, See-Kiong Ng, Pengfei Liu
Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification. NAACL-HLT (2022)
Haris Widjaja, Kiril Gashteovski, Wiem Ben Rim, Pengfei Liu, Christopher Malon, Daniel Ruffinelli, Carolin Lawrence, Graham Neubig
KGxBoard: Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Models. EMNLP (Demos) (2022)
Luyu Gao, Aman Madaan, Shuyan Zhou, Uri Alon, Pengfei Liu, Yiming Yang, Jamie Callan, Graham Neubig
PAL: Program-aided Language Models. CoRR (2022)
Yang Xiao, Jinlan Fu, See-Kiong Ng, Pengfei Liu
Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification. CoRR (2022)
Yang Xiao, Jinlan Fu, Weizhe Yuan, Vijay Viswanathan, Zhoumianze Liu, Yixin Liu, Graham Neubig, Pengfei Liu
DataLab: A Platform for Data Analysis and Intervention. CoRR (2022)
Yiwei Qin, Graham Neubig, Pengfei Liu
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization. CoRR (2022)
Weizhe Yuan, Pengfei Liu
reStructured Pre-training. CoRR (2022)
Yiwei Qin, Weizhe Yuan, Graham Neubig, Pengfei Liu
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics. CoRR (2022)
Yixin Liu, Pengfei Liu, Dragomir R. Radev, Graham Neubig
BRIO: Bringing Order to Abstractive Summarization. CoRR (2022)
Jinlan Fu, See-Kiong Ng, Pengfei Liu
Polyglot Prompt: Multilingual Multitask PrompTraining. CoRR (2022)
Weizhe Yuan, Pengfei Liu
KID-Review: Knowledge-Guided Scientific Review Generation with Oracle Pre-training. AAAI (2022)
Haris Widjaja, Kiril Gashteovski, Wiem Ben Rim, Pengfei Liu, Christopher Malon, Daniel Ruffinelli, Carolin Lawrence, Graham Neubig
KGxBoard: Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Models. CoRR (2022)
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, Graham Neubig
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing. CoRR (2021)
Vijay Viswanathan, Graham Neubig, Pengfei Liu
CitationIE: Leveraging the Citation Graph for Scientific Information Extraction. CoRR (2021)
Yixin Liu, Pengfei Liu
SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization. ACL/IJCNLP (2) (2021)
Weizhe Yuan, Graham Neubig, Pengfei Liu
BARTScore: Evaluating Generated Text as Text Generation. NeurIPS (2021)
Junqi Dai, Hang Yan, Tianxiang Sun, Pengfei Liu, Xipeng Qiu
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa. NAACL-HLT (2021)
Yixin Liu, Zi-Yi Dou, Pengfei Liu
RefSum: Refactoring Neural Summarization. CoRR (2021)
Zihuiwen Ye, Pengfei Liu, Jinlan Fu, Graham Neubig
Towards More Fine-grained and Reliable NLP Performance Prediction. CoRR (2021)
Vijay Viswanathan, Graham Neubig, Pengfei Liu
CitationIE: Leveraging the Citation Graph for Scientific Information Extraction. ACL/IJCNLP (1) (2021)
Zihuiwen Ye, Pengfei Liu, Jinlan Fu, Graham Neubig
Towards More Fine-grained and Reliable NLP Performance Prediction. EACL (2021)
Weizhe Yuan, Pengfei Liu, Graham Neubig
Can We Automate Scientific Reviewing? CoRR (2021)
Zi-Yi Dou, Pengfei Liu, Hiroaki Hayashi, Zhengbao Jiang, Graham Neubig
GSum: A General Framework for Guided Neural Abstractive Summarization. NAACL-HLT (2021)
Jinlan Fu, Liangjing Feng, Qi Zhang, Xuanjing Huang, Pengfei Liu
Larger-Context Tagging: When and Why Does It Work? NAACL-HLT (2021)
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaichen Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye, Graham Neubig
ExplainaBoard: An Explainable Leaderboard for NLP. ACL (demo) (2021)
Weizhe Yuan, Graham Neubig, Pengfei Liu
BARTScore: Evaluating Generated Text as Text Generation. CoRR (2021)
Junqi Dai, Hang Yan, Tianxiang Sun, Pengfei Liu, Xipeng Qiu
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa. CoRR (2021)
Yixin Liu, Pengfei Liu
SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization. CoRR (2021)
Jinlan Fu, Xuanjing Huang, Pengfei Liu
SpanNER: Named Entity Re-/Recognition as Span Prediction. ACL/IJCNLP (1) (2021)
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaichen Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye, Graham Neubig
EXPLAINABOARD: An Explainable Leaderboard for NLP. CoRR (2021)
Jinlan Fu, Xuanjing Huang, Pengfei Liu
SpanNER: Named Entity Re-/Recognition as Span Prediction. CoRR (2021)
Jinlan Fu, Liangjing Feng, Qi Zhang, Xuanjing Huang, Pengfei Liu
Larger-Context Tagging: When and Why Does It Work? CoRR (2021)
Yixin Liu, Zi-Yi Dou, Pengfei Liu
RefSum: Refactoring Neural Summarization. NAACL-HLT (2021)
Yiran Chen, Pengfei Liu, Xipeng Qiu
Are Factuality Checkers Reliable? Adversarial Meta-evaluation of Factuality in Summarization. EMNLP (Findings) (2021)
Sebastian Ruder, Noah Constant, Jan Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. CoRR (2021)
Sebastian Ruder, Noah Constant, Jan Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Dan Garrette, Graham Neubig, Melvin Johnson
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. EMNLP (1) (2021)
Yiran Chen, Pengfei Liu, Ming Zhong, Zi-Yi Dou, Danqing Wang, Xipeng Qiu, Xuanjing Huang
CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systems. CoRR (2020)
Jinlan Fu, Pengfei Liu, Qi Zhang, Xuanjing Huang
RethinkCWS: Is Chinese Word Segmentation a Solved Task? CoRR (2020)
Manik Bhandari, Pranav Narayan Gour, Atabak Ashfaq, Pengfei Liu, Graham Neubig
Re-evaluating Evaluation in Text Summarization. EMNLP (1) (2020)
Jinlan Fu, Pengfei Liu, Qi Zhang, Xuanjing Huang
RethinkCWS: Is Chinese Word Segmentation a Solved Task? EMNLP (1) (2020)
Ming Zhong, Pengfei Liu, Yiran Chen, Danqing Wang, Xipeng Qiu, Xuanjing Huang
Extractive Summarization as Text Matching. ACL (2020)
Jinlan Fu, Pengfei Liu, Graham Neubig
Interpretable Multi-dataset Evaluation for Named Entity Recognition. EMNLP (1) (2020)
Tianxiang Sun, Yunfan Shao, Xiaonan Li, Pengfei Liu, Hang Yan, Xipeng Qiu, Xuanjing Huang
Learning Sparse Sharing Architectures for Multiple Tasks. AAAI (2020)
Yiran Chen, Pengfei Liu, Ming Zhong, Zi-Yi Dou, Danqing Wang, Xipeng Qiu, Xuanjing Huang
An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systems. EMNLP (Findings) (2020)
Manik Bhandari, Pranav Narayan Gour, Atabak Ashfaq, Pengfei Liu, Graham Neubig
Re-evaluating Evaluation in Text Summarization. CoRR (2020)
Qipeng Guo, Xipeng Qiu, Pengfei Liu, Xiangyang Xue, Zheng Zhang
Multi-Scale Self-Attention for Text Classification. AAAI (2020)
Jinlan Fu, Pengfei Liu, Qi Zhang
Rethinking Generalization of Neural Models: A Named Entity Recognition Case Study. AAAI (2020)
Jinlan Fu, Pengfei Liu, Qi Zhang, Xuanjing Huang
Rethinking Generalization of Neural Models: A Named Entity Recognition Case Study. CoRR (2020)
Ming Zhong, Pengfei Liu, Yiran Chen, Danqing Wang, Xipeng Qiu, Xuanjing Huang
Extractive Summarization as Text Matching. CoRR (2020)
Danqing Wang, Pengfei Liu, Yining Zheng, Xipeng Qiu, Xuanjing Huang
Heterogeneous Graph Neural Networks for Extractive Document Summarization. CoRR (2020)
Jinlan Fu, Pengfei Liu, Graham Neubig
Interpretable Multi-dataset Evaluation for Named Entity Recognition. CoRR (2020)
Danqing Wang, Pengfei Liu, Yining Zheng, Xipeng Qiu, Xuanjing Huang
Heterogeneous Graph Neural Networks for Extractive Document Summarization. ACL (2020)
Zi-Yi Dou, Pengfei Liu, Hiroaki Hayashi, Zhengbao Jiang, Graham Neubig
GSum: A General Framework for Guided Neural Abstractive Summarization. CoRR (2020)
Danqing Wang, Pengfei Liu, Ming Zhong, Jie Fu, Xipeng Qiu, Xuanjing Huang
Exploring Domain Shift in Extractive Text Summarization. CoRR (2019)
Tianxiang Sun, Yunfan Shao, Xiaonan Li, Pengfei Liu, Hang Yan, Xipeng Qiu, Xuanjing Huang
Learning Sparse Sharing Architectures for Multiple Tasks. CoRR (2019)
Qipeng Guo, Xipeng Qiu, Pengfei Liu, Yunfan Shao, Xiangyang Xue, Zheng Zhang
Star-Transformer. NAACL-HLT (1) (2019)

Pengfei Liu.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Pengfei Liu