Hao Cheng

Publication Activity (10 Years)

Years Active: 2013-2024
Publications (10 Years): 61

Top Topics

Natural Language

Question Answering

Top Venues

Publications

Zeliang Zhang, Xiaodong Liu, Hao Cheng, Chenliang Xu, Jianfeng Gao
Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts. CoRR (2024)
Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chunyuan Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts. ICLR (2024)
Bo-Ru Lu, Nikita Haduong, Chien-Yu Lin, Hao Cheng, Noah A. Smith, Mari Ostendorf
Encode Once and Decode in Parallel: Efficient Transformer Decoding. CoRR (2024)
Yiqing Xie, Sheng Zhang, Hao Cheng, Pengfei Liu, Zelalem Gero, Cliff Wong, Tristan Naumann, Hoifung Poon, Carolyn P. Rosé
DocLens: Multi-aspect Fine-grained Medical Text Evaluation. ACL (1) (2024)
Zonglin Yang, Li Dong, Xinya Du, Hao Cheng, Erik Cambria, Xiaodong Liu, Jianfeng Gao, Furu Wei
Language Models as Inductive Reasoners. EACL (1) (2024)
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
Fast-ELECTRA for Efficient Pre-training. ICLR (2024)
Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
OrchestraLLM: Efficient Orchestration of Language Models for Dialogue State Tracking. NAACL-HLT (2024)
Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
OrchestraLLM: Efficient Orchestration of Language Models for Dialogue State Tracking. CoRR (2023)
Sheng Zhang, Hao Cheng, Jianfeng Gao, Hoifung Poon
Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning. ICLR (2023)
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
Augmenting Language Models with Long-Term Memory. CoRR (2023)
Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models. CoRR (2023)
Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
Visually-Augmented Language Modeling. ICLR (2023)
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering. ACL (2) (2023)
Robert Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
Fine-tuning large neural language models for biomedical natural language processing. Patterns 4 (4) (2023)
Zeqiu Wu, Ryu Parish, Hao Cheng, Sewon Min, Prithviraj Ammanabrolu, Mari Ostendorf, Hannaneh Hajishirzi
InSCIt: Information-Seeking Conversations with Mixed-Initiative Interactions. Trans. Assoc. Comput. Linguistics 11 (2023)
Bo-Ru Lu, Nikita Haduong, Chia-Hsuan Lee, Zeqiu Wu, Hao Cheng, Paul Koester, Jean Utke, Tao Yu, Noah A. Smith, Mari Ostendorf
DIALGEN: Collaborative Human-LM Generated Dialogues for Improved Understanding of Human-Human Conversations. CoRR (2023)
Kaixin Ma, Hao Cheng, Yu Zhang, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
Chain-of-Skills: A Configurable Model for Open-domain Question Answering. CoRR (2023)
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge. EMNLP (Findings) (2022)
Zonglin Yang, Li Dong, Xinya Du, Hao Cheng, Erik Cambria, Xiaodong Liu, Jianfeng Gao, Furu Wei
Language Models as Inductive Reasoners. CoRR (2022)
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge. CoRR (2022)
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
Open Domain Question Answering with A Unified Knowledge Interface. ACL (1) (2022)
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention. IJCAI (2022)
Zeqiu Wu, Ryu Parish, Hao Cheng, Sewon Min, Prithviraj Ammanabrolu, Mari Ostendorf, Hannaneh Hajishirzi
INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactions. CoRR (2022)
Bo-Ru Lu, Yushi Hu, Hao Cheng, Noah A. Smith, Mari Ostendorf
Unsupervised Learning of Hierarchical Conversation Structure. CoRR (2022)
Bo-Ru Lu, Yushi Hu, Hao Cheng, Noah A. Smith, Mari Ostendorf
Unsupervised Learning of Hierarchical Conversation Structure. EMNLP (Findings) (2022)
Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
Visually-Augmented Language Modeling. CoRR (2022)
Da Yin, Li Dong, Hao Cheng, Xiaodong Liu, Kai-Wei Chang, Furu Wei, Jianfeng Gao
A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models. CoRR (2022)
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering. CoRR (2022)
Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing. ACM Trans. Comput. Heal. 3 (1) (2022)
Sheng Zhang, Hao Cheng, Jianfeng Gao, Hoifung Poon
Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning. CoRR (2022)
Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
Targeted Adversarial Training for Natural Language Understanding. CoRR (2021)
Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
Targeted Adversarial Training for Natural Language Understanding. NAACL-HLT (2021)
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Robert Tinn, Cliff Wong, Naoto Usuyama, Richard Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul N. Bennett, Jianfeng Gao, Hoifung Poon
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature. KDD (2021)
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
Open Domain Question Answering over Virtual Documents: A Unified Approach for Data and Text. CoRR (2021)
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
UnitedQA: A Hybrid Approach for Open Domain Question Answering. ACL/IJCNLP (1) (2021)
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Robert Tinn, Cliff Wong, Naoto Usuyama, Richard Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul N. Bennett, Jianfeng Gao, Hoifung Poon
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature. CoRR (2021)
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
UnitedQA: A Hybrid Approach for Open Domain Question Answering. CoRR (2021)
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
Knowledge-Rich Self-Supervised Entity Linking. CoRR (2021)
Sewon Min, Jordan L. Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick S. H. Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Sejr Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned. CoRR (2021)
Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
Dialogue State Tracking with a Language Model using Schema-Driven Prompting. CoRR (2021)
Robert Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing. CoRR (2021)
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention. CoRR (2021)
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
Posterior Differential Regularization with f-divergence for Improving Model Robustness. NAACL-HLT (2021)
Subhabrata Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Christopher Meek, Ahmed Hassan Awadallah, Jianfeng Gao
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding. CoRR (2021)
Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
Dialogue State Tracking with a Language Model using Schema-Driven Prompting. EMNLP (1) (2021)
Subhabrata Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Ge Yang, Christopher Meek, Ahmed Hassan Awadallah, Jianfeng Gao
Few-Shot Learning Evaluation in Natural Language Understanding. NeurIPS Datasets and Benchmarks (2021)
Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing. CoRR (2020)
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding. ACL (demo) (2020)
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
Posterior Differential Regularization with f-divergence for Improving Model Robustness. CoRR (2020)
Sewon Min, Jordan L. Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick S. H. Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Sejr Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned. NeurIPS (Competition and Demos) (2020)
Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao
Adversarial Training for Large Neural Language Models. CoRR (2020)
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding. CoRR (2020)
Hao Cheng, Hao Fang, Mari Ostendorf
A Dynamic Speaker Model for Conversational Interactions. NAACL-HLT (1) (2019)
Hao Fang, Hao Cheng, Maarten Sap, Elizabeth Clark, Ari Holtzman, Yejin Choi, Noah A. Smith, Mari Ostendorf
Sounding Board: A User-Centric and Content-Driven Social Chatbot. NAACL-HLT (Demonstrations) (2018)
Hao Fang, Hao Cheng, Maarten Sap, Elizabeth Clark, Ari Holtzman, Yejin Choi, Noah A. Smith, Mari Ostendorf
Sounding Board: A User-Centric and Content-Driven Social Chatbot. CoRR (2018)
Hao Cheng, Hao Fang, Mari Ostendorf
A Factored Neural Network Model for Characterizing Online Discussions in Vector Space. EMNLP (2017)
Hao Cheng, Yaoliang Yu, Xinhua Zhang, Eric P. Xing, Dale Schuurmans
Scalable and Sound Low-Rank Tensor Learning. AISTATS (2016)
Hao Fang, Hao Cheng, Mari Ostendorf
Learning Latent Local Conversation Modes for Predicting Community Endorsement in Online Discussions. CoRR (2016)
Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
Bi-directional Attention with Agreement for Dependency Parsing. EMNLP (2016)
Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
Bi-directional Attention with Agreement for Dependency Parsing. CoRR (2016)
Hao Fang, Hao Cheng, Mari Ostendorf
Learning Latent Local Conversation Modes for Predicting Comment Endorsement in Online Discussions. SocialNLP@EMNLP (2016)
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
Language Models for Image Captioning: The Quirks and What Works. CoRR (2015)
Hao Cheng, Hao Fang, Mari Ostendorf
Open-Domain Name Error Detection using a Multi-Task RNN. EMNLP (2015)
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
Language Models for Image Captioning: The Quirks and What Works. ACL (2) (2015)
Yaoliang Yu, Hao Cheng, Dale Schuurmans, Csaba Szepesvári
Characterizing the Representer Theorem. ICML (1) (2013)