Xiaodong Liu

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 27

Top Topics

Language Understanding

Adaptive Learning Rate

Question Answering

Top Venues

EMNLP (Findings)

Publications

Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs. ICLR (2024)
Zonglin Yang, Li Dong, Xinya Du, Hao Cheng, Erik Cambria, Xiaodong Liu, Jianfeng Gao, Furu Wei
Language Models as Inductive Reasoners. EACL (1) (2024)
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
Fast-ELECTRA for Efficient Pre-training. ICLR (2024)
Sanxing Chen, Hao Cheng, Xiaodong Liu, Jian Jiao, Yangfeng Ji, Jianfeng Gao
Pre-training Transformers for Knowledge Graph Completion. CoRR (2023)
Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
Visually-Augmented Language Modeling. ICLR (2023)
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering. ACL (2) (2023)
Robert Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
Fine-tuning large neural language models for biomedical natural language processing. Patterns 4 (4) (2023)
Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
Efficient Long Sequence Modeling via State Space Augmented Transformer. CoRR (2022)
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge. EMNLP (Findings) (2022)
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
Knowledge-Rich Self-Supervision for Biomedical Entity Linking. EMNLP (Findings) (2022)
Yaqing Wang, Subhabrata Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Hassan Awadallah, Jianfeng Gao
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners. NAACL-HLT (Findings) (2022)
Zonglin Yang, Li Dong, Xinya Du, Hao Cheng, Erik Cambria, Xiaodong Liu, Jianfeng Gao, Furu Wei
Language Models as Inductive Reasoners. CoRR (2022)
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge. CoRR (2022)
Yaqing Wang, Sahaj Agarwal, Subhabrata Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Hassan Awadallah, Jianfeng Gao
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning. EMNLP (2022)
Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, Xiaodong Liu, David Farhi, Nick Ryder, Jakub Pachocki, Weizhu Chen, Jianfeng Gao
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer. CoRR (2022)
Ganesh Jawahar, Subhabrata Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Hassan Awadallah, Sébastien Bubeck, Jianfeng Gao
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers. CoRR (2022)
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
Open Domain Question Answering with A Unified Knowledge Interface. ACL (1) (2022)
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention. IJCAI (2022)
Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
Visually-Augmented Language Modeling. CoRR (2022)
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering. CoRR (2022)
Yaqing Wang, Subhabrata Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Hassan Awadallah, Jianfeng Gao
AdaMix: Mixture-of-Adapter for Parameter-efficient Tuning of Large Language Models. CoRR (2022)
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Jianfeng Gao, Tuo Zhao
Taming Sparsely Activated Transformer with Stochastic Experts. ICLR (2022)
Yaqing Wang, Sahaj Agarwal, Subhabrata Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Hassan Awadallah, Jianfeng Gao
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning. CoRR (2022)
Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models. ICLR (2022)
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Di He, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals. CoRR (2022)
Ge Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, Xiaodong Liu, David Farhi, Nick Ryder, Jakub Pachocki, Weizhu Chen, Jianfeng Gao
Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer. NeurIPS (2021)
Subhabrata Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Ge Yang, Christopher Meek, Ahmed Hassan Awadallah, Jianfeng Gao
Few-Shot Learning Evaluation in Natural Language Understanding. NeurIPS Datasets and Benchmarks (2021)