Faisal Ladhak

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 49

Top Topics

Sentence Extraction

Extractive Summarization

Text Summarization

Top Venues

Publications

Tianyi Zhang, Faisal Ladhak, Esin Durmus, Percy Liang, Kathleen R. McKeown, Tatsunori B. Hashimoto
Benchmarking Large Language Models for News Summarization. Trans. Assoc. Comput. Linguistics 12 (2024)
Melanie Subbiah, Faisal Ladhak, Akankshya Mishra, Griffin Adams, Lydia B. Chilton, Kathleen R. McKeown
STORYSUMM: Evaluating Faithfulness in Story Summarization. CoRR (2024)
Dehong Xu, Liang Qiu, Minseok Kim, Faisal Ladhak, Jaeyoung Do
Aligning Large Language Models via Fine-grained Supervision. CoRR (2024)
Yonatan Oren, Nicole Meister, Niladri S. Chatterji, Faisal Ladhak, Tatsunori Hashimoto
Proving Test Set Contamination in Black-Box Language Models. ICLR (2024)
Griffin Adams, Alexander R. Fabbri, Faisal Ladhak, Eric Lehman, Noémie Elhadad
From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting. CoRR (2023)
Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, Tatsunori Hashimoto
Whose Opinions Do Language Models Reflect? ICML (2023)
Yonatan Oren, Nicole Meister, Niladri S. Chatterji, Faisal Ladhak, Tatsunori B. Hashimoto
Proving Test Set Contamination in Black Box Language Models. CoRR (2023)
Federico Bianchi, Pratyusha Kalluri, Esin Durmus, Faisal Ladhak, Myra Cheng, Debora Nozza, Tatsunori Hashimoto, Dan Jurafsky, James Zou, Aylin Caliskan
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale. FAccT (2023)
Tianyi Zhang, Faisal Ladhak, Esin Durmus, Percy Liang, Kathleen R. McKeown, Tatsunori B. Hashimoto
Benchmarking Large Language Models for News Summarization. CoRR (2023)
Faisal Ladhak, Esin Durmus, Mirac Suzgun, Tianyi Zhang, Dan Jurafsky, Kathleen R. McKeown, Tatsunori Hashimoto
When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization. EACL (2023)
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D. Manning, Christopher Ré, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue Wang, Keshav Santhanam, Laurel J. Orr, Lucia Zheng, Mert Yüksekgönül, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, Yuta Koreeda
Holistic Evaluation of Language Models. Trans. Mach. Learn. Res. 2023 (2023)
Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ashwin Paranjape, Ines Gerard-Ursin, Xiang Lisa Li, Faisal Ladhak, Frieda Rong, Rose E. Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael S. Bernstein, Percy Liang
Evaluating Human-Language Model Interaction. Trans. Mach. Learn. Res. 2023 (2023)
Griffin Adams, Alexander R. Fabbri, Faisal Ladhak, Kathleen R. McKeown, Noémie Elhadad
Generating EDU Extracts for Plan-Guided Summary Re-Ranking. CoRR (2023)
Faisal Ladhak, Esin Durmus, Tatsunori Hashimoto
Contrastive Error Attribution for Finetuned Language Models. ACL (1) (2023)
Griffin Adams, Alexander R. Fabbri, Faisal Ladhak, Noémie Elhadad, Kathleen R. McKeown
Generating EDU Extracts for Plan-Guided Summary Re-Ranking. ACL (1) (2023)
Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, Tatsunori Hashimoto
Whose Opinions Do Language Models Reflect? CoRR (2023)
Badr AlKhamissi, Faisal Ladhak, Srini Iyer, Ves Stoyanov, Zornitsa Kozareva, Xian Li, Pascale Fung, Lambert Mathias, Asli Celikyilmaz, Mona T. Diab
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection. CoRR (2022)
Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran, Alex Wang, Alexandros Papangelis, Aman Madaan, Angelina McMillan-Major, Anna Shvets, Ashish Upadhyay, Bingsheng Yao, Bryan Wilie, Chandra Bhagavatula, Chaobin You, Craig Thomson, Cristina Garbacea, Dakuo Wang, Daniel Deutsch, Deyi Xiong, Di Jin, Dimitra Gkatzia, Dragomir R. Radev, Elizabeth Clark, Esin Durmus, Faisal Ladhak, Filip Ginter, Genta Indra Winata, Hendrik Strobelt, Hiroaki Hayashi, Jekaterina Novikova, Jenna Kanerva, Jenny Chim, Jiawei Zhou, Jordan Clive, Joshua Maynez, João Sedoc, Juraj Juraska, Kaustubh D. Dhole, Khyathi Raghavi Chandu, Laura Perez-Beltrachini, Leonardo F. R. Ribeiro, Lewis Tunstall, Li Zhang, Mahima Pushkarna, Mathias Creutz, Michael White, Mihir Sanjay Kale, Moussa Kamal Eddine, Nico Daheim, Nishant Subramani, Ondrej Dusek, Paul Pu Liang, Pawan Sasanka Ammanamanchi, Qi Zhu, Ratish Puduppully, Reno Kriz, Rifat Shahriyar, Ronald Cardenas, Saad Mahamood, Salomey Osei, Samuel Cahyawijaya, Sanja Stajner, Sébastien Montella, Shailza Jolly, Simon Mille, Tahmid Hasan, Tianhao Shen, Tosin P. AMahidewumi, Vikas Raunak, Vipul Raheja, Vitaly Nikolaev, Vivian Tsai, Yacine Jernite, Ying Xu, Yisi Sang, Yixin Liu, Yufang Hou
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code. CoRR (2022)
Faisal Ladhak, Esin Durmus, He He, Claire Cardie, Kathleen R. McKeown
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization. ACL (1) (2022)
Federico Bianchi, Pratyusha Kalluri, Esin Durmus, Faisal Ladhak, Myra Cheng, Debora Nozza, Tatsunori Hashimoto, Dan Jurafsky, James Zou, Aylin Caliskan
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale. CoRR (2022)
Divyansh Agarwal, Alexander R. Fabbri, Simeng Han, Wojciech Kryscinski, Faisal Ladhak, Bryan Li, Kathleen R. McKeown, Dragomir Radev, Tianyi Zhang, Sam Wiseman
CREATIVESUMM: Shared Task on Automatic Summarization for Creative Writing. CoRR (2022)
Hardy Hardy, Miguel Ballesteros, Faisal Ladhak, Muhammad Khalifa, Vittorio Castelli, Kathleen R. McKeown
Novel Chapter Abstractive Summarization using Spinal Tree Aware Sub-Sentential Content Selection. CoRR (2022)
Esin Durmus, Faisal Ladhak, Tatsunori Hashimoto
Spurious Correlations in Reference-Free Evaluation of Text Generation. CoRR (2022)
Badr AlKhamissi, Faisal Ladhak, Srinivasan Iyer, Veselin Stoyanov, Zornitsa Kozareva, Xian Li, Pascale Fung, Lambert Mathias, Asli Celikyilmaz, Mona T. Diab
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection. EMNLP (2022)
Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ashwin Paranjape, Ines Gerard-Ursin, Xiang Lisa Li, Faisal Ladhak, Frieda Rong, Rose E. Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael S. Bernstein, Percy Liang
Evaluating Human-Language Model Interaction. CoRR (2022)
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D. Manning, Christopher Ré, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue Wang, Keshav Santhanam, Laurel J. Orr, Lucia Zheng, Mert Yüksekgönül, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, Yuta Koreeda
Holistic Evaluation of Language Models. CoRR (2022)
Elsbeth Turcan, David Wan, Faisal Ladhak, Petra Galuscáková, Sukanta Sen, Svetlana Tchistiakova, Weijia Xu, Marine Carpuat, Kenneth Heafield, Douglas W. Oard, Kathleen R. McKeown
Constrained Regeneration for Cross-Lingual Query-Focused Extractive Summarization. COLING (2022)
Faisal Ladhak, Esin Durmus, Tatsunori Hashimoto
Tracing and Removing Data Errors in Natural Language Generation Datasets. CoRR (2022)
Esin Durmus, Faisal Ladhak, Tatsunori Hashimoto
Spurious Correlations in Reference-Free Evaluation of Text Generation. ACL (1) (2022)
Tianshu Wang, Faisal Ladhak, Esin Durmus, He He
Improving Faithfulness by Augmenting Negative Summaries from Fake Documents. EMNLP (2022)
Faisal Ladhak, Esin Durmus, He He, Claire Cardie, Kathleen R. McKeown
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization. CoRR (2021)
David Wan, Chris Kedzie, Faisal Ladhak, Elsbeth Turcan, Petra Galuscáková, Elena Zotkina, Zhengping Jiang, Peter Bell, Kathleen R. McKeown
Segmenting Subtitles for Correcting ASR Segmentation Errors. EACL (2021)
Sebastian Gehrmann, Tosin P. Adewumi, Karmanya Aggarwal, Pawan Sasanka Ammanamanchi, Aremu Anuoluwapo, Antoine Bosselut, Khyathi Raghavi Chandu, Miruna-Adriana Clinciu, Dipanjan Das, Kaustubh D. Dhole, Wanyu Du, Esin Durmus, Ondrej Dusek, Chris Emezue, Varun Gangal, Cristina Garbacea, Tatsunori Hashimoto, Yufang Hou, Yacine Jernite, Harsh Jhamtani, Yangfeng Ji, Shailza Jolly, Dhruv Kumar, Faisal Ladhak, Aman Madaan, Mounica Maddela, Khyati Mahajan, Saad Mahamood, Bodhisattwa Prasad Majumder, Pedro Henrique Martins, Angelina McMillan-Major, Simon Mille, Emiel van Miltenburg, Moin Nadeem, Shashi Narayan, Vitaly Nikolaev, Rubungo Andre Niyongabo, Salomey Osei, Ankur P. Parikh, Laura Perez-Beltrachini, Niranjan Ramesh Rao, Vikas Raunak, Juan Diego Rodriguez, Sashank Santhanam, João Sedoc, Thibault Sellam, Samira Shaikh, Anastasia Shimorina, Marco Antonio Sobrevilla Cabezudo, Hendrik Strobelt, Nishant Subramani, Wei Xu, Diyi Yang, Akhila Yerukola, Jiawei Zhou
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics. CoRR (2021)
David Wan, Chris Kedzie, Faisal Ladhak, Elsbeth Turcan, Petra Galuscáková, Elena Zotkina, Zhengping Jiang, Peter Bell, Kathleen R. McKeown
Segmenting Subtitles for Correcting ASR Segmentation Errors. CoRR (2021)
Faisal Ladhak, Bryan Li, Yaser Al-Onaizan, Kathleen R. McKeown
Exploring Content Selection in Summarization of Novel Chapters. CoRR (2020)
Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan
To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging. CoRR (2020)
Faisal Ladhak, Esin Durmus, Claire Cardie, Kathleen R. McKeown
WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization. CoRR (2020)
Faisal Ladhak, Bryan Li, Yaser Al-Onaizan, Kathleen R. McKeown
Exploring Content Selection in Summarization of Novel Chapters. ACL (2020)
Esin Durmus, Faisal Ladhak, Claire Cardie
The Role of Pragmatic and Discourse Context in Determining Argument Impact. CoRR (2020)
Faisal Ladhak, Esin Durmus, Claire Cardie, Kathleen R. McKeown
WikiLingua: A New Benchmark Dataset for Multilingual Abstractive Summarization. EMNLP (Findings) (2020)
Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan
To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging. EMNLP (1) (2020)
David Wan, Chris Kedzie, Faisal Ladhak, Marine Carpuat, Kathleen R. McKeown
Incorporating Terminology Constraints in Automatic Post-Editing. WMT@EMNLP (2020)
David Wan, Chris Kedzie, Faisal Ladhak, Marine Carpuat, Kathleen R. McKeown
Incorporating Terminology Constraints in Automatic Post-Editing. CoRR (2020)
Esin Durmus, Faisal Ladhak, Claire Cardie
Determining Relative Argument Specificity and Stance for Complex Argumentative Structures. CoRR (2019)
Esin Durmus, Faisal Ladhak, Claire Cardie
The Role of Pragmatic and Discourse Context in Determining Argument Impact. EMNLP/IJCNLP (1) (2019)
Esin Durmus, Faisal Ladhak, Claire Cardie
Determining Relative Argument Specificity and Stance for Complex Argumentative Structures. ACL (1) (2019)
Yichao Lu, Phillip Keung, Faisal Ladhak, Vikas Bhardwaj, Shaonan Zhang, Jason Sun
A neural interlingua for multilingual machine translation. WMT (2018)
Yichao Lu, Phillip Keung, Faisal Ladhak, Vikas Bhardwaj, Shaonan Zhang, Jason Sun
A neural interlingua for multilingual machine translation. CoRR (2018)
Faisal Ladhak, Ankur Gandhe, Markus Dreyer, Lambert Mathias, Ariya Rastrow, Björn Hoffmeister
LatticeRnn: Recurrent Neural Networks Over Lattices. INTERSPEECH (2016)