Benjamin Van Durme

ORCID

Publication Activity (10 Years)

Years Active: 2003-2024
Publications (10 Years): 276

Top Venues

Publications

Guanghui Qin, Corby Rosset, Ethan C. Chau, Nikhil Rao, Benjamin Van Durme
Dodo: Dynamic Contextual Compression for Decoder-only LMs. ACL (1) (2024)
Kate Sanders, Nathaniel Weir, Benjamin Van Durme
TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning. CoRR (2024)
Weiting Tan, Yunmo Chen, Tongfei Chen, Guanghui Qin, Haoran Xu, Heidi C. Zhang, Benjamin Van Durme, Philipp Koehn
Streaming Sequence Transduction through Dynamic Compression. CoRR (2024)
Miriam Wanner, Seth Ebner, Zhengping Jiang, Mark Dredze, Benjamin Van Durme
A Closer Look at Claim Decomposition. *SEM@NAACL (2024)
Jiefu Ou, Arda Uzunoglu, Benjamin Van Durme, Daniel Khashabi
WorldAPIs: The World Is Worth How Many APIs? A Thought Experiment. CoRR (2024)
Abe Bohan Hou, Orion Weller, Guanghui Qin, Eugene Yang, Dawn J. Lawrie, Nils Holzenberger, Andrew Blair-Stanek, Benjamin Van Durme
CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generation. CoRR (2024)
Kate Sanders, Benjamin Van Durme
A Survey of Video Datasets for Grounded Event Understanding. CoRR (2024)
Zhengping Jiang, Yining Lu, Hanjie Chen, Daniel Khashabi, Benjamin Van Durme, Anqi Liu
RORA: Robust Free-Text Rationale Evaluation. ACL (1) (2024)
Kevin Xu, Yeganeh Kordi, Kate Sanders, Yizhong Wang, Adam Byerly, Jack Zhang, Benjamin Van Durme, Daniel Khashabi
Tur[k]ingBench: A Challenge Benchmark for Web Agents. CoRR (2024)
William Fleshman, Benjamin Van Durme
RE-Adapt: Reverse Engineered Adaptation of Large Language Models. CoRR (2024)
Orion Weller, Benjamin Chang, Sean MacAvaney, Kyle Lo, Arman Cohan, Benjamin Van Durme, Dawn J. Lawrie, Luca Soldaini
FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions. CoRR (2024)
Elias Stengel-Eskin, Kyle Rawlins, Benjamin Van Durme
Zero and Few-shot Semantic Parsing with Ambiguous Inputs. ICLR (2024)
Boshi Wang, Hao Fang, Jason Eisner, Benjamin Van Durme, Yu Su
LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error. ACL (1) (2024)
Zhengping Jiang, Jingyu Zhang, Nathaniel Weir, Seth Ebner, Miriam Wanner, Kate Sanders, Daniel Khashabi, Anqi Liu, Benjamin Van Durme
Core: Robust Factual Precision Scoring with Informative Sub-Claim Identification. CoRR (2024)
William Gantt, Shabnam Behzad, Hannah Youngeun An, Yunmo Chen, Aaron Steven White, Benjamin Van Durme, Mahsa Yarmohammadi
MultiMUC: Multilingual Template Filling on MUC-4. EACL (1) (2024)
Zhuowan Li, Cihang Xie, Benjamin Van Durme, Alan L. Yuille
Localization vs. Semantics: Visual Representations in Unimodal and Multimodal Models. EACL (1) (2024)
Boshi Wang, Hao Fang, Jason Eisner, Benjamin Van Durme, Yu Su
LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error. CoRR (2024)
Orion Weller, Kyle Lo, David Wadden, Dawn J. Lawrie, Benjamin Van Durme, Arman Cohan, Luca Soldaini
When do Generative Query and Document Expansions Fail? A Comprehensive Study Across Methods, Retrievers, and Datasets. EACL (Findings) (2024)
William Fleshman, Aleem Khan, Marc Marone, Benjamin Van Durme
AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guarantees. CoRR (2024)
Miriam Wanner, Seth Ebner, Zhengping Jiang, Mark Dredze, Benjamin Van Durme
A Closer Look at Claim Decomposition. CoRR (2024)
Zhengping Jiang, Anqi Liu, Benjamin Van Durme
Addressing the Binning Problem in Calibration Assessment through Scalar Annotations. Trans. Assoc. Comput. Linguistics 12 (2024)
Jeffrey Cheng, Marc Marone, Orion Weller, Dawn J. Lawrie, Daniel Khashabi, Benjamin Van Durme
Dated Data: Tracing Knowledge Cutoffs in Large Language Models. CoRR (2024)
Helia Hashemi, Jason Eisner, Corby Rosset, Benjamin Van Durme, Chris Kedzie
LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts. ACL (1) (2024)
Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, Young Jin Kim
Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation. CoRR (2024)
Siddharth Vashishtha, Alexander Martin, William Gantt, Benjamin Van Durme, Aaron Steven White
FAMuS: Frames Across Multiple Sources. NAACL-HLT (2024)
Abe Bohan Hou, Jingyu Zhang, Tianxing He, Yichen Wang, Yung-Sung Chuang, Hongwei Wang, Lingfeng Shen, Benjamin Van Durme, Daniel Khashabi, Yulia Tsvetkov
SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text Generation. NAACL-HLT (2024)
Orion Weller, Marc Marone, Nathaniel Weir, Dawn J. Lawrie, Daniel Khashabi, Benjamin Van Durme
"According to . . . ": Prompting Language Models Improves Quoting from Pre-Training Data. EACL (1) (2024)
Dongwei Jiang, Jingyu Zhang, Orion Weller, Nathaniel Weir, Benjamin Van Durme, Daniel Khashabi
SELF-[IN]CORRECT: LLMs Struggle with Refining Self-Generated Responses. CoRR (2024)
William Fleshman, Benjamin Van Durme
RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation. CoRR (2024)
Orion Weller, Dawn J. Lawrie, Benjamin Van Durme
NevIR: Negation in Neural Information Retrieval. EACL (1) (2024)
Zhengping Jiang, Yining Lu, Hanjie Chen, Daniel Khashabi, Benjamin Van Durme, Anqi Liu
RORA: Robust Free-Text Rationale Evaluation. CoRR (2024)
William Gantt, Shabnam Behzad, Hannah Youngeun An, Yunmo Chen, Aaron Steven White, Benjamin Van Durme, Mahsa Yarmohammadi
MultiMUC: Multilingual Template Filling on MUC-4. CoRR (2024)
Jingyu Zhang, Marc Marone, Tianjian Li, Benjamin Van Durme, Daniel Khashabi
Verifiable by Design: Aligning Language Models to Quote from Pre-Training Data. CoRR (2024)
Nathaniel Weir, Kate Sanders, Orion Weller, Shreya Sharma, Dongwei Jiang, Zhengping Jiang, Bhavana Dalvi Mishra, Oyvind Tafjord, Peter A. Jansen, Peter Clark, Benjamin Van Durme
Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic. CoRR (2024)
Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Benjamin Van Durme
Learning to Retrieve Iteratively for In-Context Learning. CoRR (2024)
Xinrui Zou, Ming Zhang, Nathaniel Weir, Benjamin Van Durme, Nils Holzenberger
Reframing Tax Law Entailment as Analogical Reasoning. CoRR (2024)
Orion Weller, Aleem Khan, Nathaniel Weir, Dawn J. Lawrie, Benjamin Van Durme
Defending Against Disinformation Attacks in Open-Domain Question Answering. EACL (2) (2024)
Sky CH-Wang, Benjamin Van Durme, Jason Eisner, Chris Kedzie
Do Androids Know They're Only Dreaming of Electric Sheep? ACL (Findings) (2024)
Yunmo Chen, William Gantt, Tongfei Chen, Aaron Steven White, Benjamin Van Durme
A Unified View of Evaluation Metrics for Structured Prediction. EMNLP (2023)
Elias Stengel-Eskin, Benjamin Van Durme
Did You Mean...? Confidence-based Trade-offs in Semantic Parsing. CoRR (2023)
Marc Marone, Benjamin Van Durme
Data Portraits: Recording Foundation Model Training Data. CoRR (2023)
Haoran Xu, Weiting Tan, Shuyue Stella Li, Yunmo Chen, Benjamin Van Durme, Philipp Koehn, Kenton Murray
Condensing Multilingual Knowledge with Lightweight Language-Specific Modules. EMNLP (2023)
Elias Stengel-Eskin, Kyle Rawlins, Benjamin Van Durme
Zero and Few-shot Semantic Parsing with Ambiguous Inputs. CoRR (2023)
Elias Stengel-Eskin, Benjamin Van Durme
Did You Mean...? Confidence-based Trade-offs in Semantic Parsing. EMNLP (2023)
Ishani Mondal, Michelle Yuan, Anandhavelu Natarajan, Aparna Garimella, Francis Ferraro, Andrew Blair-Stanek, Benjamin Van Durme, Jordan L. Boyd-Graber
InteractiveIE: Towards Assessing the Strength of Human-AI Collaboration in Improving the Performance of Information Extraction. CoRR (2023)
William Fleshman, Benjamin Van Durme
Toucan: Token-Aware Character Level Language Modeling. CoRR (2023)
Yunmo Chen, William Gantt, Weiwei Gu, Tongfei Chen, Aaron Steven White, Benjamin Van Durme
Iterative Document-level Information Extraction via Imitation Learning. EACL (2023)
Andrew Blair-Stanek, Nils Holzenberger, Benjamin Van Durme
BLT: Can Large Language Models Handle Basic Legal Text? CoRR (2023)
Sky CH-Wang, Benjamin Van Durme, Jason Eisner, Chris Kedzie
Do Androids Know They're Only Dreaming of Electric Sheep? CoRR (2023)
Haoran Xu, Weiting Tan, Shuyue Stella Li, Yunmo Chen, Benjamin Van Durme, Philipp Koehn, Kenton Murray
Condensing Multilingual Knowledge with Lightweight Language-Specific Modules. CoRR (2023)
Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Benjamin Van Durme
Natural Language Decomposition and Interpretation of Complex Utterances. CoRR (2023)
Nathaniel Weir, Xingdi Yuan, Marc-Alexandre Côté, Matthew J. Hausknecht, Romain Laroche, Ida Momennejad, Harm van Seijen, Benjamin Van Durme
One-Shot Learning from a Demonstration with Hierarchical Latent Language. AAMAS (2023)
Justin Payan, Swaroop Mishra, Mukul Singh, Carina Negreanu, Christian Pölitz, Chitta Baral, Subhro Roy, Rasika Chakravarthy, Benjamin Van Durme, Elnaz Nouri
InstructExcel: A Benchmark for Natural Language Instruction in Excel. CoRR (2023)
Kumar Shridhar, Harsh Jhamtani, Hao Fang, Benjamin Van Durme, Jason Eisner, Patrick Xia
SCREWS: A Modular Framework for Reasoning with Revisions. CoRR (2023)
Kangda Wei, Dawn J. Lawrie, Benjamin Van Durme, Yunmo Chen, Orion Weller
When Do Decompositions Help for Machine Reading? EMNLP (2023)
Boyuan Zheng, Patrick Xia, Mahsa Yarmohammadi, Benjamin Van Durme
Multilingual Coreference Resolution in Multiparty Dialogue. Trans. Assoc. Comput. Linguistics 11 (2023)
Kate Sanders, David Etter, Reno Kriz, Benjamin Van Durme
MultiVENT: Multilingual Videos of Events with Aligned Natural Text. CoRR (2023)
Dhruv Verma, Yash Kumar Lal, Shreyashee Sinha, Benjamin Van Durme, Adam Poliak
Evaluating Paraphrastic Robustness in Textual Entailment Models. ACL (2) (2023)
Orion Weller, Marc Marone, Nathaniel Weir, Dawn J. Lawrie, Daniel Khashabi, Benjamin Van Durme
"According to ..." Prompting Language Models Improves Quoting from Pre-Training Data. CoRR (2023)
Siddharth Vashishtha, Alexander Martin, William Gantt, Benjamin Van Durme, Aaron Steven White
FAMuS: Frames Across Multiple Sources. CoRR (2023)
Samuel Barham, Orion Weller, Michelle Yuan, Kenton Murray, Mahsa Yarmohammadi, Zhengping Jiang, Siddharth Vashishtha, Alexander Martin, Anqi Liu, Aaron Steven White, Jordan L. Boyd-Graber, Benjamin Van Durme
MegaWika: Millions of reports and their sources across 50 diverse languages. CoRR (2023)
Orion Weller, Dawn J. Lawrie, Benjamin Van Durme
NevIR: Negation in Neural Information Retrieval. CoRR (2023)
Nikita Moghe, Patrick Xia, Jacob Andreas, Jason Eisner, Benjamin Van Durme, Harsh Jhamtani
Interpreting User Requests in the Context of Natural Language Standing Instructions. CoRR (2023)
Kate Sanders, David Etter, Reno Kriz, Benjamin Van Durme
MultiVENT: Multilingual Videos of Events and Aligned Natural Text. NeurIPS (2023)
Guanghui Qin, Corby Rosset, Ethan C. Chau, Nikhil Rao, Benjamin Van Durme
Nugget 2D: Dynamic Contextual Compression for Scaling Decoder-only Language Models. CoRR (2023)
Elias Stengel-Eskin, Benjamin Van Durme
Calibrated Interpretation: Confidence Estimation in Semantic Parsing. Trans. Assoc. Comput. Linguistics 11 (2023)
Subhro Roy, Samuel Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Benjamin Van Durme
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing. NeurIPS (2023)
Yunmo Chen, William Gantt, Tongfei Chen, Aaron Steven White, Benjamin Van Durme
A Unified View of Evaluation Metrics for Structured Prediction. CoRR (2023)
Andrew Blair-Stanek, Nils Holzenberger, Benjamin Van Durme
OpenAI Cribbed Our Tax Example, But Can GPT-4 Really Do Tax? CoRR (2023)
Guanghui Qin, Benjamin Van Durme
Nugget: Neural Agglomerative Embeddings of Text. ICML (2023)
Orion Weller, Kyle Lo, David Wadden, Dawn J. Lawrie, Benjamin Van Durme, Arman Cohan, Luca Soldaini
When do Generative Query and Document Expansions Fail? A Comprehensive Study Across Methods, Retrievers, and Datasets. CoRR (2023)
Andrew Blair-Stanek, Nils Holzenberger, Benjamin Van Durme
Can GPT-3 Perform Statutory Reasoning? ICAIL (2023)
Dhruv Verma, Yash Kumar Lal, Shreyashee Sinha, Benjamin Van Durme, Adam Poliak
Evaluating Paraphrastic Robustness in Textual Entailment Models. CoRR (2023)
Andrew Blair-Stanek, Nils Holzenberger, Benjamin Van Durme
Can GPT-3 Perform Statutory Reasoning? CoRR (2023)
Marc Marone, Benjamin Van Durme
Data Portraits: Recording Foundation Model Training Data. NeurIPS (2023)
Weiting Tan, Haoran Xu, Lingfeng Shen, Shuyue Stella Li, Kenton Murray, Philipp Koehn, Benjamin Van Durme, Yunmo Chen
Narrowing the Gap between Zero- and Few-shot Machine Translation by Matching Styles. CoRR (2023)
Guanghui Qin, Benjamin Van Durme
Nugget: Neural Agglomerative Embeddings of Text. CoRR (2023)
Abe Bohan Hou, Jingyu Zhang, Tianxing He, Yichen Wang, Yung-Sung Chuang, Hongwei Wang, Lingfeng Shen, Benjamin Van Durme, Daniel Khashabi, Yulia Tsvetkov
SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text Generation. CoRR (2023)
Guanghui Qin, Yukun Feng, Benjamin Van Durme
The NLP Task Effectiveness of Long-Range Transformers. EACL (2023)
Zhuowan Li, Xingrui Wang, Elias Stengel-Eskin, Adam Kortylewski, Wufei Ma, Benjamin Van Durme, Alan L. Yuille
Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning. CVPR (2023)
Elias Stengel-Eskin, Jimena Guallar-Blasco, Yi Zhou, Benjamin Van Durme
Why Did the Chicken Cross the Road? Rephrasing and Analyzing Ambiguous Questions in VQA. ACL (1) (2023)
Justin Payan, Swaroop Mishra, Mukul Singh, Carina Negreanu, Christian Pölitz, Chitta Baral, Subhro Roy, Rasika Chakravarthy, Benjamin Van Durme, Elnaz Nouri
InstructExcel: A Benchmark for Natural Language Instruction in Excel. EMNLP (Findings) (2023)
Elias Stengel-Eskin, Benjamin Van Durme
The Curious Case of Control. EMNLP (2022)
Nils Holzenberger, Yunmo Chen, Benjamin Van Durme
Asking the Right Questions in Low Resource Template Extraction. CoRR (2022)
Kate Sanders, Reno Kriz, Anqi Liu, Benjamin Van Durme
Ambiguous Images With Human Judgments for Robust Visual Event Classification. CoRR (2022)
Boyuan Zheng, Patrick Xia, Mahsa Yarmohammadi, Benjamin Van Durme
Multilingual Coreference Resolution in Multiparty Dialogue. CoRR (2022)
Shijie Wu, Benjamin Van Durme, Mark Dredze
Zero-shot Cross-lingual Transfer is Under-specified Optimization. CoRR (2022)
Orion Weller, Marc Marone, Vladimir Braverman, Dawn J. Lawrie, Benjamin Van Durme
Pretrained Models for Multilingual Federated Learning. NAACL-HLT (2022)
Richard Shin, Benjamin Van Durme
Few-Shot Semantic Parsing with Language Models Trained on Code. NAACL-HLT (2022)
Elias Stengel-Eskin, Benjamin Van Durme
The Curious Case of Control. CoRR (2022)
Yukun Feng, Patrick Xia, Benjamin Van Durme, João Sedoc
Automatic Document Selection for Efficient Encoder Pretraining. CoRR (2022)
Zhengping Jiang, Anqi Liu, Benjamin Van Durme
Calibrating Zero-shot Cross-lingual (Un-)structured Predictions. EMNLP (2022)
Zhuowan Li, Xingrui Wang, Elias Stengel-Eskin, Adam Kortylewski, Wufei Ma, Benjamin Van Durme, Alan L. Yuille
Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning. CoRR (2022)
Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Benjamin Van Durme, Jason Eisner, Yu Su
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems. CoRR (2022)
Elias Stengel-Eskin, Jimena Guallar-Blasco, Yi Zhou, Benjamin Van Durme
Why Did the Chicken Cross the Road? Rephrasing and Analyzing Ambiguous Questions in VQA. CoRR (2022)
Shijie Wu, Benjamin Van Durme, Mark Dredze
Zero-shot Cross-lingual Transfer is Under-specified Optimization. RepL4NLP@ACL (2022)
Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Benjamin Van Durme, Jason Eisner, Yu Su
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems. EMNLP (2022)
Michelle Yuan, Patrick Xia, Chandler May, Benjamin Van Durme, Jordan L. Boyd-Graber
Adapting Coreference Resolution Models through Active Learning. ACL (1) (2022)
Kangda Wei, Dawn J. Lawrie, Benjamin Van Durme, Yunmo Chen, Orion Weller
When Do Decompositions Help for Machine Reading? CoRR (2022)
Andrew Blair-Stanek, Benjamin Van Durme
Improved Induction of Narrative Chains via Cross-Document Relations. *SEM@NAACL-HLT (2022)

Benjamin Van Durme.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Benjamin Van Durme