Oyvind Tafjord

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 65

Top Topics

Implicit Knowledge

Question Answering

Multiple Choice

Top Venues

Publications

Yuling Gu, Oyvind Tafjord, Peter Clark
Digital Socrates: Evaluating LLMs through Explanation Critiques. ACL (1) (2024)
Peter A. Jansen, Marc-Alexandre Côté, Tushar Khot, Erin Bransom, Bhavana Dalvi Mishra, Bodhisattwa Prasad Majumder, Oyvind Tafjord, Peter Clark
DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents. CoRR (2024)
Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
OLMo: Accelerating the Science of Language Models. CoRR (2024)
Yuling Gu, Oyvind Tafjord, Bailey Kuehl, Dany Haddad, Jesse Dodge, Hannaneh Hajishirzi
OLMES: A Standard for Language Model Evaluations. CoRR (2024)
Neset Özkan Tan, Niket Tandon, David Wadden, Oyvind Tafjord, Mark Gahegan, Michael Witbrock
Faithful Reasoning over Scientific Claims. AAAI Spring Symposia (2024)
Sarah Wiegreffe, Oyvind Tafjord, Yonatan Belinkov, Hannaneh Hajishirzi, Ashish Sabharwal
Answer, Assemble, Ace: Understanding How Transformers Answer Multiple Choice Questions. CoRR (2024)
Nathaniel Weir, Kate Sanders, Orion Weller, Shreya Sharma, Dongwei Jiang, Zhengping Jiang, Bhavana Dalvi Mishra, Oyvind Tafjord, Peter A. Jansen, Peter Clark, Benjamin Van Durme
Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic. CoRR (2024)
Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research. CoRR (2024)
Sarah Wiegreffe, Matthew Finlayson, Oyvind Tafjord, Peter Clark, Ashish Sabharwal
Increasing Probability Mass on Answer Choices Does Not Always Improve Accuracy. EMNLP (2023)
Yuling Gu, Oyvind Tafjord, Peter Clark
Digital Socrates: Evaluating LLMs through explanation critiques. CoRR (2023)
Dirk Groeneveld, Anas Awadalla, Iz Beltagy, Akshita Bhagia, Ian Magnusson, Hao Peng, Oyvind Tafjord, Pete Walsh, Kyle Richardson, Jesse Dodge
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets. CoRR (2023)
Nora Kassner, Oyvind Tafjord, Ashish Sabharwal, Kyle Richardson, Hinrich Schütze, Peter Clark
Language Models with Rationality. EMNLP (2023)
Nora Kassner, Oyvind Tafjord, Ashish Sabharwal, Kyle Richardson, Hinrich Schütze, Peter Clark
Language Models with Rationality. CoRR (2023)
Bodhisattwa Prasad Majumder, Bhavana Dalvi Mishra, Peter A. Jansen, Oyvind Tafjord, Niket Tandon, Li Zhang, Chris Callison-Burch, Peter Clark
CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalization. CoRR (2023)
Ian Magnusson, Akshita Bhagia, Valentin Hofmann, Luca Soldaini, Ananya Harsh Jha, Oyvind Tafjord, Dustin Schwenk, Evan Pete Walsh, Yanai Elazar, Kyle Lo, Dirk Groeneveld, Iz Beltagy, Hannaneh Hajishirzi, Noah A. Smith, Kyle Richardson, Jesse Dodge
Paloma: A Benchmark for Evaluating Language Model Fit. CoRR (2023)
Peter Clark, Bhavana Dalvi Mishra, Oyvind Tafjord
BaRDa: A Belief and Reasoning Dataset that Separates Factual Accuracy and Reasoning Ability. CoRR (2023)
Sarah Wiegreffe, Matthew Finlayson, Oyvind Tafjord, Peter Clark, Ashish Sabharwal
Attentiveness to Answer Choices Doesn't Always Entail High QA Accuracy. CoRR (2023)
Swaroop Mishra, Matthew Finlayson, Pan Lu, Leonard Tang, Sean Welleck, Chitta Baral, Tanmay Rajpurohit, Oyvind Tafjord, Ashish Sabharwal, Peter Clark, Ashwin Kalyan
LILA: A Unified Benchmark for Mathematical Reasoning. EMNLP (2022)
Oyvind Tafjord, Bhavana Dalvi Mishra, Peter Clark
Entailer: Answering Questions with Faithful and Truthful Chains of Reasoning. CoRR (2022)
Bhavana Dalvi, Oyvind Tafjord, Peter Clark
Towards Teachable Reasoning Systems. CoRR (2022)
Pan Lu, Swaroop Mishra, Tanglin Xia, Liang Qiu, Kai-Wei Chang, Song-Chun Zhu, Oyvind Tafjord, Peter Clark, Ashwin Kalyan
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering. NeurIPS (2022)
Bhavana Dalvi Mishra, Oyvind Tafjord, Peter Clark
Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvement. EMNLP (2022)
Oyvind Tafjord, Bhavana Dalvi Mishra, Peter Clark
Entailer: Answering Questions with Faithful and Truthful Chains of Reasoning. EMNLP (2022)
Pan Lu, Swaroop Mishra, Tony Xia, Liang Qiu, Kai-Wei Chang, Song-Chun Zhu, Oyvind Tafjord, Peter Clark, Ashwin Kalyan
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering. CoRR (2022)
Swaroop Mishra, Matthew Finlayson, Pan Lu, Leonard Tang, Sean Welleck, Chitta Baral, Tanmay Rajpurohit, Oyvind Tafjord, Ashish Sabharwal, Peter Clark, Ashwin Kalyan
Lila: A Unified Benchmark for Mathematical Reasoning. CoRR (2022)
Faeze Brahman, Meng Huang, Oyvind Tafjord, Chao Zhao, Mrinmaya Sachan, Snigdha Chaturvedi
"Let Your Characters Tell Their Story": A Dataset for Character-Centric Narrative Understanding. EMNLP (Findings) (2021)
Nora Kassner, Oyvind Tafjord, Hinrich Schütze, Peter Clark
BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief. EMNLP (1) (2021)
Sumithra Bhakthavatsalam, Daniel Khashabi, Tushar Khot, Bhavana Dalvi Mishra, Kyle Richardson, Ashish Sabharwal, Carissa Schoenick, Oyvind Tafjord, Peter Clark
Think you have Solved Direct-Answer Question Answering? Try ARC-DA, the Direct-Answer AI2 Reasoning Challenge. CoRR (2021)
Nora Kassner, Oyvind Tafjord, Hinrich Schütze, Peter Clark
BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief. CoRR (2021)
Bhavana Dalvi, Peter Jansen, Oyvind Tafjord, Zhengnan Xie, Hannah Smith, Leighanna Pipatanangkura, Peter Clark
Explaining Answers with Entailment Trees. CoRR (2021)
Oyvind Tafjord, Bhavana Dalvi, Peter Clark
ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language. ACL/IJCNLP (Findings) (2021)
Faeze Brahman, Meng Huang, Oyvind Tafjord, Chao Zhao, Mrinmaya Sachan, Snigdha Chaturvedi
"Let Your Characters Tell Their Story": A Dataset for Character-Centric Narrative Understanding. CoRR (2021)
Bhavana Dalvi, Peter Jansen, Oyvind Tafjord, Zhengnan Xie, Hannah Smith, Leighanna Pipatanangkura, Peter Clark
Explaining Answers with Entailment Trees. EMNLP (1) (2021)
Oyvind Tafjord, Peter Clark
General-Purpose Question-Answering with Macaw. CoRR (2021)
Nora Kassner, Oyvind Tafjord, Hinrich Schütze, Peter Clark
Enriching a Model's Notion of Belief using a Persistent Memory. CoRR (2021)
Alon Talmor, Oyvind Tafjord, Peter Clark, Yoav Goldberg, Jonathan Berant
Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge. NeurIPS (2020)
Daniel Khashabi, Tushar Khot, Ashish Sabharwal, Oyvind Tafjord, Peter Clark, Hannaneh Hajishirzi
UnifiedQA: Crossing Format Boundaries With a Single QA System. CoRR (2020)
Alon Talmor, Oyvind Tafjord, Peter Clark, Yoav Goldberg, Jonathan Berant
Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge. CoRR (2020)
Lucy Lu Wang, Oyvind Tafjord, Arman Cohan, Sarthak Jain, Sam Skjonsberg, Carissa Schoenick, Nick Botner, Waleed Ammar
SUPP.AI: finding evidence for supplement-drug interactions. ACL (demo) (2020)
Peter Clark, Oyvind Tafjord, Kyle Richardson
Transformers as Soft Reasoners over Language. IJCAI (2020)
Vered Shwartz, Rachel Rudinger, Oyvind Tafjord
"You are grounded!": Latent Name Artifacts in Pre-trained Language Models. EMNLP (1) (2020)
Peter Clark, Oyvind Tafjord, Kyle Richardson
Transformers as Soft Reasoners over Language. CoRR (2020)
Oyvind Tafjord, Bhavana Dalvi Mishra, Peter Clark
ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language. CoRR (2020)
Vered Shwartz, Rachel Rudinger, Oyvind Tafjord
"You are grounded!": Latent Name Artifacts in Pre-trained Language Models. CoRR (2020)
Peter Clark, Oren Etzioni, Tushar Khot, Daniel Khashabi, Bhavana Dalvi Mishra, Kyle Richardson, Ashish Sabharwal, Carissa Schoenick, Oyvind Tafjord, Niket Tandon, Sumithra Bhakthavatsalam, Dirk Groeneveld, Michal Guerquin, Michael Schmitz
From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Project. AI Mag. 41 (4) (2020)
Dongfang Xu, Peter A. Jansen, Jaycie Martin, Zhengnan Xie, Vikas Yadav, Harish Tayyar Madabushi, Oyvind Tafjord, Peter Clark
Multi-class Hierarchical Question Classification for Multiple Choice Science Exams. LREC (2020)
Daniel Khashabi, Sewon Min, Tushar Khot, Ashish Sabharwal, Oyvind Tafjord, Peter Clark, Hannaneh Hajishirzi
UnifiedQA: Crossing Format Boundaries With a Single QA System. EMNLP (Findings) (2020)
Oyvind Tafjord, Matt Gardner, Kevin Lin, Peter Clark
QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions. CoRR (2019)
Lucy Lu Wang, Oyvind Tafjord, Sarthak Jain, Arman Cohan, Sam Skjonsberg, Carissa Schoenick, Nick Botner, Waleed Ammar
Extracting evidence of supplement-drug interactions from literature. CoRR (2019)
Oyvind Tafjord, Peter Clark, Matt Gardner, Wen-tau Yih, Ashish Sabharwal
QUAREL: A Dataset and Models for Answering Questions about Qualitative Relationships. AAAI (2019)
Arindam Mitra, Peter Clark, Oyvind Tafjord, Chitta Baral
Declarative Question Answering over Knowledge Bases Containing Natural Language Text with Answer Set Programming. AAAI (2019)
Kevin Lin, Oyvind Tafjord, Peter Clark, Matt Gardner
Reasoning Over Paragraph Effects in Situations. CoRR (2019)
Dongfang Xu, Peter A. Jansen, Jaycie Martin, Zhengnan Xie, Vikas Yadav, Harish Tayyar Madabushi, Oyvind Tafjord, Peter Clark
Multi-class Hierarchical Question Classification for Multiple Choice Science Exams. CoRR (2019)
Oyvind Tafjord, Matt Gardner, Kevin Lin, Peter Clark
QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions. EMNLP/IJCNLP (1) (2019)
Arindam Mitra, Peter Clark, Oyvind Tafjord, Chitta Baral
Declarative Question Answering over Knowledge Bases containing Natural Language Text with Answer Set Programming. CoRR (2019)
Peter Clark, Oren Etzioni, Daniel Khashabi, Tushar Khot, Bhavana Dalvi Mishra, Kyle Richardson, Ashish Sabharwal, Carissa Schoenick, Oyvind Tafjord, Niket Tandon, Sumithra Bhakthavatsalam, Dirk Groeneveld, Michal Guerquin, Michael Schmitz
From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Project. CoRR (2019)
Kevin Lin, Oyvind Tafjord, Peter Clark, Matt Gardner
Reasoning Over Paragraph Effects in Situations. MRQA@EMNLP (2019)
Oyvind Tafjord, Peter Clark, Matt Gardner, Wen-tau Yih, Ashish Sabharwal
QuaRel: A Dataset and Models for Answering Questions about Qualitative Relationships. CoRR (2018)
Matt Gardner, Joel Grus, Mark Neumann, Oyvind Tafjord, Pradeep Dasigi, Nelson F. Liu, Matthew E. Peters, Michael Schmitz, Luke Zettlemoyer
AllenNLP: A Deep Semantic Natural Language Processing Platform. CoRR (2018)
Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, Oyvind Tafjord
Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge. CoRR (2018)
Carissa Schoenick, Peter Clark, Oyvind Tafjord, Peter D. Turney, Oren Etzioni
Moving beyond the Turing Test with the Allen AI Science Challenge. Commun. ACM 60 (9) (2017)
Jayant Krishnamurthy, Oyvind Tafjord
Semantic Parsing to Probabilistic Programs for Situated Question Answering. CoRR (2016)
Jayant Krishnamurthy, Oyvind Tafjord, Aniruddha Kembhavi
Semantic Parsing to Probabilistic Programs for Situated Question Answering. EMNLP (2016)
Peter Clark, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Oyvind Tafjord, Peter D. Turney, Daniel Khashabi
Combining Retrieval, Statistics, and Inference to Answer Elementary Science Questions. AAAI (2016)
Carissa Schoenick, Peter Clark, Oyvind Tafjord, Peter D. Turney, Oren Etzioni
Moving Beyond the Turing Test with the Allen AI Science Challenge. CoRR (2016)