Allyson Ettinger

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 53

Top Topics

Vector Space Model

Pronoun Resolution

World Knowledge

Top Venues

Publications

Peter West, Ximing Lu, Nouha Dziri, Faeze Brahman, Linjie Li, Jena D. Hwang, Liwei Jiang, Jillian Fisher, Abhilasha Ravichander, Khyathi Raghavi Chandu, Benjamin Newman, Pang Wei Koh, Allyson Ettinger, Yejin Choi
The Generative AI Paradox: "What It Can Create, It May Not Understand". ICLR (2024)
Liwei Jiang, Kavel Rao, Seungju Han, Allyson Ettinger, Faeze Brahman, Sachin Kumar, Niloofar Mireshghallah, Ximing Lu, Maarten Sap, Yejin Choi, Nouha Dziri
WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models. CoRR (2024)
Kanishka Misra, Allyson Ettinger, Kyle Mahowald
Experimental Contexts Can Facilitate Robust Semantic Property Inference in Language Models, but Inconsistently. CoRR (2024)
Yanhong Li, Chenghao Yang, Allyson Ettinger
When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Models. CoRR (2024)
Seungju Han, Kavel Rao, Allyson Ettinger, Liwei Jiang, Bill Yuchen Lin, Nathan Lambert, Yejin Choi, Nouha Dziri
WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs. CoRR (2024)
Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Sean Welleck, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Xiang Ren, Allyson Ettinger, Zaïd Harchaoui, Yejin Choi
Faith and Fate: Limits of Transformers on Compositionality. NeurIPS (2023)
Jiaxuan Li, Lang Yu, Allyson Ettinger
Counterfactual reasoning: Testing language models' understanding of hypothetical scenarios. CoRR (2023)
Chenghao Yang, Allyson Ettinger
Can You Follow Me? Testing Situational Understanding in ChatGPT. CoRR (2023)
Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Sean Welleck, Xiang Ren, Allyson Ettinger, Zaïd Harchaoui, Yejin Choi
Faith and Fate: Limits of Transformers on Compositionality. CoRR (2023)
Jiaxuan Li, Lang Yu, Allyson Ettinger
Counterfactual reasoning: Testing language models' understanding of hypothetical scenarios. ACL (2) (2023)
Peter West, Ximing Lu, Nouha Dziri, Faeze Brahman, Linjie Li, Jena D. Hwang, Liwei Jiang, Jillian Fisher, Abhilasha Ravichander, Khyathi Chandu, Benjamin Newman, Pang Wei Koh, Allyson Ettinger, Yejin Choi
The Generative AI Paradox: "What It Can Create, It May Not Understand". CoRR (2023)
Chenghao Yang, Allyson Ettinger
Can You Follow Me? Testing Situational Understanding for ChatGPT. EMNLP (2023)
Kanishka Misra, Julia Rayz, Allyson Ettinger
COMPS: Conceptual Minimal Pair Sentences for testing Robust Property Knowledge and its Inheritance in Pre-trained Language Models. EACL (2023)
Allyson Ettinger, Jena D. Hwang, Valentina Pyatkin, Chandra Bhagavatula, Yejin Choi
"You Are An Expert Linguistic Annotator": Limits of LLMs as Analyzers of Abstract Meaning Representation. CoRR (2023)
Allyson Ettinger, Jena D. Hwang, Valentina Pyatkin, Chandra Bhagavatula, Yejin Choi
"You Are An Expert Linguistic Annotator": Limits of LLMs as Analyzers of Abstract Meaning Representation. EMNLP (Findings) (2023)
Raquel G. Alhama, Ruthe Foushee, Daniel Byrne, Allyson Ettinger, Susan Goldin-Meadow, Afra Alishahi
Linguistic Productivity: the Case of Determiners in English. IJCNLP (1) (2023)
Jiaxuan Li, Lang Yu, Allyson Ettinger
Counterfactual reasoning: Do language models need world knowledge for causal understanding? CoRR (2022)
Sanghee J. Kim, Lang Yu, Allyson Ettinger
"No, they did not": Dialogue response dynamics in pre-trained language models. CoRR (2022)
Kanishka Misra, Julia Rayz, Allyson Ettinger
A Property Induction Framework for Neural Language Models. CogSci (2022)
Kanishka Misra, Julia Taylor Rayz, Allyson Ettinger
A Property Induction Framework for Neural Language Models. CoRR (2022)
Kanishka Misra, Julia Taylor Rayz, Allyson Ettinger
COMPS: Conceptual Minimal Pair Sentences for testing Property Knowledge and Inheritance in Pre-trained Language Models. CoRR (2022)
Sanghee J. Kim, Lang Yu, Allyson Ettinger
"No, They Did Not": Dialogue Response Dynamics in Pre-trained Language Models. COLING (2022)
Lalchand Pandia, Yan Cong, Allyson Ettinger
Pragmatic competence of pre-trained language models through the lens of discourse connectives. CoNLL (2021)
Lalchand Pandia, Allyson Ettinger
Sorting through the noise: Testing robustness of information processing in pre-trained language models. EMNLP (1) (2021)
Lalchand Pandia, Yan Cong, Allyson Ettinger
Pragmatic competence of pre-trained language models through the lens of discourse connectives. CoRR (2021)
Lalchand Pandia, Allyson Ettinger
Sorting through the noise: Testing robustness of information processing in pre-trained language models. CoRR (2021)
Lang Yu, Allyson Ettinger
On the Interplay Between Fine-tuning and Composition in Transformers. CoRR (2021)
Qinxuan Wu, Allyson Ettinger
Variation and generality in encoding of syntactic anomaly information in sentence embeddings. CoRR (2021)
Kanishka Misra, Allyson Ettinger, Julia Taylor Rayz
Do language models learn typicality judgments from text? CoRR (2021)
Kanishka Misra, Allyson Ettinger, Julia Rayz
Do language models learn typicality judgments from text? CogSci (2021)
Qinxuan Wu, Allyson Ettinger
Variation and generality in encoding of syntactic anomaly information in sentence embeddings. BlackboxNLP@EMNLP (2021)
Lang Yu, Allyson Ettinger
On the Interplay Between Fine-tuning and Composition in Transformers. ACL/IJCNLP (Findings) (2021)
Shubham Toshniwal, Sam Wiseman, Allyson Ettinger, Karen Livescu, Kevin Gimpel
Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networks. CoRR (2020)
Allyson Ettinger
What BERT is Not: Lessons from a New Suite of Psycholinguistic Diagnostics for Language Models. Trans. Assoc. Comput. Linguistics 8 (2020)
Shubham Toshniwal, Allyson Ettinger, Kevin Gimpel, Karen Livescu
PeTra: A Sparsely Supervised Memory Model for People Tracking. CoRR (2020)
Shubham Toshniwal, Allyson Ettinger, Kevin Gimpel, Karen Livescu
PeTra: A Sparsely Supervised Memory Model for People Tracking. ACL (2020)
Josef Klafka, Allyson Ettinger
Spying on Your Neighbors: Fine-grained Probing of Contextual Embeddings for Information about Surrounding Words. ACL (2020)
Davis Yoshida, Allyson Ettinger, Kevin Gimpel
Adding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size. CoRR (2020)
Lang Yu, Allyson Ettinger
Assessing Phrasal Representation and Composition in Transformers. EMNLP (1) (2020)
Shubham Toshniwal, Sam Wiseman, Allyson Ettinger, Karen Livescu, Kevin Gimpel
Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networks. EMNLP (1) (2020)
Kanishka Misra, Allyson Ettinger, Julia Rayz
Exploring Lexical Relations in BERT using Semantic Priming. CogSci (2020)
Kanishka Misra, Allyson Ettinger, Julia Taylor Rayz
Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Priming. CoRR (2020)
Lang Yu, Allyson Ettinger
Assessing Phrasal Representation and Composition in Transformers. CoRR (2020)
Josef Klafka, Allyson Ettinger
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words. CoRR (2020)
Kanishka Misra, Allyson Ettinger, Julia Rayz
Exploring BERT's sensitivity to lexical cues using tests from semantic priming. EMNLP (Findings) (2020)
Allyson Ettinger
What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models. CoRR (2019)
Allyson Ettinger, Ahmed Elgohary, Colin Phillips, Philip Resnik
Assessing Composition in Sentence Vector Representations. COLING (2018)
Allyson Ettinger, Ahmed Elgohary, Colin Phillips, Philip Resnik
Assessing Composition in Sentence Vector Representations. CoRR (2018)
Allyson Ettinger, Sudha Rao, Hal Daumé III, Emily M. Bender
Towards Linguistically Generalizable NLP Systems: A Workshop and Shared Task. CoRR (2017)
Allyson Ettinger, Ahmed Elgohary, Philip Resnik
Probing for semantic evidence of composition by means of simple classification tasks. RepEval@ACL (2016)
Allyson Ettinger, Tal Linzen
Evaluating vector space models using human semantic priming results. RepEval@ACL (2016)
Allyson Ettinger, Philip Resnik, Marine Carpuat
Retrofitting Sense-Specific Word Vectors Using Parallel Text. HLT-NAACL (2016)
Allyson Ettinger, Naomi Feldman, Philip Resnik, Colin Phillips
Modeling N400 amplitude using vector space models of word representation. CogSci (2016)
Sudha Rao, Allyson Ettinger, Hal Daumé III, Philip Resnik
Dialogue focus tracking for zero pronoun resolution. HLT-NAACL (2015)