Adina Williams

Publication Activity (10 Years)

Years Active: 2017-2023
Publications (10 Years): 88

Top Topics

Natural Language

Formal Languages

Top Venues

Publications

David Esiobu, Xiaoqing Ellen Tan, Saghar Hosseini, Megan Ung, Yuchen Zhang, Jude Fernandes, Jane Dwivedi-Yu, Eleonora Presani, Adina Williams, Eric Michael Smith
ROBBIE: Robust Bias Evaluation of Large Generative Language Models. EMNLP (2023)
Melissa Hall, Candace Ross, Adina Williams, Nicolas Carion, Michal Drozdzal, Adriana Romero-Soriano
DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversity. CoRR (2023)
Saeed Goodarzi, Nikhil Kagita, Dennis Minn, Shufan Wang, Roberto Dessì, Shubham Toshniwal, Adina Williams, Jack Lanchantin, Koustuv Sinha
Robustness of Named-Entity Replacements for In-Context Learning. EMNLP (Findings) (2023)
Alex Warstadt, Leshem Choshen, Aaron Mueller, Adina Williams, Ethan Wilcox, Chengxu Zhuang
Call for Papers - The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus. CoRR (2023)
Benjamin Muller, Belen Alastruey, Prangthip Hansanti, Elahe Kalbassi, Christophe Ropers, Eric Michael Smith, Adina Williams, Luke Zettlemoyer, Pierre Andrews, Marta R. Costa-jussà
The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages. CoRR (2023)
Kaiser Sun, Adina Williams, Dieuwke Hupkes
The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks. CoRR (2023)
Karolina Stanczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, Isabelle Augenstein
A Latent-Variable Model for Intrinsic Probing. AAAI (2023)
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton-Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurélien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom
Llama 2: Open Foundation and Fine-Tuned Chat Models. CoRR (2023)
Koustuv Sinha, Jon Gauthier, Aaron Mueller, Kanishka Misra, Keren Fuentes, Roger Levy, Adina Williams
Language model acceptability judgements are not always robust to context. ACL (1) (2023)
Mark Mazumder, Colby R. Banbury, Xiaozhe Yao, Bojan Karlas, William Gaviria Rojas, Sudnya Frederick Diamos, Greg Diamos, Lynn He, Alicia Parrish, Hannah Rose Kirk, Jessica Quaye, Charvi Rastogi, Douwe Kiela, David Jurado, David Kanter, Rafael Mosquera, Will Cukierski, Juan Ciro, Lora Aroyo, Bilge Acun, Lingjiao Chen, Mehul Raje, Max Bartolo, Evan Sabri Eyuboglu, Amirata Ghorbani, Emmett D. Goodman, Addison Howard, Oana Inel, Tariq Kane, Christine R. Kirkpatrick, D. Sculley, Tzu-Sheng Kuo, Jonas W. Mueller, Tristan Thrush, Joaquin Vanschoren, Margaret Warren, Adina Williams, Serena Yeung, Newsha Ardalani, Praveen K. Paritosh, Ce Zhang, James Y. Zou, Carole-Jean Wu, Cody Coleman, Andrew Y. Ng, Peter Mattson, Vijay Janapa Reddi
DataPerf: Benchmarks for Data-Centric AI Development. NeurIPS (2023)
Arjun Subramonian, Adina Williams, Maximilian Nickel, Yizhou Sun, Levent Sagun
Weisfeiler and Lehman Go Measurement Modeling: Probing the Validity of the WL Test. CoRR (2023)
Kaiser Sun, Adina Williams, Dieuwke Hupkes
The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks. CoNLL (2023)
Benjamin Muller, Belen Alastruey, Prangthip Hansanti, Elahe Kalbassi, Christophe Ropers, Eric Smith, Adina Williams, Luke Zettlemoyer, Pierre Andrews, Marta R. Costa-jussà
The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages. WMT (2023)
David Esiobu, Xiaoqing Ellen Tan, Saghar Hosseini, Megan Ung, Yuchen Zhang, Jude Fernandes, Jane Dwivedi-Yu, Eleonora Presani, Adina Williams, Eric Michael Smith
ROBBIE: Robust Bias Evaluation of Large Generative Language Models. CoRR (2023)
Maureen de Seyssel, Antony D'Avirro, Adina Williams, Emmanuel Dupoux
EmphAssess : a Prosodic Benchmark on Assessing Emphasis Transfer in Speech-to-Speech Models. CoRR (2023)
Karolina Stanczak, Kevin Du, Adina Williams, Isabelle Augenstein, Ryan Cotterell
Grammatical Gender's Influence on Distributional Semantics: A Causal Perspective. CoRR (2023)
Eric Michael Smith, Melissa Hall, Melanie Kambadur, Eleonora Presani, Adina Williams
"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Dataset. EMNLP (2022)
Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks. ACL (demo) (2022)
Josef Valvoda, Naomi Saphra, Jonathan Rawski, Ryan Cotterell, Adina Williams
Learning Transductions to Test Systematic Compositionality. CoRR (2022)
Adi Renduchintala, Adina Williams
Investigating Failures of Automatic Translationin the Case of Unambiguous Gender. ACL (1) (2022)
Eric Michael Smith, Melissa Hall, Melanie Kambadur, Eleonora Presani, Adina Williams
"I'm sorry to hear that": finding bias in language models with a holistic descriptor dataset. CoRR (2022)
Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality. CVPR (2022)
Eric Wallace, Adina Williams, Robin Jia, Douwe Kiela
Analyzing Dynamic Adversarial Training Data in the Limit. ACL (Findings) (2022)
Rebecca Qian, Candace Ross, Jude Fernandes, Eric Michael Smith, Douwe Kiela, Adina Williams
Perturbation Augmentation for Fairer NLP. EMNLP (2022)
Koustuv Sinha, Amirhossein Kazemnejad, Siva Reddy, Joelle Pineau, Dieuwke Hupkes, Adina Williams
The Curious Case of Absolute Position Embeddings. EMNLP (Findings) (2022)
Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, Adina Williams
On the Machine Learning of Ethical Judgments from Natural Language. NAACL-HLT (2022)
Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality. CoRR (2022)
Mark Mazumder, Colby R. Banbury, Xiaozhe Yao, Bojan Karlas, William Gaviria Rojas, Sudnya Frederick Diamos, Greg Diamos, Lynn He, Douwe Kiela, David Jurado, David Kanter, Rafael Mosquera, Juan Ciro, Lora Aroyo, Bilge Acun, Sabri Eyuboglu, Amirata Ghorbani, Emmett D. Goodman, Tariq Kane, Christine R. Kirkpatrick, Tzu-Sheng Kuo, Jonas Mueller, Tristan Thrush, Joaquin Vanschoren, Margaret Warren, Adina Williams, Serena Yeung, Newsha Ardalani, Praveen K. Paritosh, Ce Zhang, James Zou, Carole-Jean Wu, Cody Coleman, Andrew Y. Ng, Peter Mattson, Vijay Janapa Reddi
DataPerf: Benchmarks for Data-Centric AI Development. CoRR (2022)
Rebecca Qian, Candace Ross, Jude Fernandes, Eric Michael Smith, Douwe Kiela, Adina Williams
Perturbation Augmentation for Fairer NLP. CoRR (2022)
Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks. CoRR (2022)
Josef Valvoda, Naomi Saphra, Jonathan Rawski, Adina Williams, Ryan Cotterell
Benchmarking Compositionality with Formal Languages. COLING (2022)
Koustuv Sinha, Jon Gauthier, Aaron Mueller, Kanishka Misra, Keren Fuentes, Roger Levy, Adina Williams
Language model acceptability judgements are not always robust to context. CoRR (2022)
Koustuv Sinha, Amirhossein Kazemnejad, Siva Reddy, Joelle Pineau, Dieuwke Hupkes, Adina Williams
The Curious Case of Absolute Position Embeddings. CoRR (2022)
Karolina Stanczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, Isabelle Augenstein
A Latent-Variable Model for Intrinsic Probing. CoRR (2022)
Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, Douwe Kiela
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little. CoRR (2021)
Grusha Prasad, Yixin Nie, Mohit Bansal, Robin Jia, Douwe Kiela, Adina Williams
To what extent do human explanations of model behavior align with actual model behavior? BlackboxNLP@EMNLP (2021)
Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, Adina Williams
Dynabench: Rethinking Benchmarking in NLP. NAACL-HLT (2021)
Zhiyi Ma, Kawin Ethayarajh, Tristan Thrush, Somya Jain, Ledell Wu, Robin Jia, Christopher Potts, Adina Williams, Douwe Kiela
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking. NeurIPS (2021)
Adithya Renduchintala, Adina Williams
Investigating Failures of Automatic Translation in the Case of Unambiguous Gender. CoRR (2021)
Eric Wallace, Adina Williams, Robin Jia, Douwe Kiela
Analyzing Dynamic Adversarial Training Data in the Limit. CoRR (2021)
Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, Douwe Kiela
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little. EMNLP (1) (2021)
Adina Williams, Lawrence Wolf-Sonkin, Damián E. Blasi, Hanna M. Wallach, Ryan Cotterell
On the Relationships Between the Grammatical Genders of Inanimate Nouns and Their Co-Occurring Adjectives and Verbs. Trans. Assoc. Comput. Linguistics 9 (2021)
Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, Adina Williams
Dynabench: Rethinking Benchmarking in NLP. CoRR (2021)
Zhiyi Ma, Kawin Ethayarajh, Tristan Thrush, Somya Jain, Ledell Wu, Robin Jia, Christopher Potts, Adina Williams, Douwe Kiela
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking. CoRR (2021)
Prasanna Parthasarathi, Koustuv Sinha, Joelle Pineau, Adina Williams
Sometimes We Want Translationese. CoRR (2021)
Eric Michael Smith, Adina Williams
Hi, my name is Martha: Using names to measure and mitigate bias in generative dialogue models. CoRR (2021)
Verna Dankers, Anna Langedijk, Kate McCurdy, Adina Williams, Dieuwke Hupkes
Generalising to German Plural Noun Classes, from the Perspective of a Recurrent Neural Network. CoNLL (2021)
Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams
UnNatural Language Inference. ACL/IJCNLP (1) (2021)
Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, Adina Williams
A Word on Machine Ethics: A Response to Jiang et al. (2021). CoRR (2021)
Prasanna Parthasarathi, Koustuv Sinha, Joelle Pineau, Adina Williams
Sometimes We Want Ungrammatical Translations. EMNLP (Findings) (2021)
Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams
Unnatural Language Inference. CoRR (2021)
Tiago Pimentel, Josef Valvoda, Rowan Hall Maudslay, Ran Zmigrod, Adina Williams, Ryan Cotterell
Information-Theoretic Probing for Linguistic Structure. CoRR (2020)
Ekaterina Vylomova, Jennifer C. White, Elizabeth Salesky, Sabrina J. Mielke, Shijie Wu, Edoardo Maria Ponti, Rowan Hall Maudslay, Ran Zmigrod, Josef Valvoda, Svetlana Toldova, Francis M. Tyers, Elena Klyachko, Ilya Yegorov, Natalia Krizhanovsky, Paula Czarnowska, Irene Nikkarinen, Andrew Krizhanovsky, Tiago Pimentel, Lucas Torroba Hennigen, Christo Kirov, Garrett Nicolai, Adina Williams, Antonios Anastasopoulos, Hilaria Cruz, Eleanor Chodroff, Ryan Cotterell, Miikka Silfverberg, Mans Hulden
SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection. CoRR (2020)
Paloma Jeretic, Alex Warstadt, Suvrat Bhooshan, Adina Williams
Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition. ACL (2020)
Rowan Hall Maudslay, Josef Valvoda, Tiago Pimentel, Adina Williams, Ryan Cotterell
A Tale of a Probe and a Parser. CoRR (2020)
Tiago Pimentel, Naomi Saphra, Adina Williams, Ryan Cotterell
Pareto Probing: Trading Off Accuracy for Complexity. EMNLP (1) (2020)
Adina Williams, Ryan Cotterell, Lawrence Wolf-Sonkin, Damián E. Blasi, Hanna M. Wallach
On the Relationships Between the Grammatical Genders of Inanimate Nouns and Their Co-Occurring Adjectives and Verbs. CoRR (2020)
Tiago Pimentel, Naomi Saphra, Adina Williams, Ryan Cotterell
Pareto Probing: Trading Off Accuracy for Complexity. CoRR (2020)
Adina Williams, Tiago Pimentel, Hagen Blix, Arya D. McCarthy, Eleanor Chodroff, Ryan Cotterell
Predicting Declension Class from Form and Meaning. ACL (2020)
Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell
Intrinsic Probing through Dimension Selection. CoRR (2020)
Rowan Hall Maudslay, Josef Valvoda, Tiago Pimentel, Adina Williams, Ryan Cotterell
A Tale of a Probe and a Parser. ACL (2020)
Paloma Jeretic, Alex Warstadt, Suvrat Bhooshan, Adina Williams
Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition. CoRR (2020)
Ekaterina Vylomova, Jennifer C. White, Elizabeth Salesky, Sabrina J. Mielke, Shijie Wu, Edoardo Maria Ponti, Rowan Hall Maudslay, Ran Zmigrod, Josef Valvoda, Svetlana Toldova, Francis M. Tyers, Elena Klyachko, Ilya Yegorov, Natalia Krizhanovsky, Paula Czarnowska, Irene Nikkarinen, Andrew Krizhanovsky, Tiago Pimentel, Lucas Torroba Hennigen, Christo Kirov, Garrett Nicolai, Adina Williams, Antonios Anastasopoulos, Hilaria Cruz, Eleanor Chodroff, Ryan Cotterell, Miikka Silfverberg, Mans Hulden
SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection. SIGMORPHON (2020)
Adina Williams, Tiago Pimentel, Arya D. McCarthy, Hagen Blix, Eleanor Chodroff, Ryan Cotterell
Predicting Declension Class from Form and Meaning. CoRR (2020)
Arya D. McCarthy, Adina Williams, Shijia Liu, David Yarowsky, Ryan Cotterell
Measuring the Similarity of Grammatical Gender Systems by Comparing Partitions. EMNLP (1) (2020)
Emily Dinan, Angela Fan, Adina Williams, Jack Urbanek, Douwe Kiela, Jason Weston
Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation. EMNLP (1) (2020)
Emily Dinan, Angela Fan, Ledell Wu, Jason Weston, Douwe Kiela, Adina Williams
Multi-Dimensional Gender Bias Classification. EMNLP (1) (2020)
Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell
Intrinsic Probing through Dimension Selection. EMNLP (1) (2020)
Adina Williams, Tristan Thrush, Douwe Kiela
ANLIzing the Adversarial Natural Language Inference Dataset. CoRR (2020)
Tiago Pimentel, Josef Valvoda, Rowan Hall Maudslay, Ran Zmigrod, Adina Williams, Ryan Cotterell
Information-Theoretic Probing for Linguistic Structure. ACL (2020)
Yixin Nie, Adina Williams, Emily Dinan, Mohit Bansal, Jason Weston, Douwe Kiela
Adversarial NLI: A New Benchmark for Natural Language Understanding. ACL (2020)
Grusha Prasad, Yixin Nie, Mohit Bansal, Robin Jia, Douwe Kiela, Adina Williams
To what extent do human explanations of model behavior align with actual model behavior? CoRR (2020)
Emily Dinan, Angela Fan, Ledell Wu, Jason Weston, Douwe Kiela, Adina Williams
Multi-Dimensional Gender Bias Classification. CoRR (2020)
Shijia Liu, Hongyuan Mei, Adina Williams, Ryan Cotterell
On the Idiosyncrasies of the Mandarin Chinese Classifier System. NAACL-HLT (1) (2019)
Adina Williams, Damián E. Blasi, Lawrence Wolf-Sonkin, Hanna M. Wallach, Ryan Cotterell
Quantifying the Semantic Core of Gender Systems. EMNLP/IJCNLP (1) (2019)
Yixin Nie, Adina Williams, Emily Dinan, Mohit Bansal, Jason Weston, Douwe Kiela
Adversarial NLI: A New Benchmark for Natural Language Understanding. CoRR (2019)
Adina Williams, Ryan Cotterell, Lawrence Wolf-Sonkin, Damián E. Blasi, Hanna M. Wallach
Quantifying the Semantic Core of Gender Systems. CoRR (2019)
Shijia Liu, Adina Williams, Hongyuan Mei, Ryan Cotterell
On the Idiosyncrasies of the Mandarin Chinese Classifier System. CoRR (2019)
Emily Dinan, Angela Fan, Adina Williams, Jack Urbanek, Douwe Kiela, Jason Weston
Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation. CoRR (2019)
Adina Williams, Andrew Drozdov, Samuel R. Bowman
Do latent tree learning models identify meaningful structure in sentences? Trans. Assoc. Comput. Linguistics 6 (2018)
Alexis Conneau, Guillaume Lample, Ruty Rinott, Adina Williams, Samuel R. Bowman, Holger Schwenk, Veselin Stoyanov
XNLI: Evaluating Cross-lingual Sentence Representations. CoRR (2018)
Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel R. Bowman, Holger Schwenk, Veselin Stoyanov
XNLI: Evaluating Cross-lingual Sentence Representations. EMNLP (2018)
Katharina Kann, Alex Warstadt, Adina Williams, Samuel R. Bowman
Verb Argument Structure Alternations in Word and Sentence Embeddings. CoRR (2018)
Adina Williams, Nikita Nangia, Samuel R. Bowman
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference. NAACL-HLT (2018)
Nikita Nangia, Adina Williams, Angeliki Lazaridou, Samuel R. Bowman
The RepEval 2017 Shared Task: Multi-Genre Natural Language Inference with Sentence Representations. CoRR (2017)
Adina Williams, Nikita Nangia, Samuel R. Bowman
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference. CoRR (2017)
Adina Williams, Andrew Drozdov, Samuel R. Bowman
Learning to parse from a semantic objective: It works. Is it syntax? CoRR (2017)
Nikita Nangia, Adina Williams, Angeliki Lazaridou, Samuel R. Bowman
The RepEval 2017 Shared Task: Multi-Genre Natural Language Inference with Sentence Representations. RepEval@EMNLP (2017)