Ryan Cotterell

ORCID

Publication Activity (10 Years)

Years Active: 2014-2024
Publications (10 Years): 371

Top Venues

CoRR

ACL (1)

EMNLP

Trans. Assoc. Comput. Linguistics

Publications

Anej Svete, Robin Chan, Ryan Cotterell
On Efficiently Representing Regular Languages as RNNs. ACL (Findings) (2024)
Anej Svete, Ryan Cotterell
-gram Language Models. CoRR (2024)
Josef Valvoda, Ryan Cotterell
Towards Explainability in Legal Outcome Prediction Models. CoRR (2024)
Anej Svete, Franz Nowak, Anisha Mohamed Sahabdeen, Ryan Cotterell
Lower Bounds on the Expressivity of Recurrent Neural Language Models. NAACL-HLT (2024)
Kevin Du, Vésteinn Snæbjarnarson, Niklas Stoehr, Jennifer C. White, Aaron Schein, Ryan Cotterell
Context versus Prior Knowledge in Language Models. ACL (1) (2024)
Afra Amini, Tim Vieira, Ryan Cotterell
Direct Preference Optimization with an Offset. ACL (Findings) (2024)
Luca Malagutti, Andrius Buinovskij, Anej Svete, Clara Meister, Afra Amini, Ryan Cotterell
The Role of n-gram Smoothing in the Age of Neural Networks. CoRR (2024)
Jiaoda Li, Yifan Hou, Mrinmaya Sachan, Ryan Cotterell
What Do Language Models Learn in Context? The Structured Task Hypothesis. CoRR (2024)
Jiaoda Li, Jennifer C. White, Mrinmaya Sachan, Ryan Cotterell
A Transformer with Stack Attention. CoRR (2024)
Li Du, Holden Lee, Jason Eisner, Ryan Cotterell
When is a Language Process a Language Model? ACL (Findings) (2024)
Robin Chan, Reda Boumasmoud, Anej Svete, Yuxin Ren, Qipeng Guo, Zhijing Jin, Shauli Ravfogel, Mrinmaya Sachan, Bernhard Schölkopf, Mennatallah El-Assady, Ryan Cotterell
On Affine Homotopy between Language Encoders. CoRR (2024)
Josef Valvoda, Ryan Cotterell
Towards Explainability in Legal Outcome Prediction Models. NAACL-HLT (2024)
Kevin Du, Vésteinn Snæbjarnarson, Niklas Stoehr, Jennifer C. White, Aaron Schein, Ryan Cotterell
Context versus Prior Knowledge in Language Models. CoRR (2024)
Juan Luis Gastaldi, John Terilla, Luca Malagutti, Brian DuSell, Tim Vieira, Ryan Cotterell
The Foundations of Tokenization: Statistical and Computational Concerns. CoRR (2024)
Amanda Doucette, Ryan Cotterell, Morgan Sonderegger, Timothy J. O'Donnell
Correlation Does Not Imply Compensation: Complexity and Irregularity in the Lexicon. CoRR (2024)
Afra Amini, Tim Vieira, Ryan Cotterell
Direct Preference Optimization with an Offset. CoRR (2024)
Ryan Cotterell, Kevin Duh
Low-Resource Named Entity Recognition with Cross-Lingual, Character-Level Neural Conditional Random Fields. CoRR (2024)
Ryan Cotterell, Thomas Müller, Alexander Fraser, Hinrich Schütze
Labeled Morphological Segmentation with Semi-Markov Models. CoRR (2024)
Anej Svete, Robin Shing Moon Chan, Ryan Cotterell
A Theoretical Result on the Inductive Bias of RNN Language Models. CoRR (2024)
Josef Valvoda, Alec Thompson, Ryan Cotterell, Simone Teufel
The Ethics of Automating Legal Actors. Trans. Assoc. Comput. Linguistics 12 (2024)
Ivan Baburin, Ryan Cotterell
Blow-up in Non-Deterministic Automata. CoRR (2024)
Nadav Borenstein, Anej Svete, Robin Shing Moon Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell
What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages. CoRR (2024)
Ionut Constantinescu, Tiago Pimentel, Ryan Cotterell, Alex Warstadt
Do Language Models Have a Critical Period for Language Acquisition? CoRR (2024)
Luca Malagutti, Andrius Buinovskij, Anej Svete, Clara Meister, Afra Amini, Ryan Cotterell
The Role of n-gram Smoothing in the Age of Neural Networks. NAACL-HLT (2024)
Shashwat Singh, Shauli Ravfogel, Jonathan Herzig, Roee Aharoni, Ryan Cotterell, Ponnurangam Kumaraguru
MiMiC: Minimally Modified Counterfactuals in the Representation Space. CoRR (2024)
Thomas Müller, Ryan Cotterell, Alexander Fraser, Hinrich Schütze
Joint Lemmatization and Morphological Tagging with LEMMING. CoRR (2024)
Andreas Opedal, Alessandro Stolfo, Haruki Shirakami, Ying Jiao, Ryan Cotterell, Bernhard Schölkopf, Abulhair Saparov, Mrinmaya Sachan
Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners? CoRR (2024)
Matan Avitan, Ryan Cotterell, Yoav Goldberg, Shauli Ravfogel
What Changed? Converting Representational Interventions to Natural Language. CoRR (2024)
Leshem Choshen, Ryan Cotterell, Michael Y. Hu, Tal Linzen, Aaron Mueller, Candace Ross, Alex Warstadt, Ethan Wilcox, Adina Williams, Chengxu Zhuang
[Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus. CoRR (2024)
Laura Manduchi, Kushagra Pandey, Robert Bamler, Ryan Cotterell, Sina Däubener, Sophie Fellenz, Asja Fischer, Thomas Gärtner, Matthias Kirchler, Marius Kloft, Yingzhen Li, Christoph Lippert, Gerard de Melo, Eric T. Nalisnick, Björn Ommer, Rajesh Ranganath, Maja Rudolph, Karen Ullrich, Guy Van den Broeck, Julia E. Vogt, Yixin Wang, Florian Wenzel, Frank Wood, Stephan Mandt, Vincent Fortuin
On the Challenges and Opportunities in Generative AI. CoRR (2024)
Franz Nowak, Anej Svete, Alexandra Butoi, Ryan Cotterell
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning. ACL (1) (2024)
Franz Nowak, Anej Svete, Alexandra Butoi, Ryan Cotterell
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning. CoRR (2024)
Jiaoda Li, Yifan Hou, Mrinmaya Sachan, Ryan Cotterell
What Do Language Models Learn in Context? The Structured Task Hypothesis. ACL (1) (2024)
Naaman Tan, Josef Valvoda, Anej Svete, Tianyu Liu, Yanxia Qin, Min-Yen Kan, Ryan Cotterell
A Fundamental Trade-off in Aligned Language Models and its Relation to Sampling Adaptors. CoRR (2024)
Seif Ismail, Antonio Arbues, Ryan Cotterell, René Zurbrügg, Carmen Amo Alonso
NARRATE: Versatile Language Architecture for Optimal Control in Robotics. CoRR (2024)
Afra Amini, Tim Vieira, Ryan Cotterell
Variational Best-of-N Alignment. CoRR (2024)
Anej Svete, Ryan Cotterell
Transformers Can Represent n-gram Language Models. NAACL-HLT (2024)
Anej Svete, Franz Nowak, Anisha Mohamed Sahabdeen, Ryan Cotterell
Lower Bounds on the Expressivity of Recurrent Neural Language Models. CoRR (2024)
Niklas Stoehr, Benjamin J. Radford, Ryan Cotterell, Aaron Schein
The Ordered Matrix Dirichlet for State-Space Models. AISTATS (2023)
Yuxin Ren, Qipeng Guo, Zhijing Jin, Shauli Ravfogel, Mrinmaya Sachan, Bernhard Schölkopf, Ryan Cotterell
All Roads Lead to Rome? Exploring the Invariance of Transformers' Representations. CoRR (2023)
Thomas Hikaru Clark, Clara Meister, Tiago Pimentel, Michael Hahn, Ryan Cotterell, Richard Futrell, Roger Levy
A Cross-Linguistic Pressure for Uniform Information Density in Word Order. Trans. Assoc. Comput. Linguistics 11 (2023)
Afra Amini, Tianyu Liu, Ryan Cotterell
Hexatagging: Projective Dependency Parsing as Tagging. CoRR (2023)
Anej Svete, Ryan Cotterell
Recurrent Neural Language Models as Probabilistic Finite-state Automata. CoRR (2023)
Kevin Duh, Lucas Torroba Hennigen, Niklas Stoehr, Alexander Warstadt, Ryan Cotterell
Generalizing Backpropagation for Gradient-Based Interpretability. CoRR (2023)
Andreas Opedal, Eleftheria Tsipidi, Tiago Pimentel, Ryan Cotterell, Tim Vieira
An Exploration of Left-Corner Transformations. EMNLP (2023)
Afra Amini, Ryan Cotterell, John Hewitt, Clara Meister, Tiago Pimentel
Generating Text from Language Models. ACL (tutorial) (2023)
Ethan Gotlieb Wilcox, Tiago Pimentel, Clara Meister, Ryan Cotterell, Roger P. Levy
Testing the Predictions of Surprisal Theory in 11 Languages. Trans. Assoc. Comput. Linguistics 11 (2023)
Nora Belrose, David Schneider-Joseph, Shauli Ravfogel, Ryan Cotterell, Edward Raff, Stella Biderman
LEACE: Perfect linear concept erasure in closed form. CoRR (2023)
Yuchen Eleanor Jiang, Tianyu Liu, Shuming Ma, Dongdong Zhang, Mrinmaya Sachan, Ryan Cotterell
Discourse-Centric Evaluation of Document-level Machine Translation with a New Densely Annotated Parallel Corpus of Novels. ACL (1) (2023)
Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Mrinmaya Sachan, Ryan Cotterell
Tokenization and the Noiseless Channel. ACL (1) (2023)
Tianyu Liu, Afra Amini, Mrinmaya Sachan, Ryan Cotterell
Learning the String Partial Order. CoRR (2023)
Josef Valvoda, Alec Thompson, Ryan Cotterell, Simone Teufel
The Ethics of Automating Legal Actors. CoRR (2023)
Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Mrinmaya Sachan, Ryan Cotterell
Tokenization and the Noiseless Channel. CoRR (2023)
Clara Meister, Tiago Pimentel, Luca Malagutti, Ethan Wilcox, Ryan Cotterell
On the Efficacy of Sampling Adapters. ACL (1) (2023)
Josef Valvoda, Ryan Cotterell, Simone Teufel
On the Role of Negative Precedent in Legal Outcome Prediction. Trans. Assoc. Comput. Linguistics 11 (2023)
Rita Sevastjanova, Eren Cakmak, Shauli Ravfogel, Ryan Cotterell, Mennatallah El-Assady
Visual Comparison of Language Model Adaptation. IEEE Trans. Vis. Comput. Graph. 29 (1) (2023)
Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Tim Vieira, Mrinmaya Sachan, Ryan Cotterell
A Formal Perspective on Byte-Pair Encoding. CoRR (2023)
Afra Amini, Li Du, Ryan Cotterell
Structured Voronoi Sampling. CoRR (2023)
Franz Nowak, Ryan Cotterell
A Fast Algorithm for Computing Prefix Probabilities. CoRR (2023)
Karolina Stanczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, Isabelle Augenstein
A Latent-Variable Model for Intrinsic Probing. AAAI (2023)
Alexandra Butoi, Ryan Cotterell, David Chiang
Convergence and Diversity in the Control Hierarchy. ACL (1) (2023)
Andreas Opedal, Ran Zmigrod, Tim Vieira, Ryan Cotterell, Jason Eisner
Efficient Semiring-Weighted Earley Parsing. CoRR (2023)
Niklas Stoehr, Ryan Cotterell, Aaron Schein
Sentiment as an Ordinal Latent Variable. EACL (2023)
Nora Belrose, David Schneider-Joseph, Shauli Ravfogel, Ryan Cotterell, Edward Raff, Stella Biderman
LEACE: Perfect linear concept erasure in closed form. NeurIPS (2023)
Lukas Wolf, Tiago Pimentel, Evelina Fedorenko, Ryan Cotterell, Alex Warstadt, Ethan Wilcox, Tamar Regev
Quantifying the redundancy between prosody and text. CoRR (2023)
Wangchunshu Zhou, Yuchen Eleanor Jiang, Peng Cui, Tiannan Wang, Zhenxin Xiao, Yifan Hou, Ryan Cotterell, Mrinmaya Sachan
RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text. CoRR (2023)
Clara Meister, Tiago Pimentel, Gian Wiher, Ryan Cotterell
Locally Typical Sampling. Trans. Assoc. Comput. Linguistics 11 (2023)
Afra Amini, Li Du, Ryan Cotterell
Structured Voronoi Sampling. NeurIPS (2023)
Li Du, Lucas Torroba Hennigen, Tiago Pimentel, Clara Meister, Jason Eisner, Ryan Cotterell
A Measure-Theoretic Characterization of Tight Language Models. ACL (1) (2023)
Tiago Pimentel, Clara Meister, Ryan Cotterell
On the Usefulness of Embeddings, Clusters and Strings for Text Generation Evaluation. ICLR (2023)
Anej Svete, Ryan Cotterell
Recurrent Neural Language Models as Probabilistic Finite-state Automata. EMNLP (2023)
Clara Meister, Tiago Pimentel, Luca Malagutti, Ethan Gotlieb Wilcox, Ryan Cotterell
On the Efficacy of Sampling Adapters. CoRR (2023)
Tiago Pimentel, Clara Meister, Ethan Gotlieb Wilcox, Roger P. Levy, Ryan Cotterell
On the Effect of Anticipation on Reading Times. Trans. Assoc. Comput. Linguistics 11 (2023)
Afra Amini, Tianyu Liu, Ryan Cotterell
Hexatagging: Projective Dependency Parsing as Tagging. ACL (2) (2023)
Alexandra Butoi, Tim Vieira, Ryan Cotterell, David Chiang
Efficient Algorithms for Recognizing Weighted Tree-Adjoining Languages. CoRR (2023)
Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Tim Vieira, Mrinmaya Sachan, Ryan Cotterell
A Formal Perspective on Byte-Pair Encoding. ACL (Findings) (2023)
Dieuwke Hupkes, Mario Giulianelli, Verna Dankers, Mikel Artetxe, Yanai Elazar, Tiago Pimentel, Christos E. Christodoulopoulos, Karim Lasri, Naomi Saphra, Arabella Sinclair, Dennis Ulmer, Florian Schottmann, Khuyagbaatar Batsuren, Kaiser Sun, Koustuv Sinha, Leila Khalatbari, Maria Ryskina, Rita Frieske, Ryan Cotterell, Zhijing Jin
A taxonomy and review of generalization research in NLP. Nat. Mac. Intell. 5 (10) (2023)
Lukas Wolf, Tiago Pimentel, Evelina Fedorenko, Ryan Cotterell, Alex Warstadt, Ethan Wilcox, Tamar Regev
Quantifying the redundancy between prosody and text. EMNLP (2023)
Wangchunshu Zhou, Yuchen Eleanor Jiang, Ethan Wilcox, Ryan Cotterell, Mrinmaya Sachan
Controlled Text Generation with Natural Language Instructions. CoRR (2023)
Wangchunshu Zhou, Yuchen Eleanor Jiang, Ryan Cotterell, Mrinmaya Sachan
Efficient Prompting via Dynamic In-Context Learning. CoRR (2023)
Anej Svete, Benjamin Dayan, Tim Vieira, Ryan Cotterell, Jason Eisner
Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs. CoRR (2023)
Andreas Opedal, Eleftheria Tsipidi, Tiago Pimentel, Ryan Cotterell, Tim Vieira
An Exploration of Left-Corner Transformations. CoRR (2023)
Alexandra Butoi, Ryan Cotterell, David Chiang
Convergence and Diversity in the Control Hierarchy. CoRR (2023)
Franz Nowak, Ryan Cotterell
A Fast Algorithm for Computing Prefix Probabilities. ACL (2) (2023)
Afra Amini, Tiago Pimentel, Clara Meister, Ryan Cotterell
Naturalistic Causal Probing for Morpho-Syntax. Trans. Assoc. Comput. Linguistics 11 (2023)
Wangchunshu Zhou, Yuchen Eleanor Jiang, Ethan Wilcox, Ryan Cotterell, Mrinmaya Sachan
Controlled Text Generation with Natural Language Instructions. ICML (2023)
Franz Nowak, Anej Svete, Li Du, Ryan Cotterell
On the Representational Capacity of Recurrent Neural Language Models. CoRR (2023)
Franz Nowak, Anej Svete, Li Du, Ryan Cotterell
On the Representational Capacity of Recurrent Neural Language Models. EMNLP (2023)
Shauli Ravfogel, Yoav Goldberg, Ryan Cotterell
Linear Guardedness and its Implications. ACL (1) (2023)
Li Du, Afra Amini, Lucas Torroba Hennigen, Xinyan Velocity Yu, Jason Eisner, Holden Lee, Ryan Cotterell
Principled Gradient-based Markov Chain Monte Carlo for Text Generation. CoRR (2023)
Yuchen Eleanor Jiang, Tianyu Liu, Shuming Ma, Dongdong Zhang, Mrinmaya Sachan, Ryan Cotterell
Discourse Centric Evaluation of Machine Translation with a Densely Annotated Parallel Corpus. CoRR (2023)
Ivan Baburin, Ryan Cotterell
An Analysis of On-the-fly Determinization of Finite-state Automata. CoRR (2023)
Ethan Wilcox, Clara Meister, Ryan Cotterell, Tiago Pimentel
Language Model Quality Correlates with Psychometric Predictive Power in Multiple Languages. EMNLP (2023)
Karolina Stanczak, Kevin Du, Adina Williams, Isabelle Augenstein, Ryan Cotterell
Grammatical Gender's Influence on Distributional Semantics: A Causal Perspective. CoRR (2023)
Kevin Du, Lucas Torroba Hennigen, Niklas Stoehr, Alex Warstadt, Ryan Cotterell
Generalizing Backpropagation for Gradient-Based Interpretability. ACL (1) (2023)
Clemente Pasti, Andreas Opedal, Tiago Pimentel, Tim Vieira, Jason Eisner, Ryan Cotterell
On the Intersection of Context-Free and Regular Languages. EACL (2023)
Thomas Hikaru Clark, Clara Meister, Tiago Pimentel, Michael Hahn, Ryan Cotterell, Richard Futrell, Roger Levy
A Cross-Linguistic Pressure for Uniform Information Density in Word Order. CoRR (2023)
Ryan Cotterell, Anej Svete, Clara Meister, Tianyu Liu, Li Du
Formal Aspects of Language Modeling. CoRR (2023)
Idan Schwartz, Vésteinn Snæbjarnarson, Sagie Benaim, Hila Chefer, Ryan Cotterell, Lior Wolf, Serge J. Belongie
Discriminative Class Tokens for Text-to-Image Diffusion Models. CoRR (2023)
Tiago Pimentel, Clara Meister, Ethan Wilcox, Kyle Mahowald, Ryan Cotterell
Revisiting the Optimality of Word Lengths. EMNLP (2023)

Ryan Cotterell.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Ryan Cotterell