Anej Svete

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 22

Top Topics

Context Sensitive

Top Venues

Publications

Anej Svete, Robin Chan, Ryan Cotterell
On Efficiently Representing Regular Languages as RNNs. ACL (Findings) (2024)
Anej Svete, Ryan Cotterell
-gram Language Models. CoRR (2024)
Anej Svete, Franz Nowak, Anisha Mohamed Sahabdeen, Ryan Cotterell
Lower Bounds on the Expressivity of Recurrent Neural Language Models. NAACL-HLT (2024)
Luca Malagutti, Andrius Buinovskij, Anej Svete, Clara Meister, Afra Amini, Ryan Cotterell
The Role of n-gram Smoothing in the Age of Neural Networks. CoRR (2024)
Robin Chan, Reda Boumasmoud, Anej Svete, Yuxin Ren, Qipeng Guo, Zhijing Jin, Shauli Ravfogel, Mrinmaya Sachan, Bernhard Schölkopf, Mennatallah El-Assady, Ryan Cotterell
On Affine Homotopy between Language Encoders. CoRR (2024)
Anej Svete, Robin Shing Moon Chan, Ryan Cotterell
A Theoretical Result on the Inductive Bias of RNN Language Models. CoRR (2024)
Nadav Borenstein, Anej Svete, Robin Shing Moon Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell
What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages. CoRR (2024)
Luca Malagutti, Andrius Buinovskij, Anej Svete, Clara Meister, Afra Amini, Ryan Cotterell
The Role of n-gram Smoothing in the Age of Neural Networks. NAACL-HLT (2024)
Franz Nowak, Anej Svete, Alexandra Butoi, Ryan Cotterell
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning. ACL (1) (2024)
Franz Nowak, Anej Svete, Alexandra Butoi, Ryan Cotterell
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning. CoRR (2024)
Naaman Tan, Josef Valvoda, Anej Svete, Tianyu Liu, Yanxia Qin, Min-Yen Kan, Ryan Cotterell
A Fundamental Trade-off in Aligned Language Models and its Relation to Sampling Adaptors. CoRR (2024)
Anej Svete, Ryan Cotterell
Transformers Can Represent n-gram Language Models. NAACL-HLT (2024)
Anej Svete, Franz Nowak, Anisha Mohamed Sahabdeen, Ryan Cotterell
Lower Bounds on the Expressivity of Recurrent Neural Language Models. CoRR (2024)
Anej Svete, Ryan Cotterell
Recurrent Neural Language Models as Probabilistic Finite-state Automata. CoRR (2023)
Anej Svete, Ryan Cotterell
Recurrent Neural Language Models as Probabilistic Finite-state Automata. EMNLP (2023)
Anej Svete, Benjamin Dayan, Tim Vieira, Ryan Cotterell, Jason Eisner
Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs. CoRR (2023)
Franz Nowak, Anej Svete, Li Du, Ryan Cotterell
On the Representational Capacity of Recurrent Neural Language Models. CoRR (2023)
Franz Nowak, Anej Svete, Li Du, Ryan Cotterell
On the Representational Capacity of Recurrent Neural Language Models. EMNLP (2023)
Ryan Cotterell, Anej Svete, Clara Meister, Tianyu Liu, Li Du
Formal Aspects of Language Modeling. CoRR (2023)
Clément Guerner, Anej Svete, Tianyu Liu, Alexander Warstadt, Ryan Cotterell
A Geometric Notion of Causal Probing. CoRR (2023)
Anej Svete, Benjamin Dayan, Ryan Cotterell, Tim Vieira, Jason Eisner
Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs. EMNLP (2022)
Anej Svete, Jakob Hostnik
It is not just about the Melody: How Europe Votes for its Favorite Songs. CoRR (2020)