Anej Svete

43 papers A* 9Journal 25Unranked 9
YearRankTypeTitle / Venue / Authors
2026 J jnl
Context-Free Recognition with Transformers.
CoRR
Selim Jerad, Anej Svete, Sophie Hao, Ryan Cotterell, William Merrill
2026 J jnl
The Transformer Cookbook.
Trans. Mach. Learn. Res.
Andy Yang, Christopher Watson, Anton Xue, Satwik Bhattamishra, Jose Llarena, William Merrill, Emile Dos Santos Ferreira, Anej Svete, David Chiang
2025 A* conf
Gumbel Counterfactual Generation From Language Models.
ICLR
Shauli Ravfogel, Anej Svete, Vésteinn Snæbjarnarson, Ryan Cotterell
2025 — conf
Information Locality as an Inductive Bias for Neural Language Models.
ACL (1)
Taiga Someya, Anej Svete, Brian DuSell, Timothy J. O'Donnell, Mario Giulianelli, Ryan Cotterell
2025 J jnl
Information Locality as an Inductive Bias for Neural Language Models.
CoRR
Taiga Someya, Anej Svete, Brian DuSell, Timothy J. O'Donnell, Mario Giulianelli, Ryan Cotterell
2025 J jnl
On the Reasoning Abilities of Masked Diffusion Language Models.
CoRR
Anej Svete, Ashish Sabharwal
2025 J jnl
Probability Distributions Computed by Hard-Attention Transformers.
CoRR
Andy Yang, Anej Svete, Jiaoda Li, Anthony Widjaja Lin, Jonathan Rawski, Ryan Cotterell, David Chiang
2025 J jnl
The Transformer Cookbook.
CoRR
Andy Yang, Christopher Watson, Anton Xue, Satwik Bhattamishra, Jose Llarena, William Merrill, Emile Dos Santos Ferreira, Anej Svete, David Chiang
2025 A* conf
Training Neural Networks as Recognizers of Formal Languages.
ICLR
Alexandra Butoi, Ghazal Khalighinejad, Anej Svete, Josef Valvoda, Ryan Cotterell, Brian DuSell
2025 — conf
Unique Hard Attention: A Tale of Two Sides.
ACL (2)
Selim Jerad, Anej Svete, Jiaoda Li, Ryan Cotterell
2025 J jnl
Unique Hard Attention: A Tale of Two Sides.
CoRR
Selim Jerad, Anej Svete, Jiaoda Li, Ryan Cotterell
2024 J jnl
A Fundamental Trade-off in Aligned Language Models and its Relation to Sampling Adaptors.
CoRR
Naaman Tan, Josef Valvoda, Anej Svete, Tianyu Liu, Yanxia Qin, Min-Yen Kan, Ryan Cotterell
2024 A* conf
A Probability-Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors.
EMNLP
Naaman Tan, Josef Valvoda, Tianyu Liu, Anej Svete, Yanxia Qin, Min-Yen Kan, Ryan Cotterell
2024 J jnl
A Theoretical Result on the Inductive Bias of RNN Language Models.
CoRR
Anej Svete, Robin Shing Moon Chan, Ryan Cotterell
2024 J jnl
An L
CoRR
Clemente Pasti, Talu Karagöz, Anej Svete, Franz Nowak, Reda Boumasmoud, Ryan Cotterell
2024 A* conf
An L* Algorithm for Deterministic Weighted Regular Languages.
EMNLP
Clemente Pasti, Talu Karagöz, Franz Nowak, Anej Svete, Reda Boumasmoud, Ryan Cotterell
2024 J jnl
Can Transformers Learn
CoRR
Anej Svete, Nadav Borenstein, Mike Zhou, Isabelle Augenstein, Ryan Cotterell
2024 A* conf
Can Transformers Learn n-gram Language Models?
EMNLP
Anej Svete, Nadav Borenstein, Mike Zhou, Isabelle Augenstein, Ryan Cotterell
2024 — conf
Computational Expressivity of Neural Language Models.
ACL (5)
Alexandra Butoi, Robin Chan, Ryan Cotterell, William Merrill, Franz Nowak, Clemente Pasti, Lena Strobl, Anej Svete
2024 J jnl
Counterfactual Generation from Language Models.
CoRR
Shauli Ravfogel, Anej Svete, Vésteinn Snæbjarnarson, Ryan Cotterell
2024 — conf
Lower Bounds on the Expressivity of Recurrent Neural Language Models.
NAACL-HLT
Anej Svete, Franz Nowak, Anisha Mohamed Sahabdeen, Ryan Cotterell
2024 J jnl
Lower Bounds on the Expressivity of Recurrent Neural Language Models.
CoRR
Anej Svete, Franz Nowak, Anisha Mohamed Sahabdeen, Ryan Cotterell
2024 A* conf
On Affine Homotopy between Language Encoders.
NeurIPS
Robin Chan, Reda Boumasmoud, Anej Svete, Yuxin Ren, Qipeng Guo, Zhijing Jin, Shauli Ravfogel, Mrinmaya Sachan, Bernhard Schölkopf, Mennatallah El-Assady, Ryan Cotterell
2024 J jnl
On Affine Homotopy between Language Encoders.
CoRR
Robin Chan, Reda Boumasmoud, Anej Svete, Yuxin Ren, Qipeng Guo, Zhijing Jin, Shauli Ravfogel, Mrinmaya Sachan, Bernhard Schölkopf, Mennatallah El-Assady, Ryan Cotterell
2024 — conf
On Efficiently Representing Regular Languages as RNNs.
ACL (Findings)
Anej Svete, Robin Chan, Ryan Cotterell
2024 — conf
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning.
ACL (1)
Franz Nowak, Anej Svete, Alexandra Butoi, Ryan Cotterell
2024 J jnl
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning.
CoRR
Franz Nowak, Anej Svete, Alexandra Butoi, Ryan Cotterell
2024 — conf
The Role of n-gram Smoothing in the Age of Neural Networks.
NAACL-HLT
Luca Malagutti, Andrius Buinovskij, Anej Svete, Clara Meister, Afra Amini, Ryan Cotterell
2024 J jnl
The Role of n-gram Smoothing in the Age of Neural Networks.
CoRR
Luca Malagutti, Andrius Buinovskij, Anej Svete, Clara Meister, Afra Amini, Ryan Cotterell
2024 J jnl
Training Neural Networks as Recognizers of Formal Languages.
CoRR
Alexandra Butoi, Ghazal Khalighinejad, Anej Svete, Josef Valvoda, Ryan Cotterell, Brian DuSell
2024 J jnl
Transformers Can Represent
CoRR
Anej Svete, Ryan Cotterell
2024 — conf
Transformers Can Represent n-gram Language Models.
NAACL-HLT
Anej Svete, Ryan Cotterell
2024 — conf
What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages.
ACL (1)
Nadav Borenstein, Anej Svete, Robin Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell
2024 J jnl
What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages.
CoRR
Nadav Borenstein, Anej Svete, Robin Shing Moon Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell
2023 J jnl
A Geometric Notion of Causal Probing.
CoRR
Clément Guerner, Anej Svete, Tianyu Liu, Alexander Warstadt, Ryan Cotterell
2023 J jnl
Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs.
CoRR
Anej Svete, Benjamin Dayan, Tim Vieira, Ryan Cotterell, Jason Eisner
2023 J jnl
Formal Aspects of Language Modeling.
CoRR
Ryan Cotterell, Anej Svete, Clara Meister, Tianyu Liu, Li Du
2023 A* conf
On the Representational Capacity of Recurrent Neural Language Models.
EMNLP
Franz Nowak, Anej Svete, Li Du, Ryan Cotterell
2023 J jnl
On the Representational Capacity of Recurrent Neural Language Models.
CoRR
Franz Nowak, Anej Svete, Li Du, Ryan Cotterell
2023 A* conf
Recurrent Neural Language Models as Probabilistic Finite-state Automata.
EMNLP
Anej Svete, Ryan Cotterell
2023 J jnl
Recurrent Neural Language Models as Probabilistic Finite-state Automata.
CoRR
Anej Svete, Ryan Cotterell
2022 A* conf
Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs.
EMNLP
Anej Svete, Benjamin Dayan, Ryan Cotterell, Tim Vieira, Jason Eisner
2020 J jnl
It is not just about the Melody: How Europe Votes for its Favorite Songs.
CoRR
Anej Svete, Jakob Hostnik