William Merrill

71 papers A* 6B 2C 1Journal 49Unranked 13

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Context-Free Recognition with Transformers. CoRR Selim Jerad, Anej Svete, Sophie Hao, Ryan Cotterell, William Merrill
2026	J	`jnl`	Discovering Interpretable Algorithms by Decompiling Transformers to RASP. CoRR Xinting Huang, Aleksandra Bakalova, Satwik Bhattamishra, William Merrill, Michael Hahn
2026	J	`jnl`	The Transformer Cookbook. Trans. Mach. Learn. Res. Andy Yang, Christopher Watson, Anton Xue, Satwik Bhattamishra, Jose Llarena, William Merrill, Emile Dos Santos Ferreira, Anej Svete, David Chiang
2026	J	`jnl`	Why Are Linear RNNs More Parallelizable? CoRR William Merrill, Hongjian Jiang, Yanhong Li, Anthony W. Lin, Ashish Sabharwal
2025	J	`jnl`	2 OLMo 2 Furious. CoRR Team OLMo, Pete Walsh, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Shane Arora, Akshita Bhagia, Yuling Gu, Shengyi Huang, Matt Jordan, Nathan Lambert, Dustin Schwenk, Oyvind Tafjord, Taira Anderson, David Atkinson, Faeze Brahman, Christopher Clark, Pradeep Dasigi, Nouha Dziri, Michal Guerquin, Hamish Ivison, Pang Wei Koh, Jiacheng Liu, Saumya Malik, William Merrill, Lester James V. Miranda, Jacob Morrison, Tyler Murray, Crystal Nam, Valentina Pyatkin, Aman Rangapur, Michael Schmitz, Sam Skjonsberg, David Wadden, Christopher Wilhelm, Michael Wilson, Luke Zettlemoyer, Ali Farhadi, Noah A. Smith, Hannaneh Hajishirzi
2025	J	`jnl`	A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers. CoRR William Merrill, Ashish Sabharwal
2025	—	`conf`	Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases. ACL (1) Michael Y. Hu, Jackson Petty, Chuan Shi, William Merrill, Tal Linzen
2025	J	`jnl`	Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases. CoRR Michael Y. Hu, Jackson Petty, Chuan Shi, William Merrill, Tal Linzen
2025	J	`jnl`	Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training. CoRR William Merrill, Shane Arora, Dirk Groeneveld, Hannaneh Hajishirzi
2025	J	`jnl`	Exact Expressive Power of Transformers with Padding. CoRR William Merrill, Ashish Sabharwal
2025	J	`jnl`	Olmo 3. CoRR Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, David Graham, David Heineman, Dirk Groeneveld, Faeze Brahman, Finbarr Timbers, Hamish Ivison, Jacob Morrison, Jake Poznanski, Kyle Lo, Luca Soldaini, Matt Jordan, Mayee F. Chen, Michael Noukhovitch, Nathan Lambert, Pete Walsh, Pradeep Dasigi, Robert Berry, Saumya Malik, Saurabh Shah, Scott Geng, Shane Arora, Shashank Gupta, Taira Anderson, Teng Xiao, Tyler Murray, Tyler Romero, Victoria Graf, Akari Asai, Akshita Bhagia, Alexander Wettig, Alisa Liu, Aman Rangapur, Chloe Anastasiades, Costa Huang, Dustin Schwenk, Harsh Trivedi, Ian Magnusson, Jaron Lochner, Jiacheng Liu, Lester James V. Miranda, Maarten Sap, Malia Morgan, Michael Schmitz, Michal Guerquin, Michael Wilson, Regan Huff, Ronan Le Bras, Rui Xin, Rulin Shao, Sam Skjonsberg, Shannon Zejiang Shen, Shuyue Stella Li, Tucker Wilde, Valentina Pyatkin, William Merrill, Yapei Chang, Yuling Gu, Zhiyuan Zeng, Ashish Sabharwal, Luke Zettlemoyer, Pang Wei Koh, Ali Farhadi, Noah A. Smith, Hannaneh Hajishirzi
2025	J	`jnl`	RELIC: Evaluating Compositional Instruction Following via Language Recognition. CoRR Jackson Petty, Michael Y. Hu, Wentao Wang, Shauli Ravfogel, William Merrill, Tal Linzen
2025	J	`jnl`	RWKV-7 "Goose" with Expressive Dynamic State Evolution. CoRR Bo Peng, Ruichong Zhang, Daniel Goldstein, Eric Alcaide, Xingjian Du, Haowen Hou, Jiaju Lin, Jiaxing Liu, Janna Lu, William Merrill, Guangyu Song, Kaifeng Tan, Saiteja Utpala, Nathan Wilce, Johan S. Wind, Tianyi Wu, Daniel Wuttke, Christian Zhou-Zheng
2025	J	`jnl`	The Transformer Cookbook. CoRR Andy Yang, Christopher Watson, Anton Xue, Satwik Bhattamishra, Jose Llarena, William Merrill, Emile Dos Santos Ferreira, Anej Svete, David Chiang
2024	—	`conf`	Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment. ACL (Findings) William Merrill, Zhaofeng Wu, Norihito Naka, Yoon Kim, Tal Linzen
2024	J	`jnl`	Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment. CoRR William Merrill, Zhaofeng Wu, Norihito Naka, Yoon Kim, Tal Linzen
2024	—	`conf`	Computational Expressivity of Neural Language Models. ACL (5) Alexandra Butoi, Robin Chan, Ryan Cotterell, William Merrill, Franz Nowak, Clemente Pasti, Lena Strobl, Anej Svete
2024	A*	`conf`	Evaluating n-Gram Novelty of Language Models Using Rusty-DAWG. EMNLP William Merrill, Noah A. Smith, Yanai Elazar
2024	J	`jnl`	Evaluating n-Gram Novelty of Language Models Using Rusty-DAWG. CoRR William Merrill, Noah A. Smith, Yanai Elazar
2024	A*	`conf`	How Language Model Hallucinations Can Snowball. ICML Muru Zhang, Ofir Press, William Merrill, Alisa Liu, Noah A. Smith
2024	J	`jnl`	Let's Think Dot by Dot: Hidden Computation in Transformer Language Models. CoRR Jacob Pfau, William Merrill, Samuel R. Bowman
2024	—	`conf`	OLMo: Accelerating the Science of Language Models. ACL (1) Dirk Groeneveld, Iz Beltagy, Evan Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
2024	J	`jnl`	OLMo: Accelerating the Science of Language Models. CoRR Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
2024	A*	`conf`	The Expressive Power of Transformers with Chain of Thought. ICLR William Merrill, Ashish Sabharwal
2024	A*	`conf`	The Illusion of State in State-Space Models. ICML William Merrill, Jackson Petty, Ashish Sabharwal
2024	J	`jnl`	The Illusion of State in State-Space Models. CoRR William Merrill, Jackson Petty, Ashish Sabharwal
2024	J	`jnl`	What Formal Languages Can Transformers Express? A Survey. Trans. Assoc. Comput. Linguistics Lena Strobl, William Merrill, Gail Weiss, David Chiang, Dana Angluin
2023	A*	`conf`	A Logic for Expressing Log-Precision Transformers. NeurIPS William Merrill, Ashish Sabharwal
2023	J	`jnl`	A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks. CoRR William Merrill, Nikolaos Tsilivis, Aman Shukla
2023	C	`conf`	Formal Languages and the NLP Black Box. DLT William Merrill
2023	—	`conf`	Formal languages and neural models for learning on sequences. ICGI William Merrill
2023	J	`jnl`	How Language Model Hallucinations Can Snowball. CoRR Muru Zhang, Ofir Press, William Merrill, Alisa Liu, Noah A. Smith
2023	J	`jnl`	The Expressive Power of Transformers with Chain of Thought. CoRR William Merrill, Ashish Sabharwal
2023	J	`jnl`	The Parallelism Tradeoff: Limitations of Log-Precision Transformers. Trans. Assoc. Comput. Linguistics William Merrill, Ashish Sabharwal
2023	J	`jnl`	Transformers as Recognizers of Formal Languages: A Survey on Expressivity. CoRR Lena Strobl, William Merrill, Gail Weiss, David Chiang, Dana Angluin
2023	J	`jnl`	Transparency Helps Reveal When Language Models Learn Meaning. Trans. Assoc. Comput. Linguistics Zhaofeng Wu, William Merrill, Hao Peng, Iz Beltagy, Noah A. Smith
2022	B	`conf`	Entailment Semantics Can Be Extracted from an Ideal Language Model. CoNLL William Merrill, Alex Warstadt, Tal Linzen
2022	J	`jnl`	Entailment Semantics Can Be Extracted from an Ideal Language Model. CoRR William Merrill, Alex Warstadt, Tal Linzen
2022	J	`jnl`	Extracting Finite Automata from RNNs Using State Merging. CoRR William Merrill, Nikolaos Tsilivis
2022	J	`jnl`	Log-Precision Transformers are Constant-Depth Uniform Threshold Circuits. CoRR William Merrill, Ashish Sabharwal
2022	—	`conf`	ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension. ACL (1) Sanjay Subramanian, William Merrill, Trevor Darrell, Matt Gardner, Sameer Singh, Anna Rohrbach
2022	J	`jnl`	ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension. CoRR Sanjay Subramanian, William Merrill, Trevor Darrell, Matt Gardner, Sameer Singh, Anna Rohrbach
2022	J	`jnl`	Saturated Transformers are Constant-Depth Threshold Circuits. Trans. Assoc. Comput. Linguistics William Merrill, Ashish Sabharwal, Noah A. Smith
2022	J	`jnl`	Transformers Implement First-Order Logic with Majority Quantifiers. CoRR William Merrill, Ashish Sabharwal
2022	J	`jnl`	Transparency Helps Reveal When Language Models Learn Meaning. CoRR Zhaofeng Wu, William Merrill, Hao Peng, Iz Beltagy, Noah A. Smith
2021	—	`conf`	Competency Problems: On Finding and Removing Artifacts in Language Data. EMNLP (1) Matt Gardner, William Merrill, Jesse Dodge, Matthew E. Peters, Alexis Ross, Sameer Singh, Noah A. Smith
2021	J	`jnl`	Competency Problems: On Finding and Removing Artifacts in Language Data. CoRR Matt Gardner, William Merrill, Jesse Dodge, Matthew E. Peters, Alexis Ross, Sameer Singh, Noah A. Smith
2021	—	`conf`	Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent. EMNLP (1) William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith
2021	J	`jnl`	Formal Language Theory Meets Modern NLP. CoRR William Merrill
2021	J	`jnl`	On the Power of Saturated Transformers: A View from Circuit Complexity. CoRR William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith
2021	J	`jnl`	Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand? Trans. Assoc. Comput. Linguistics William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith
2021	J	`jnl`	Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand? CoRR William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith
2020	A*	`conf`	A Formal Hierarchy of RNN Architectures. ACL William Merrill, Gail Weiss, Yoav Goldberg, Roy Schwartz, Noah A. Smith, Eran Yahav
2020	J	`jnl`	A Formal Hierarchy of RNN Architectures. CoRR William Merrill, Gail Weiss, Yoav Goldberg, Roy Schwartz, Noah A. Smith, Eran Yahav
2020	J	`jnl`	CORD-19: The Covid-19 Open Research Dataset. CoRR Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, Russell Reas, Jiangjiang Yang, Darrin Eide, Kathryn Funk, Rodney Kinney, Ziyang Liu, William Merrill, Paul Mooney, Dewey A. Murdick, Devvret Rishi, Jerry Sheehan, Zhihong Shen, Brandon Stilson, Alex D. Wade, Kuansan Wang, Chris Wilhelm, Boya Xie, Douglas Raymond, Daniel S. Weld, Oren Etzioni, Sebastian Kohlmeier
2020	J	`jnl`	On the Linguistic Capacity of Real-Time Counter Automata. CoRR William Merrill
2020	J	`jnl`	Parameter Norm Growth During Training of Transformers. CoRR William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith
2019	—	`conf`	Detecting Syntactic Change Using a Neural Part-of-Speech Tagger. LChange@ACL William Merrill, Gigi Felice Stark, Robert Frank
2019	J	`jnl`	Detecting Syntactic Change Using a Neural Part-of-Speech Tagger. CoRR William Merrill, Gigi Felice Stark, Robert Frank
2019	—	`conf`	Finding Hierarchical Structure in Neural Stacks Using Unsupervised Parsing. BlackboxNLP@ACL William Merrill, Lenny Khazan, Noah Amsel, Yiding Hao, Simon Mendelsohn, Robert Frank
2019	J	`jnl`	Finding Syntactic Representations in Neural Stacks. CoRR William Merrill, Lenny Khazan, Noah Amsel, Yiding Hao, Simon Mendelsohn, Robert Frank
2019	J	`jnl`	Sequential Neural Networks as Automata. CoRR William Merrill
2018	—	`conf`	Context-Free Transductions with Neural Stacks. BlackboxNLP@EMNLP Yiding Hao, William Merrill, Dana Angluin, Robert Frank, Noah Amsel, Andrew Benz, Simon Mendelsohn
2018	J	`jnl`	Context-Free Transductions with Neural Stacks. CoRR Yiding Hao, William Merrill, Dana Angluin, Robert Frank, Noah Amsel, Andrew Benz, Simon Mendelsohn
2018	—	`conf`	End-to-End Graph-Based TAG Parsing with Neural Networks. NAACL-HLT Jungo Kasai, Robert Frank, Pauli Xu, William Merrill, Owen Rambow
2018	J	`jnl`	End-to-end Graph-based TAG Parsing with Neural Networks. CoRR Jungo Kasai, Robert Frank, Pauli Xu, William Merrill, Owen Rambow
2018	B	`conf`	Using Machine Learning to Understand Transfer from First Language to Second Language. CogSci Tiwalayo Eisape, William Merrill, Joshua K. Hartshorne, Sven Dietz
2010	J	`jnl`	Where is the return on investment in wireless sensor networks? IEEE Wirel. Commun. William Merrill
2004	J	`jnl`	Dynamic Networking and Smart Sensing Enable Next-Generation Landmines. IEEE Pervasive Comput. William Merrill, Lewis Girod, Brian Schiffer, Dustin McIntire, Guillaume Rava, Katayoun Sohrabi, Fredric Newberg, Jeremy Elson, William J. Kaiser
2004	J	`jnl`	Methods for Scalable Self-Assembly of Ad Hoc Wireless Sensor Networks. IEEE Trans. Mob. Comput. Katayoun Sohrabi, William Merrill, Jeremy Elson, Lewis Girod, Fredric Newberg, William J. Kaiser
2001	—	`conf`	Preserving and Protecting the Freedom to Learn Online. WebNet William Merrill