Beren Millidge

79 papers A* 9A 1Journal 62Unranked 7

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Hybrid Associative Memories. CoRR Leon Lufkin, Tomas Figliolia, Beren Millidge, Kamesh Krishnamurthy
2026	J	`jnl`	Online Vector Quantized Attention. CoRR Nick Alonso, Tomas Figliolia, Beren Millidge
2026	J	`jnl`	ZUNA: Flexible EEG Superresolution with Position-Aware Diffusion Autoencoders. CoRR Christopher Warner, Jonas Mago, JR Huml, Mohamed Osman, Beren Millidge
2025	J	`jnl`	Compressed Convolutional Attention: Efficient Attention in a Compressed Latent Space. CoRR Tomas Figliolia, Nicholas Alonso, Rishi Iyer, Quentin Anthony, Beren Millidge
2025	J	`jnl`	Equivalence of Personalized PageRank and Successor Representations. CoRR Beren Millidge
2025	J	`jnl`	Generalising E-prop to Deep Networks. CoRR Beren Millidge
2025	J	`jnl`	Training Foundation Models on a Full-Stack AMD Platform: Compute, Networking, and System Design. CoRR Quentin Anthony, Yury Tokpanov, Skyler Szot, Srivatsan Rajagopal, Praneeth Medepalli, Anna Golubeva, Vasudev Shyam, Robert Washbourne, Rishi Iyer, Ansh Chaurasia, Tomas Figliolia, Xiao Yang, Abhinav Sarje, Drew Thorstensen, Amartey Pearson, Zack Grossbart, Jason van Patten, Emad Barsoum, Zhenyu Gu, Yao Fu, Beren Millidge
2024	J	`jnl`	A Review of Neuroscience-Inspired Machine Learning. CoRR Alexander Ororbia, Ankur Mali, Adam Kohan, Beren Millidge, Tommaso Salvatori
2024	A*	`conf`	A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks. ICLR Tommaso Salvatori, Yuhang Song, Yordan Yordanov, Beren Millidge, Lei Sha, Cornelius Emde, Zhenghua Xu, Rafal Bogacz, Thomas Lukasiewicz
2024	J	`jnl`	Associative Memories in the Feature Space. CoRR Tommaso Salvatori, Beren Millidge, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
2024	J	`jnl`	BlackMamba: Mixture of Experts for State-Space Models. CoRR Quentin Anthony, Yury Tokpanov, Paolo Glorioso, Beren Millidge
2024	J	`jnl`	Exploring Action-Centric Representations Through the Lens of Rate-Distortion Theory. CoRR Miguel De Llanza Varona, Christopher L. Buckley, Beren Millidge
2024	J	`jnl`	Mixture-of-PageRanks: Replacing Long-Context with Real-Time, Sparse GraphRAG. CoRR Nicholas Alonso, Beren Millidge
2024	J	`jnl`	Natural Induction: Spontaneous Adaptive Organisation without Natural Selection. Entropy Christopher L. Buckley, Tim Lewens, Michael Levin, Beren Millidge, Alexander Tschantz, Richard A. Watson
2024	A*	`conf`	Predictive Coding beyond Correlations. ICML Tommaso Salvatori, Luca Pinchetti, Amine M'Charrak, Beren Millidge, Thomas Lukasiewicz
2024	J	`jnl`	Predictive coding networks for temporal prediction. PLoS Comput. Biol. Beren Millidge, Mufeng Tang, Mahyar Osanlouy, Nicol S. Harper, Rafal Bogacz
2024	J	`jnl`	Reward Bases: A simple mechanism for adaptive acquisition of multiple reward types. PLoS Comput. Biol. Beren Millidge, Yuhang Song, Armin Lak, Mark E. Walton, Rafal Bogacz
2024	J	`jnl`	The Zamba2 Suite: Technical Report. CoRR Paolo Glorioso, Quentin Anthony, Yury Tokpanov, Anna Golubeva, Vasudev Shyam, James Whittington, Jonathan Pilault, Beren Millidge
2024	J	`jnl`	Toward Conversational Agents with Context and Time Sensitive Long-term Memory. CoRR Nick Alonso, Tomas Figliolia, Anthony Ndirango, Beren Millidge
2024	J	`jnl`	Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters. CoRR Vasudev Shyam, Jonathan Pilault, Emily Shepperd, Quentin Anthony, Beren Millidge
2024	J	`jnl`	Zamba: A Compact 7B SSM Hybrid Model. CoRR Paolo Glorioso, Quentin Anthony, Yury Tokpanov, James Whittington, Jonathan Pilault, Adam Ibrahim, Beren Millidge
2024	J	`jnl`	Zyda-2: a 5 Trillion Token High-Quality Dataset. CoRR Yury Tokpanov, Paolo Glorioso, Quentin Anthony, Beren Millidge
2024	J	`jnl`	Zyda: A 1.3T Dataset for Open Language Modeling. CoRR Yury Tokpanov, Beren Millidge, Paolo Glorioso, Jonathan Pilault, Adam Ibrahim, James Whittington, Quentin Anthony
2023	A*	`conf`	A Theoretical Framework for Inference and Learning in Predictive Coding Networks. ICLR Beren Millidge, Yuhang Song, Tommaso Salvatori, Thomas Lukasiewicz, Rafal Bogacz
2023	A	`conf`	Associative Memories in the Feature Space. ECAI Tommaso Salvatori, Beren Millidge, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
2023	A*	`conf`	Backpropagation at the Infinitesimal Inference Limit of Energy-Based Models: Unifying Predictive Coding, Equilibrium Propagation, and Contrastive Hebbian Learning. ICLR Beren Millidge, Yuhang Song, Tommaso Salvatori, Thomas Lukasiewicz, Rafal Bogacz
2023	J	`jnl`	Causal Inference via Predictive Coding. CoRR Tommaso Salvatori, Luca Pinchetti, Amine M'Charrak, Beren Millidge, Thomas Lukasiewicz
2023	J	`jnl`	Collective behavior from surprise minimization. CoRR Conor Heins, Beren Millidge, Lancelot Da Costa, Richard Mann, Karl J. Friston, Iain D. Couzin
2023	—	`conf`	Exploring Action-Centric Representations Through the Lens of Rate-Distortion Theory. IWAI Miguel De Llanza Varona, Christopher L. Buckley, Beren Millidge
2023	J	`jnl`	Hybrid predictive coding: Inferring, fast and slow. PLoS Comput. Biol. Alexander Tscshantz, Beren Millidge, Anil K. Seth, Christopher L. Buckley
2023	J	`jnl`	Recurrent predictive coding models for associative memory employing covariance learning. PLoS Comput. Biol. Mufeng Tang, Tommaso Salvatori, Beren Millidge, Yuhang Song, Thomas Lukasiewicz, Rafal Bogacz
2022	A*	`conf`	A Theoretical Framework for Inference Learning. NeurIPS Nick Alonso, Beren Millidge, Jeffrey L. Krichmar, Emre O. Neftci
2022	J	`jnl`	A Theoretical Framework for Inference Learning. CoRR Nick Alonso, Beren Millidge, Jeff Krichmar, Emre Neftci
2022	J	`jnl`	A Theoretical Framework for Inference and Learning in Predictive Coding Networks. CoRR Beren Millidge, Yuhang Song, Tommaso Salvatori, Thomas Lukasiewicz, Rafal Bogacz
2022	—	`conf`	Active Inference Successor Representations. IWAI Beren Millidge, Christopher L. Buckley
2022	J	`jnl`	Backpropagation at the Infinitesimal Inference Limit of Energy-Based Models: Unifying Predictive Coding, Equilibrium Propagation, and Contrastive Hebbian Learning. CoRR Beren Millidge, Yuhang Song, Tommaso Salvatori, Thomas Lukasiewicz, Rafal Bogacz
2022	—	`conf`	Capsule Networks as Generative Models. IWAI Alex B. Kiefer, Beren Millidge, Alexander Tschantz, Christopher L. Buckley
2022	J	`jnl`	Designing Ecosystems of Intelligence from First Principles. CoRR Karl J. Friston, Maxwell J. D. Ramstead, Alex B. Kiefer, Alexander Tschantz, Christopher L. Buckley, Mahault Albarracin, Riddhi J. Pitliya, Conor Heins, Brennan Klein, Beren Millidge, Dalton A. R. Sakthivadivel, Toby St Clere Smithe, Magnus T. Koudahl, Safae Essafi Tremblay, Capm Petersen, Kaiser Fung, Jason G. Fox, Steven Swanson, Dan Mapes, Gabriel René
2022	J	`jnl`	Hybrid Predictive Coding: Inferring, Fast and Slow. CoRR Alexander Tschantz, Beren Millidge, Anil K. Seth, Christopher L. Buckley
2022	J	`jnl`	Incremental Predictive Coding: A Parallel and Fully Automatic Learning Algorithm. CoRR Tommaso Salvatori, Yuhang Song, Beren Millidge, Zhenghua Xu, Lei Sha, Cornelius Emde, Rafal Bogacz, Thomas Lukasiewicz
2022	J	`jnl`	Interpreting Neural Networks through the Polytope Lens. CoRR Sid Black, Lee Sharkey, Léo Grinsztajn, Eric Winsor, Dan Braun, Jacob Merizian, Kip Parker, Carlos Ramón Guevara, Beren Millidge, Gabriel Alfour, Connor Leahy
2022	A*	`conf`	Learning on Arbitrary Graph Topologies via Predictive Coding. NeurIPS Tommaso Salvatori, Luca Pinchetti, Beren Millidge, Yuhang Song, Tianyi Bao, Rafal Bogacz, Thomas Lukasiewicz
2022	J	`jnl`	Learning on Arbitrary Graph Topologies via Predictive Coding. CoRR Tommaso Salvatori, Luca Pinchetti, Beren Millidge, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
2022	J	`jnl`	Predictive Coding Approximates Backprop Along Arbitrary Computation Graphs. Neural Comput. Beren Millidge, Alexander Tschantz, Christopher L. Buckley
2022	A*	`conf`	Predictive Coding beyond Gaussian Distributions. NeurIPS Luca Pinchetti, Tommaso Salvatori, Yordan Yordanov, Beren Millidge, Yuhang Song, Thomas Lukasiewicz
2022	J	`jnl`	Predictive Coding beyond Gaussian Distributions. CoRR Luca Pinchetti, Tommaso Salvatori, Yordan Yordanov, Beren Millidge, Yuhang Song, Thomas Lukasiewicz
2022	A*	`conf`	Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation? IJCAI Beren Millidge, Tommaso Salvatori, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
2022	J	`jnl`	Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation? CoRR Beren Millidge, Tommaso Salvatori, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
2022	—	`conf`	Preventing Deterioration of Classification Accuracy in Predictive Coding Networks. IWAI Paul F. Kinghorn, Beren Millidge, Christopher L. Buckley
2022	J	`jnl`	Preventing Deterioration of Classification Accuracy in Predictive Coding Networks. CoRR Paul F. Kinghorn, Beren Millidge, Christopher L. Buckley
2022	J	`jnl`	Successor Representation Active Inference. CoRR Beren Millidge, Christopher L. Buckley
2022	A*	`conf`	Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Models. ICML Beren Millidge, Tommaso Salvatori, Yuhang Song, Thomas Lukasiewicz, Rafal Bogacz
2022	J	`jnl`	Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Models. CoRR Beren Millidge, Tommaso Salvatori, Yuhang Song, Thomas Lukasiewicz, Rafal Bogacz
2022	J	`jnl`	pymdp: A Python library for active inference in discrete state spaces. CoRR Conor Heins, Beren Millidge, Daphne Demekas, Brennan Klein, Karl J. Friston, Iain D. Couzin, Alexander Tschantz
2022	J	`jnl`	pymdp: A Python library for active inference in discrete state spaces. J. Open Source Softw. Conor Heins, Beren Millidge, Daphne Demekas, Brennan Klein, Karl J. Friston, Iain D. Couzin, Alexander Tschantz
2021	J	`jnl`	A Mathematical Walkthrough and Discussion of the Free Energy Principle. CoRR Beren Millidge, Anil K. Seth, Christopher L. Buckley
2021	J	`jnl`	Active Inference in Robotics and Artificial Agents: Survey and Challenges. CoRR Pablo Lanillos, Cristian Meo, Corrado Pezzato, Ajith Anil Meera, Mohamed Baioumy, Wataru Ohata, Alexander Tschantz, Beren Millidge, Martijn Wisse, Christopher L. Buckley, Jun Tani
2021	J	`jnl`	Applications of the Free Energy Principle to Machine Learning and Neuroscience. CoRR Beren Millidge
2021	—	`conf`	Habitual and Reflective Control in Hierarchical Predictive Coding. PKDD/ECML Workshops (1) Paul F. Kinghorn, Beren Millidge, Christopher L. Buckley
2021	J	`jnl`	Habitual and Reflective Control in Hierarchical Predictive Coding. CoRR Paul F. Kinghorn, Beren Millidge, Christopher L. Buckley
2021	J	`jnl`	Neural Kalman Filtering. CoRR Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
2021	J	`jnl`	Online reinforcement learning with sparse rewards through an active inference capsule. CoRR Alejandro Daniel Noel, Charel van Hoof, Beren Millidge
2021	J	`jnl`	Predictive Coding: a Theoretical and Experimental Review. CoRR Beren Millidge, Anil K. Seth, Christopher L. Buckley
2021	J	`jnl`	The Acquisition of Culturally Patterned Attention Styles Under Active Inference. Frontiers Neurorobotics Axel Constant, Alexander Tschantz, Beren Millidge, Felipe Criado-Boado, Luis M. Martinez, Johannes Müller, Andy Clark
2021	J	`jnl`	Towards a Mathematical Theory of Abstraction. CoRR Beren Millidge
2021	J	`jnl`	Understanding the origin of information-seeking exploration in probabilistic objectives for control. CoRR Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
2021	J	`jnl`	Whence the Expected Free Energy? Neural Comput. Beren Millidge, Alexander Tschantz, Christopher L. Buckley
2020	J	`jnl`	Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Brain. CoRR Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
2020	J	`jnl`	Control as Hybrid Inference. CoRR Alexander Tschantz, Beren Millidge, Anil K. Seth, Christopher L. Buckley
2020	J	`jnl`	Investigating the Scalability and Biological Plausibility of the Activation Relaxation Algorithm. CoRR Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
2020	—	`conf`	On the Relationship Between Active Inference and Control as Inference. IWAI Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
2020	J	`jnl`	On the Relationship Between Active Inference and Control as Inference. CoRR Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
2020	J	`jnl`	Predictive Coding Approximates Backprop along Arbitrary Computation Graphs. CoRR Beren Millidge, Alexander Tschantz, Christopher L. Buckley
2020	J	`jnl`	Reinforcement Learning as Iterative and Amortised Inference. CoRR Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
2020	J	`jnl`	Reinforcement Learning through Active Inference. CoRR Alexander Tschantz, Beren Millidge, Anil K. Seth, Christopher L. Buckley
2020	J	`jnl`	Relaxing the Constraints on Predictive Coding Models. CoRR Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
2020	—	`conf`	Sophisticated Affective Inference: Simulating Anticipatory Affective Dynamics of Imagining Future Events. IWAI Casper Hesp, Alexander Tschantz, Beren Millidge, Maxwell Ramstead, Karl J. Friston, Ryan Smith
2020	J	`jnl`	Whence the Expected Free Energy? CoRR Beren Millidge, Alexander Tschantz, Christopher L. Buckley
2019	J	`jnl`	Deep Active Inference as Variational Policy Gradients. CoRR Beren Millidge