Beren Millidge

Publication Activity (10 Years)

Years Active: 2019-2024
Publications (10 Years): 63

Top Topics

Predictive Coding

Theoretical Framework

Top Venues

Publications

Tommaso Salvatori, Beren Millidge, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
Associative Memories in the Feature Space. CoRR (2024)
Alexander Ororbia, Ankur Arjun Mali, Adam Kohan, Beren Millidge, Tommaso Salvatori
A Review of Neuroscience-Inspired Machine Learning. CoRR (2024)
Paolo Glorioso, Quentin Anthony, Yury Tokpanov, James Whittington, Jonathan Pilault, Adam Ibrahim, Beren Millidge
Zamba: A Compact 7B SSM Hybrid Model. CoRR (2024)
Tommaso Salvatori, Yuhang Song, Yordan Yordanov, Beren Millidge, Lei Sha, Cornelius Emde, Zhenghua Xu, Rafal Bogacz, Thomas Lukasiewicz
A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks. ICLR (2024)
Nick Alonso, Tomas Figliolia, Anthony Ndirango, Beren Millidge
Toward Conversational Agents with Context and Time Sensitive Long-term Memory. CoRR (2024)
Yury Tokpanov, Beren Millidge, Paolo Glorioso, Jonathan Pilault, Adam Ibrahim, James Whittington, Quentin Anthony
Zyda: A 1.3T Dataset for Open Language Modeling. CoRR (2024)
Quentin Anthony, Yury Tokpanov, Paolo Glorioso, Beren Millidge
BlackMamba: Mixture of Experts for State-Space Models. CoRR (2024)
Miguel De Llanza Varona, Christopher L. Buckley, Beren Millidge
Exploring Action-Centric Representations Through the Lens of Rate-Distortion Theory. IWAI (2023)
Beren Millidge, Yuhang Song, Tommaso Salvatori, Thomas Lukasiewicz, Rafal Bogacz
A Theoretical Framework for Inference and Learning in Predictive Coding Networks. ICLR (2023)
Mufeng Tang, Tommaso Salvatori, Beren Millidge, Yuhang Song, Thomas Lukasiewicz, Rafal Bogacz
Recurrent predictive coding models for associative memory employing covariance learning. PLoS Comput. Biol. 19 (4) (2023)
Alexander Tscshantz, Beren Millidge, Anil K. Seth, Christopher L. Buckley
Hybrid predictive coding: Inferring, fast and slow. PLoS Comput. Biol. 19 (8) (2023)
Conor Heins, Beren Millidge, Lancelot Da Costa, Richard Mann, Karl J. Friston, Iain D. Couzin
Collective behavior from surprise minimization. CoRR (2023)
Tommaso Salvatori, Luca Pinchetti, Amine M'Charrak, Beren Millidge, Thomas Lukasiewicz
Causal Inference via Predictive Coding. CoRR (2023)
Tommaso Salvatori, Beren Millidge, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
Associative Memories in the Feature Space. ECAI (2023)
Beren Millidge, Yuhang Song, Tommaso Salvatori, Thomas Lukasiewicz, Rafal Bogacz
Backpropagation at the Infinitesimal Inference Limit of Energy-Based Models: Unifying Predictive Coding, Equilibrium Propagation, and Contrastive Hebbian Learning. ICLR (2023)
Sid Black, Lee Sharkey, Léo Grinsztajn, Eric Winsor, Dan Braun, Jacob Merizian, Kip Parker, Carlos Ramón Guevara, Beren Millidge, Gabriel Alfour, Connor Leahy
Interpreting Neural Networks through the Polytope Lens. CoRR (2022)
Beren Millidge, Christopher L. Buckley
Successor Representation Active Inference. CoRR (2022)
Paul F. Kinghorn, Beren Millidge, Christopher L. Buckley
Preventing Deterioration of Classification Accuracy in Predictive Coding Networks. CoRR (2022)
Beren Millidge, Tommaso Salvatori, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation? CoRR (2022)
Beren Millidge, Christopher L. Buckley
Active Inference Successor Representations. IWAI (2022)
Beren Millidge, Yuhang Song, Tommaso Salvatori, Thomas Lukasiewicz, Rafal Bogacz
Backpropagation at the Infinitesimal Inference Limit of Energy-Based Models: Unifying Predictive Coding, Equilibrium Propagation, and Contrastive Hebbian Learning. CoRR (2022)
Beren Millidge, Tommaso Salvatori, Yuhang Song, Thomas Lukasiewicz, Rafal Bogacz
Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Models. CoRR (2022)
Paul F. Kinghorn, Beren Millidge, Christopher L. Buckley
Preventing Deterioration of Classification Accuracy in Predictive Coding Networks. IWAI (2022)
Conor Heins, Beren Millidge, Daphne Demekas, Brennan Klein, Karl J. Friston, Iain Couzin, Alexander Tschantz
pymdp: A Python library for active inference in discrete state spaces. CoRR (2022)
Tommaso Salvatori, Luca Pinchetti, Beren Millidge, Yuhang Song, Tianyi Bao, Rafal Bogacz, Thomas Lukasiewicz
Learning on Arbitrary Graph Topologies via Predictive Coding. NeurIPS (2022)
Alexander Tschantz, Beren Millidge, Anil K. Seth, Christopher L. Buckley
Hybrid Predictive Coding: Inferring, Fast and Slow. CoRR (2022)
Luca Pinchetti, Tommaso Salvatori, Yordan Yordanov, Beren Millidge, Yuhang Song, Thomas Lukasiewicz
Predictive Coding beyond Gaussian Distributions. NeurIPS (2022)
Tommaso Salvatori, Luca Pinchetti, Beren Millidge, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
Learning on Arbitrary Graph Topologies via Predictive Coding. CoRR (2022)
Nick Alonso, Beren Millidge, Jeff Krichmar, Emre Neftci
A Theoretical Framework for Inference Learning. CoRR (2022)
Nick Alonso, Beren Millidge, Jeffrey L. Krichmar, Emre O. Neftci
A Theoretical Framework for Inference Learning. NeurIPS (2022)
Conor Heins, Beren Millidge, Daphne Demekas, Brennan Klein, Karl J. Friston, Iain D. Couzin, Alexander Tschantz
pymdp: A Python library for active inference in discrete state spaces. J. Open Source Softw. 7 (73) (2022)
Beren Millidge, Yuhang Song, Tommaso Salvatori, Thomas Lukasiewicz, Rafal Bogacz
A Theoretical Framework for Inference and Learning in Predictive Coding Networks. CoRR (2022)
Beren Millidge, Tommaso Salvatori, Yuhang Song, Thomas Lukasiewicz, Rafal Bogacz
Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Models. ICML (2022)
Beren Millidge, Alexander Tschantz, Christopher L. Buckley
Predictive Coding Approximates Backprop Along Arbitrary Computation Graphs. Neural Comput. 34 (6) (2022)
Tommaso Salvatori, Yuhang Song, Beren Millidge, Zhenghua Xu, Lei Sha, Cornelius Emde, Rafal Bogacz, Thomas Lukasiewicz
Incremental Predictive Coding: A Parallel and Fully Automatic Learning Algorithm. CoRR (2022)
Karl J. Friston, Maxwell J. D. Ramstead, Alex B. Kiefer, Alexander Tschantz, Christopher L. Buckley, Mahault Albarracin, Riddhi J. Pitliya, Conor Heins, Brennan Klein, Beren Millidge, Dalton A. R. Sakthivadivel, Toby St Clere Smithe, Magnus T. Koudahl, Safae Essafi Tremblay, Capm Petersen, Kaiser Fung, Jason G. Fox, Steven Swanson, Dan Mapes, Gabriel René
Designing Ecosystems of Intelligence from First Principles. CoRR (2022)
Beren Millidge, Tommaso Salvatori, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz
Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation? IJCAI (2022)
Luca Pinchetti, Tommaso Salvatori, Yordan Yordanov, Beren Millidge, Yuhang Song, Thomas Lukasiewicz
Predictive Coding beyond Gaussian Distributions. CoRR (2022)
Alex B. Kiefer, Beren Millidge, Alexander Tschantz, Christopher L. Buckley
Capsule Networks as Generative Models. IWAI (2022)
Beren Millidge
Applications of the Free Energy Principle to Machine Learning and Neuroscience. CoRR (2021)
Alejandro Daniel Noel, Charel van Hoof, Beren Millidge
Online reinforcement learning with sparse rewards through an active inference capsule. CoRR (2021)
Pablo Lanillos, Cristian Meo, Corrado Pezzato, Ajith Anil Meera, Mohamed Baioumy, Wataru Ohata, Alexander Tschantz, Beren Millidge, Martijn Wisse, Christopher L. Buckley, Jun Tani
Active Inference in Robotics and Artificial Agents: Survey and Challenges. CoRR (2021)
Beren Millidge
Towards a Mathematical Theory of Abstraction. CoRR (2021)
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
Understanding the origin of information-seeking exploration in probabilistic objectives for control. CoRR (2021)
Paul F. Kinghorn, Beren Millidge, Christopher L. Buckley
Habitual and Reflective Control in Hierarchical Predictive Coding. PKDD/ECML Workshops (1) (2021)
Beren Millidge, Anil K. Seth, Christopher L. Buckley
Predictive Coding: a Theoretical and Experimental Review. CoRR (2021)
Axel Constant, Alexander Tschantz, Beren Millidge, Felipe Criado-Boado, Luis M. Martinez, Johannes Müller, Andy Clark
The Acquisition of Culturally Patterned Attention Styles Under Active Inference. Frontiers Neurorobotics 15 (2021)
Beren Millidge, Anil K. Seth, Christopher L. Buckley
A Mathematical Walkthrough and Discussion of the Free Energy Principle. CoRR (2021)
Beren Millidge, Alexander Tschantz, Christopher L. Buckley
Whence the Expected Free Energy? Neural Comput. 33 (2) (2021)
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
Neural Kalman Filtering. CoRR (2021)
Paul F. Kinghorn, Beren Millidge, Christopher L. Buckley
Habitual and Reflective Control in Hierarchical Predictive Coding. CoRR (2021)
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
Reinforcement Learning as Iterative and Amortised Inference. CoRR (2020)
Casper Hesp, Alexander Tschantz, Beren Millidge, Maxwell Ramstead, Karl J. Friston, Ryan Smith
Sophisticated Affective Inference: Simulating Anticipatory Affective Dynamics of Imagining Future Events. IWAI (2020)
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Brain. CoRR (2020)
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
Relaxing the Constraints on Predictive Coding Models. CoRR (2020)
Alexander Tschantz, Beren Millidge, Anil K. Seth, Christopher L. Buckley
Control as Hybrid Inference. CoRR (2020)
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
On the Relationship Between Active Inference and Control as Inference. CoRR (2020)
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
Investigating the Scalability and Biological Plausibility of the Activation Relaxation Algorithm. CoRR (2020)
Beren Millidge, Alexander Tschantz, Christopher L. Buckley
Predictive Coding Approximates Backprop along Arbitrary Computation Graphs. CoRR (2020)
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
On the Relationship Between Active Inference and Control as Inference. IWAI (2020)
Beren Millidge, Alexander Tschantz, Christopher L. Buckley
Whence the Expected Free Energy? CoRR (2020)
Alexander Tschantz, Beren Millidge, Anil K. Seth, Christopher L. Buckley
Reinforcement Learning through Active Inference. CoRR (2020)
Beren Millidge
Deep Active Inference as Variational Policy Gradients. CoRR (2019)