Skip to content

A Bellman Optimality Equation for Plasticity

Sep 2026 · 0 citations · 9 references
Computer Science

TL;DR

Preliminary work toward optimizing plasticity within Markov decision processes is presented and it is shown that there exists a Bellman optimality equation for optimizing plasticity similar to previous work for empowerment.

Abstract

In continual reinforcement learning, carefully managing the stability-plasticity tradeoff remains a core challenge. Recent work by Abel et al. (2025) formalized this dilemma by defining plasticity as the generalized directed information from an agent's observations to its actions, and empowerment as the generalized directed information from its actions to its observations. This formulation successfully reframes the traditional stability-plasticity tradeoff as an empowerment-plasticity tradeoff. However, while extensive literature exists on optimizing for empowerment, there is currently no research addressing the optimization of plasticity under this new definition. This paper presents preliminary work toward optimizing plasticity within Markov decision processes. We show that there exists a Bellman optimality equation for optimizing plasticity similar to previous work for empowerment.

View source

Similar papers

Preprint Sep 2026

A theory of plasticity: capacity for change as inverse configurational constraint

Plasticity is invoked across the sciences to explain how systems can change, yet it is inferred from the very change it is meant to explain. A system may have many alternatives, realize none and still be plastic. Another may be driven far toward its only alternative, but the magnitude of that change does not establish...

I. Branchi · 0 citations
#machine learning Preprint Sep 2026

Generalized Residual Closure: General Learning Dynamics for Stability-Plasticity Compatibility

Learning must acquire new capabilities while preserving both prior responsibilities and the capacity to learn again. We introduce Generalized Residual Closure (GRC), a framework for learning as recursive closure of future-relevant discrepancies: closing a residual establishes the conditions for subsequent prediction, i...

Dong-Xu Li, Yi-Nuo Zhang, Hong-Yu Zhang et al. · 0 citations
Preprint Oct 2026

Energy-fed commitment: a minimal model of random selection followed by reinforcement

When a symmetric instability is crossed, fluctuations choose one of several equivalent branches. We study a minimal stochastic model of what can then make that choice progressively harder to undo. After selection, the stiffness of the selected state grows in proportion to the energy released each time the structure rec...

Haidar Issa Abbas · 0 citations
Preprint Aug 2026

Evolutionary Recurrent Decision Model in Developing Adaptive and Maladaptive Behaviors

The results suggest that many psychopathology-relevant aspects may be interpreted as bounded cognitive systems operating under modern-ancestral environmental mismatch, positioning ERDM as a key computational cognitive tool that can be extended to other studies.

Andrew Hu · 0 citations
#machine learning Preprint Oct 2026

Continual Reinforcement Learning with Neuroevolution

Neuroevolution is established as a competitive alternative to RL under continual task changes, and it is suggested that training under perturbations in weight space may be a useful mechanism for continual learning more broadly.

Eleni Nisioti, Andrea Cossu, Kathrin Korte et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.