This work considers a minimal model of active agents which collectively learn to reach a target macroscopic state via a decentralized adaptation process via a decentralized adaptation process, and describes the evolution of the policy distribution across the agent population with a kinetic theory.
Abstract
We consider a minimal model of active agents which collectively learn to reach a target macroscopic state via a decentralized adaptation process. Agents are modeled as active Brownian particles which randomly reorient to a given direction through tumbling events. An average target state is encoded into a reward function evaluated by each agent. Agents can tune one of the parameters of their microscopic dynamics, called `policy'(e.g., speed or reorientation direction), to optimize their reward function thanks to information exchange with neighboring agents. We describe the evolution of the policy distribution across the agent population with a kinetic theory, under the assumption that the adaptation process is slow with respect to the physical dynamics. The adaptation process is illustrated on several learning protocols with either fixed or time-dependent target velocities. A characteristic learning time $\tau$ combining teaching and mutations emerges from the dynamics. For time-oscillating targets at angular frequency $\omega$, the collective dynamics oscillates in time, with an oscillation amplitude and phase shift determined by the product $\omega \tau$. An unlocking transition to a non-adaptable state is also observed for a rotating target velocity.
A coupled learning--environment model in which agents update stateless $Q-values on a fixed graph, while their population-average behavior drives an environmental variable that dynamically modifies the payoff matrix is formulated.
It is shown that temporal trajectories can act like a coordinated population, reducing control energy by 19–24% in demand response while still reaching the desired final distribution.
Paradigmatic interaction models explain how collective behaviors can emerge in complex systems from interactions among the constituent agents. In bio-inspired swarms, however, interactions alone may not suffice to bring the population to a desired aggregate configuration within a prescribed time horizon, as needed in a...
Asmaa Eldesoukey, Manfred Haider, Italo Napolitano et al.· 1 citation
Using computer simulations, we investigate the collective behavior of two-dimensional active Brownian particles (ABPs) with excluded-volume interactions in the bulk and in the presence of a single static circular obstacle. Perception-mediated interactions are introduced through a vision-based steering mechanism that en...
S. Sahoo, Arabinda Bera, Jiarul Midya· 0 citations
It is hypothesized that many of these problems defy the initial-condition driven or gradients on landscapes so useful in problems ranging from mechanics to electrodynamics to chemical kinetics to mass and heat transport.
Sara D. Mahdavi, Gabriel L. Salmon, Minakshi Ashok et al.· bioRxiv· 0 citations
It is hypothesized that many of these problems defy the initial-condition driven or gradients on landscapes so useful in problems ranging from mechanics to electrodynamics to chemical kinetics to mass and heat transport.
Sara D. Mahdavi, Gabriel L. Salmon, Minakshi Ashok et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.