Advances in Multi-Agent Deep Reinforcement Learning: Methods with Applications and Challenges

Abstract

Multi-agent deep reinforcement learning (MARL) extends deep reinforcement learning (DRL) to environments involving multiple interacting agents and has enabled applications in domains such as autonomous vehicles, robotics, unmanned aerial vehicles (UAVs), and multi-player games. Compared with single-agent learning, MARL introduces additional challenges, including non-stationarity, partial observability, multi-agent credit assignment, and scalability. This paper presents a narrative survey of recent developments in MARL and discusses major approaches proposed to address these challenges. In particular, we examine research directions centred on centralised training with decentralised execution (CTDE), value decomposition, learned communication, graph-based methods, and model-based learning. We further discuss commonly used benchmark environments and evaluation practices, highlighting considerations related to reproducibility, robustness, and generalisation. Finally, we outline open research challenges and future directions concerning theoretical understanding, sample efficiency, scalable coordination, and deployment in real-world settings. Rather than providing an exhaustive systematic review, this survey aims to offer an organised and up-to-date synthesis of recent progress in MARL.