Skip to content

Provable Speedups From Dynamic Population Sizes in Evolutionary Algorithms for Multiobjective Optimization

Jul 2026 · arXiv.org · Vol abs/2607.23800 · 0 citations · 57 references
Computer Science

TL;DR

This paper introduces the bi-objective problem class CLIMB and analyzes the runtime of GSEMO and the widely used NSGA-II on this problem, and proves that GSEMO and NSGA-II-DYN, a version of NSGA-II with dynamic population sizes, can find the Pareto front of CLIMB in expected fitness evaluations.

Abstract

This paper investigates the role of dynamic population sizes in evolutionary multi-objective optimization. Although such approaches are widely used in practice, their benefits remain poorly understood, and rigorous runtime analyses explaining when and why they help are still scarce. To address this, we introduce the bi-objective problem class CLIMB and analyze the runtime of GSEMO and the widely used NSGA-II on this problem. Our results show that allowing a dynamic population size for NSGA-II can lead to a moderate improvement, yielding a speedup of order $\Omega(\sqrt{n}/\log n)$. In particular, we prove that GSEMO and NSGA-II-DYN, a version of NSGA-II with dynamic population sizes we propose in this paper, can find the Pareto front of CLIMB in expected $O(n \log n)$ fitness evaluations, whereas NSGA-II with a fixed population size requires $\Omega(n^{1.5})$ fitness evaluations in expectation. To the best of our knowledge, this is the first rigorous runtime analysis in multi-objective optimization demonstrating a super-constant speedup of GSEMO over NSGA-II. Our analysis builds on concepts from single-objective optimization, like the evolution of population diversity over time, and employs the well-known family-three method to prove the lower bound.

View source

Similar papers

Book Open access Jul 2026

Hot of the Press: A First Runtime Analysis of NSGA-III on a Many-Objective Multimodal Problem: Provable Exponential Speedup via Stochastic Population Update

A rigorous runtime analysis of NSGA-III on the many-objective OneJumpZeroJump benchmark, providing runtime bounds where the number of objectives is constant and a stochastic population update provably guarantees a speedup of order Θ((k/b)k-1) in the runtime where b > 0 is a constant.

Andre Opris · 11 citations
Book Open access Jul 2026

Hot of the Press: Tight Runtime Guarantees From Understanding the Population Dynamics of the GSEMO Multi-Objective Evolutionary Algorithm

This work significantly enhance the understanding of the dynamics of the GSEMO, in particular, for the classic CountingOnesCountingZeros benchmark, and proves a lower bound of order Ω(n2 log n), for the first time matching the seminal upper bounds known for over twenty years.

Benjamin Doerr, Martin S. Krejca, Andre Opris · 0 citations
Book Open access Jul 2026

Hot off the Press: Stochastic Population Update Can Provably Be Helpful in Multi-Objective Evolutionary Algorithms

Evolutionary algorithms (EAs) have been widely and successfully applied to solve multi-objective optimization problems, due to their nature of population-based search. Population update, a key component in multi-objective EAs (MOEAs), is usually performed in a greedy, deterministic manner. In this paper, we analytically present that stochastic population update can be beneficial for the search of MOEAs. Specifically, we prove that the expected running time of two well-established MOEAs, SMS-EMOA and NSGA-II, for solving two bi-objective problems, OneJumpZeroJump and bi-objective RealRoyalRoad, can be exponentially decreased if replacing its deterministic population update mechanism by a stochastic one. Empirical studies also verify the effectiveness of the proposed population update method. This work is an attempt to show the benefit of introducing randomness into the population update of MOEAs. Its positive results, which might hold more generally, should encourage the exploration of developing new MOEAs in the area. This paper for the Hot-off-the-Press track at GECCO 2025 summarizes the work C. Bian, Y. Zhou, M. Li, and C. Qian. Stochastic Population Update Can Provably Be Helpful in Multi-Objective Evolutionary Algorithms. Artificial Intelligence, 2025, 341: 104308. [5]

Chao Bian, Yawen Zhou, Miqing Li et al. · 0 citations
Book Open access Jul 2026

Hot off the Press: A Theoretical Perspective on Why Stochastic Population Update Needs an Archive in Evolutionary Multi-objective Optimization

Evolutionary algorithms (EAs) are popular for multi-objective optimization due to their population-based nature. While population updates in multi-objective EAs (MOEAs) are typically greedy and deterministic. However, recent studies have questioned this practice and shown that stochastic population update (SPU), which allows inferior solutions have a chance to be preserved, can help MOEAs jump out of local optima more easily. Nevertheless, SPU risks losing high-quality solutions, potentially requiring a large population. Intuitively, a possible solution to this issue is to introduce an archive that stores the best solutions ever found. This paper theoretically demonstrates that incorporating an archive to store best-found solutions enables smaller populations and enhances SPU-based MOEA performance. Analyzing SMS-EMOA and NSGA-II on the bi-objective OneJumpZeroJump problem, we prove archives reduce expected running time upper bounds (even exponentially). The comparison between SMS-EMOA and NSGA-II also suggests that the (μ + μ) update mode may be more suitable for SPU than the (μ + 1) update mode. We also validate our findings empirically. This paper for the Hot-off-the-Press track at GECCO 2026 sum marizes the work S. Ren, Z. Liang, M. Li, and C. Qian. A Theoretical Perspective on Why Stochastic Population Update Needs an Archive in Evolutionary Multi-objective Optimization. IJCAI, 2025, 8921: 8929. [17]

Shengjie Ren, Zimin Liang, Miqing Li et al. · 0 citations
Book Open access Jul 2026

Benchmarking Metaheuristics for Mixed-Integer Optimization

This paper compares six different strategies identified in a recent survey, categorizing them as either global strategies (GS), which treat the decision vector as a unified type, or decomposition-based strategies (DS), which split the problem into continuous and discrete subproblems.

Thomas Lang, Denis Pallez · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.