Dynamic Siamese Expansion Framework for Improving Robustness in Online Continual Learning

Fei Ye Yulong Zhao Qihe Liu Junlin Chen A. Bors Jinglin Sun Rongyao Hu Shijie Zhou

2025 · Neural Information Processing Systems · 3 citations · 38 references

Computer Science

TL;DR

An innovative approach to robustness in continual learning systems is introduced, the Dynamic Siamese Expansion Framework (DSEF) that employs a Siamese backbone architecture, comprising static and dynamic components, to facilitate the learning of both global and local representations over time.

Abstract

Continual learning requires the model to continually capture novel information without forgetting prior knowledge. Nonetheless, existing studies predominantly address catastrophic forgetting, often neglecting enhancements in model robustness. Consequently, these methodologies fall short in real-time applications, such as autonomous driving, where data samples frequently exhibit noise due to environmental and lighting variations, thereby impairing model efficacy and causing safety issues. In this paper, we address robustness in continual learning systems by introducing an innovative approach, the Dynamic Siamese Expansion Framework (DSEF) that employs a Siamese backbone architecture, comprising static and dynamic components, to facilitate the learning of both global and local representations over time. Specifically, the proposed framework dynamically generates a lightweight expert for each novel task, leveraging the Siamese backbone to enable rapid adaptation. A novel Robust Dynamic Representation Optimization (RDRO) approach is proposed to incrementally update the dynamic backbone by maintaining all previously acquired representations and prediction patterns of historical experts, thereby fostering new task learning without inducing detrimental knowledge transfer. Additionally, we propose a novel Robust Feature Fusion (RFF) approach to incrementally amalgamate robust representations from all historical experts into the expert construction process. A novel mutual information-based technique is employed to derive adaptive weights for feature fusion by assessing the knowledge relevance between historical experts and the new task, thus maximizing positive knowledge transfer effects. A comprehensive experimental evaluation, benchmarking our approach against established baselines, demonstrates that our method achieves state-of-the-art performance even under adversarial attacks. Code is released at https://github.com/seSysdl/DSEF.

DOI Semantic Scholar

View source

Similar papers

Jun 2026

Attention-based Experience Replay Framework for Continual Learning of Agnostic Time Series Forecasting Models

This work introduces a novel framework for continual time series forecasting, designed to extend existing static forecasting models commonly used in the literature by incorporating an Experience Replay strategy guided by Attention mechanisms, which allows the model to adapt dynamically to new contexts while preserving prior knowledge, effectively mitigating catastrophic forgetting.

Quentin Besnard, Nicolas Ragot · arXiv.org · 0 citations

Open access Jul 2026

Navigating parameter space: mitigating catastrophic forgetting in continual learning

Investigation of the influence of fully connected FC layer architecture on parameter regularization in the class incremental learning setting using a modified ResNet-18 trained on the CIFAR-10 dataset provides both a novel parameter regularization strategy and new insights into the interaction between network architecture and catastrophic forgetting in continual learning.

Henry Huang · Journal of high school scien... · 0 citations

Review Open access Aug 2026

Modern Continual Learning with Foundation Models, Evaluation Challenges, and Future Directions

This review provides a structured overview of major CL paradigms, including task-incremental, domain-incremental, class-incremental, online, multimodal, and federated CL, and examines the theoretical foundations of CL, particularly the stability–plasticity dilemma, catastrophic forgetting, transfer dynamics, and representation learning.

Zahid Ullah, Minki Hong, Jihie Kim · Mathematics · 0 citations

Preprint Aug 2026

BPG: Balancing Plasticity and Generalization for Domain Incremental Learning

Deep neural networks excel in various tasks but struggle to generalize across evolving data distributions, leading to significant performance degradation under domain shifts. Domain incremental learning (DIL) addresses this challenge by enabling models to continuously adapt while retaining prior knowledge. Among existing DIL approaches, the parameter-isolation paradigm achieves state-of-the-art performance. However, these methods often adopt a one-size-fits-all approach to adapt to new domains, resulting in either insufficient learning capacity or redundant parameters. In this work, we propose BPG, a unified framework that addresses both challenges through two complementary components: BPG-Adapter, which dynamically determines each domain's adapter hidden dimension based on domain-specific feature separability, and BPG-Inference, a soft domain mixture strategy that integrates multiple domain-specific models at test time, mitigating domain ID misselection. Experimental results on DomainNet, CDDB, and CORe50 demonstrate that BPG consistently outperforms uniform adapter-based approaches and hard domain selection strategies, achieving state-of-the-art average accuracy while reducing forgetting to as low as 0.22% on DomainNet.

Qiang Wang, Songlin Dong, Shaokun Wang et al. · 0 citations

Open access Jul 2026

Miles: Metric Learning With Expandable Subspace for Pre-Trained Model-Based Class-Incremental Learning

Miles decouples the learnable modules with the pre-trained model, exploiting prior information from intermediate features of the backbone network to enable more flexible parameter expansion, and orchestrating an efficient expansion of the parameter space through guided optimization.

Kai Jiang, Zisong Lin, Hongyuan Zhang et al. · IEEE Transactions on Image P... · 0 citations

Jul 2026

Continual Video-MLLM Adaptation over Evolving Domains

DAER maintains domain-isolated lightweight experts while keeping the pretrained Video-MLLM backbone frozen, thereby decoupling domain-specific adaptation from the general multimodal knowledge of the pretrained model, and introduces adaptive domain merging to improve parameter scalability and a two-stage optimization strategy to stabilize expert specialization during continual learning.

Rui Cheng, Meixing Shi, Yuxiang Cai et al. · arXiv.org · 0 citations