Skip to content

Decision Boundary Drift: A Security, Privacy, and Trust Risk of Continual Learning for Agentic AI in Edge Networks

2026 · IEEE Transactions on Network Science and Engineering · Vol 13, pp. 11081-11097 · 0 citations · 110 references

Abstract

Continual learning (CL) is a key paradigm that enables intelligent agents to operate autonomously in edge networks over the long term. However, continuous model updates can lead to catastrophic forgetting and representation instability in edge deployment scenarios, which may further induce Decision Boundary Drift (DBD). We propose a DBD-based adversarial attack framework that exploits class-level drift modeling and leverages the deformation of decision boundaries caused by incremental updates. We introduce multiple statistical metrics to quantify boundary drift, based on which class-level adversarial perturbations are constructed and further optimized in the input space to generate effective adversarial examples. Extensive experiments on multiple datasets and continual learning models demonstrate that the proposed method can significantly degrade model robustness, revealing non-negligible security risks in continuously evolving learning systems. Inspired by the security and trustworthiness requirements of edge intelligent agents, we systematically study and quantify DBD and its associated security risks in continual learning. Our findings reveal a practical yet underestimated attack surface and provide a foundation for future research on secure and robust continual learning systems.

View source

Similar papers

#explainable ai Open access Sep 2026

Privacy-aware adversarial defense with explainable AI for adversarial robustness in AI model

The Attention Concentration Score (ACS) is introduced, which measures how DP training shifts Transformer attention away from task-critical features toward non-functional ones, providing a mechanistic explanation of the trade-off.

Bilal Sardar, Shareeful Islam, Stefano Silvestri et al. · 0 citations
Open access Oct 2026

Adversarially robust dynamic trust evaluation via graph-attentive reinforcement learning for scalable edge IoT security

Edge IoT deployments must evaluate the trustworthiness of peer devices continuously, locally, and under resource constraints that static scoring models cannot accommodate—particularly when adversaries adapt their mimicry strategies in response to observed detection outcomes. This study presents the Adaptive Dynamic T...

Pavansai Ramarao Maddali, Vijay Kumar Damera, Ratna Kumar Prathipati · 0 citations
Open access 2026

A Sensitivity-Driven Gradient Framework for Adversarial Sample Generation in Deep Learning-Based Network Intrusion Detection Systems

A sensitivity-driven adversarial generation framework (AGF) that identifies and perturbs the most influential traffic features that affect the classifier’s decision boundary to generate statistically consistent adversarial samples with constrained perturbation magnitude is proposed.

Omar Abboosh Hussein Gwassi, O. N. Uçan · 0 citations
Preprint Aug 2026

Catastrophic Learning: A New Attack Vector on Continual Learning Networks

The results demonstrate a strong vulnerability: an adversary can selectively impede plasticity to hinder the acquisition of new knowledge, while promoting loss of prior knowledge, inducing a catastrophic learning scenario.

Benedikt Kluss, Niklas Bunzel · 0 citations
#machine learning Preprint Sep 2026

Probabilistic Robustness-driven Universal Adversarial Perturbations with Explainability against Deep Reinforcement Learning-based Intrusion Detection System

This work proposes PR-based UAP, which represents the first integration of an explicit PR-driven objective into generating UAPs against DRL-based IDS and introduces PX-UAP, which leverages explainable artificial intelligence (XAI) to guide perturbation shaping under realistic domain constraints, and provides a rigorous...

Hong-Sen Zhang, Lu Zhang, Ming-Jing Xu et al. · 0 citations
#federated learning Open access Sep 2026

Friend-Safe Adversarial Attack for selective evasion in personalized federated learning

Federated Learning (FL) enables collaborative model training across distributed clients while preserving data privacy; however, the personalization of client models in non-independent and identically distributed (non-IID) settings creates an unexplored attack surface where adversarial examples can selectively fool spec...

Hyun Kwon, Dae-Jin Kim · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.