Skip to content
Review

ANOMALY DETECTION ALGORITHMS IN STREAMING DATA: COMPARATIVE ANALYSIS AND APPLICATION

2026 · Herald Of Technological University · 0 citations

Abstract

This paper presents a systematic review and comparative analysis of state-of-the-art anomaly detection algorithms for streaming data - one of the fundamental problems in data mining, cybersecurity, and industrial monitoring. Unlike existing surveys, which mostly address the batch setting, all methods here are examined from a streaming perspective: per-observation processing cost, resident memory footprint, and the ability to update the model incrementally. An explicit set of comparison criteria is introduced - computational complexity, memory requirements, adaptivity, robustness to concept drift, and interpretability - together with the scales and rules used to assign qualitative ratings. Four major algorithm classes are examined: statistical methods (Z-score, EWMA, CUSUM, Shewhart control charts), distance- and density-based methods (k-NN, LOF, ILOF), ensemble methods - Isolation Forest and its streaming adaptations Half-Space Trees, iForestASD, and Robust Random Cut Forest - and neural network architectures including autoencoders (Autoencoder, VAE, LSTM-Autoencoder) and transformer-based models (Anomaly Transformer, TranAD). For each class, both strengths and intrinsic limitations are systematised: the dependence of statistical methods on distributional assumptions, the degradation of distance-based methods in high-dimensional spaces, the sensitivity of Isolation Forest to complex data structures and masking effects, and the high resource demands and limited interpretability of neural models. Concept drift adaptation strategies are discussed: sliding window, weighted learning, and the ADWIN algorithm. Evaluation results on real-world datasets are described - KDD Cup 1999 (cybersecurity) and SMAP NASA (industrial IoT) - along with the well-documented methodological limitations of these benchmarks and evaluation protocols, which imply that published metric values should be treated as upper bounds. Key practical application domains are considered: network intrusion detection, predictive equipment maintenance, financial transaction monitoring, and medical diagnostics. The results demonstrate that algorithm selection is governed by a trade-off between computational efficiency, accuracy, and adaptability; practical selection guidelines are formulated for five typical deployment scenarios. Promising directions for future research are identified: federated learning, explainable models (SHAP, LIME), transformer-based architectures, and hardware acceleration on FPGAs.

View source

Similar papers

Review Open access 2026

An Adaptive Machine Learning Framework for Anomaly Detection in Cloud-Based Storage Systems

This study created and verified an adaptive machine learning framework that makes use of real-time model updates and domain-specific cloud infrastructure information and offers a deployable framework for improving cloud security in Kenya and other resource-constrained environments.

Milimo Moses Sibilike · 0 citations
Sep 2026

Scalable and Adaptive Log-based Anomaly Detection: A Synergistic Approach

System logs are critical for software reliability. While many automated log-based anomaly detection methods exist, they often falter in large-scale cloud systems due to high resource consumption and poor adaptability to evolving logs. In this paper, we present SeaLog, an accurate, lightweight, and adaptive log-based an...

Jinyang Liu, Jun-Jie Huang, Zhihan Jiang et al. · 0 citations
Review Open access Sep 2026

Real-Time Anomaly Detection in Distributed Financial Transaction Streams Using Machine Learning: From Statistical Detection to Operational Reliability

Financial transaction monitoring is increasingly expected to identify anomalous and potentially fraudulent activity while transactions are still operationally actionable. This requirement is more demanding than conventional offline classification because the detector is embedded in an unbounded, distributed stream in w...

John Kwesi Erbynn, Doreen Appiah, A. Ampomah-Britwum · 0 citations
Review

ma-Does the implementation of machine-learning-based anomaly detection increase the risk of system latency and false-positive trips in automated smart grid controllers compared to traditional regex-based filtering?

The findings indicate that hybrid-based approach to architecture should be suggested, where rule-based filtering is applied to address the time-sensitive deterministic checks, and the ML models give the context-driven anomaly analysis on both the SCADA and the wide-area layers.

Wenxuan Cao · 0 citations
Review Open access Sep 2026

DEEP LEARNING-BASED INTRUSION DETECTION SYSTEMS: ARCHITECTURES, IMPLEMENTATIONS, AND CHALLENGES IN MODERN NETWORK ANOMALY DETECTION

The revised framework extends this four-layer pipeline by explicitly integrating Explainable AI (XAI) and edge-oriented deployment as cross-cutting operational requirements by explicitly integrating Explainable AI (XAI) and edge-oriented deployment as cross-cutting operational requirements.

A. Havy, Muhammad Faishol Amrulloh · 0 citations
Review Open access Oct 2026

Machine Learning and Deep Learning Approaches for Anomaly Detection: A Review

Anomaly detection is a crucial machine learning problem designed to uncover observations or patterns that are unusual, or outlier behaviors. It is commonly used in cyber security, Internet of Things (IoT), industrial monitoring, health care and other data-driven systems. But anomaly detection is still a challenge due t...

Sonia Shaifun Nahar, Sharma Atul · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.