Skip to content
#federated learning Open access

Federated MapReduce fractional deep learning for scalable and privacy-aware intrusion detection in cloud computing

Sep 2026 · Discover Computing · Vol 29 · 0 citations · 26 references
Network Security and Intrusion Detection

Abstract

Conventional intrusion detection systems (IDSs) are not suitable for large-scale, heterogeneous, and privacy-sensitive cloud environments, owing to the rapid adoption of cloud computing and Internet of Things (IoT) technologies, which have resulted in an increasing scale and complexity of cyberattacks. Current machine learning, deep learning, and federated IDS methods are typically centralised, cannot be scaled to provide high service availability, are inefficient at distributing data preprocessing, are not robust enough to converge under non-IID data distributions, and lack proper adaptive optimisations. In order to overcome these drawbacks, in this paper, a Federated MapReduce-Enabled Fractional Deep Learning Framework (FedMR-FFNet) is proposed to provide scalable and privacy-preserving intrusion detection in cloud computing. The proposed structure includes MapReduce-based distributed preprocessing to process features in a large scale efficiently, HSBOA-driven ensemble feature selection to select informative features of an intrusion, Fractional Feedforward Network (FFNet) learning to address the issues of complex nonlinear intrusion pattern representations, Taylor Wave Search Algorithm (TWSA) for optimizing the model parameters adaptively, and an adaptive federated aggregation strategy to assign weights to the clients based on their dataset size, loss, update consistency, and noise level to enhance the robustness under heterogeneous non-IID environments. The proposed framework is validated through extensive experiments conducted on the NSL-KDD, CIC-IDS2017 and TON_IoT datasets. The methods of FedMR-FFNet show high accuracy (99.18%), precision (99.03%), recall (98.94%) and F1-score (98.98%), and the convergence speed is stable, reducing the computational time and improving the accuracy, precision, recall and F1-score relative to conventional machine learning, deep learning and federated IDS. Moreover, the framework exhibits high cross-dataset generalisation, communication efficiency, scalability and privacy preservation, which presents a promising solution to intelligent intrusion detection in modern distributed cloud and IoT infrastructures. Not applicable.

Read PDF

Similar papers

#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54
#machine learning Review Open access Jun 2014

Why Early-Stage Software Startups Fail: A Behavioral Framework

This state-of-practice investigation was performed using a literature review followed by a multiple-case study approach and presents how inconsistency between managerial strategies and execution can lead to failure by means of a behavioral framework.

Carmine Giardino, Xiaofeng Wang, P. Abrahamsson · 175 citations · ⚡19
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#machine learning Review Open access May 2016

Key Challenges in Software Startups Across Life Cycle Stages

It is found that what perceived as biggest challenges by software startups do vary across different life cycle stages, even though its significance decreases when the learning focuses of the startups move from problem to solution and their products mature.

Xiaofeng Wang, Henry Edison, Sohaib Shahid Bajwa et al. · 62 citations · ⚡6

Related blog posts

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.