Skip to content
Open access

Self-Adaptive Distributed Computing Models for High-Performance Analytics

2025 · International Journal of Applied Data Science & Modern Computing · 0 citations

TL;DR

This work proposes a scalable, intelligent, and resilient foundation for next-generation high-performance analytics and data-intensive applications that integrates adaptive resource management, intelligent workload scheduling, dynamic task migration, predictive analytics, and machine learning-based optimization to improve computational efficiency and responsiveness.

Abstract

The rapid growth of Big Data, IoT, cloud computing, edge intelligence, and AI has increased the demand for scalable and efficient analytical infrastructures. Traditional distributed computing systems often rely on fixed resource allocation and execution strategies, leading to performance issues, resource underutilization, higher latency, and limited scalability under dynamic workloads. To address these challenges, self-adaptive distributed computing models enable systems to autonomously monitor, analyze, and optimize operations in real time. The proposed framework integrates adaptive resource management, intelligent workload scheduling, dynamic task migration, predictive analytics, and machine learning-based optimization to improve computational efficiency and responsiveness. The architecture includes monitoring layers, decision engines, adaptation controllers, distributed resource managers, and analytics execution frameworks. Machine learning techniques such as reinforcement learning, deep neural networks, and predictive modeling support proactive adaptation by forecasting workload demands and optimizing scheduling decisions. Experimental results demonstrate significant improvements in resource utilization, throughput, scalability, fault tolerance, and execution time compared to traditional approaches. Self-healing capabilities further enhance resilience against node failures and network disruptions. Overall, self-adaptive distributed computing provides a scalable, intelligent, and resilient foundation for next-generation high-performance analytics and data-intensive applications.

Read PDF

Similar papers

Open access 2024

AI-Assisted Resource Scheduling in Multi-Cloud Computing Environments

This research proposes an AI-driven resource scheduling framework that integrates workload prediction, resource classification, intelligent scheduling, and continuous feedback mechanisms that aims to optimize multiple objectives, including cost reduction, execution efficiency, energy consumption, and SLA compliance.

Michael Anderson · 0 citations
Open access 2025

Autonomous Data Pipeline Optimization Using Reinforcement Learning Techniques

A reinforcement learning (RL)-based autonomous optimization framework that integrates RL agents with data orchestration platforms to continuously monitor pipeline states and optimize operations that enables adaptive, self-managing data pipelines that improve scalability, resilience, and operational efficiency across en...

Rahul Mehta · 0 citations
Open access 2021

Reinforcement Learning for Adaptive Resource Management in Cloud Software

Reinforcement learning-based adaptive resource management framework is proposed that enables cloud systems to autonomously learn optimal resource allocation policies through continuous interaction with the environment and significantly outperforms static and reactive baseline strategies in terms of resource utilization...

Rajesh K. Sharma, Priya Natarajan · 0 citations
Open access 2025

Energy-Efficient Distributed Machine Learning in Edge Computing Architectures

This study investigates energy-efficient distributed machine learning techniques, including federated learning, model compression, adaptive resource management, dynamic task offloading, and communication-efficient optimization, and proposes a distributed learning framework that integrates local model training, adaptive...

Venkatesh Iyer · 0 citations
Open access 2024

Intelligent Workflow Scheduling for Distributed Data Processing Systems

An intelligent workflow scheduling framework that improves performance through adaptive decision-making, predictive analytics, and machine learning, and addresses key challenges like load balancing, scalability, energy efficiency, and fault tolerance is proposed.

D. Parnas · 0 citations
Open access 2025

Context-Aware AI Models for Dynamic Resource Management in Cloud Systems

This study proposes a Context-Aware AI framework for dynamic cloud resource management that incorporates workload patterns, user behavior, network conditions, infrastructure health, and business objectives and provides a foundation for future technologies such as edge computing, IoT, 6G networks, and intelligent enterp...

Richard Evans, Karen Lewis · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.