Risk Aware Adaptive Scheduling Between In-Memory and Disk-Based Big Data Frameworks
While Apache Spark offers highly efficient in-memory data processing capabilities, such systems tend to exhibit poor performance and execution failures under memory-constrained infrastructure owing to high memory footprint and shuffle amplification. On the other hand, although Hadoop MapReduce is slower compared to Spa...