Skip to content
Open access

Intelligent Predictive Analytics using Machine Learning: A Comparative Evaluation of Classification Algorithms for High-Dimensional Data

Sep 2026 · Journal of Global Social Transformation · 0 citations

TL;DR

Overall, the findings identify XGBoost as the most effective algorithm for reliable predictive analytics in high-dimensional data environments, while demonstrating that model selection should balance predictive performance with computational efficiency.

Abstract

This study comparatively evaluated the predictive performance of selected machine-learning classification algorithms for high-dimensional data using a quantitative computational design-and-evaluation methodology. The analysis involved data preprocessing, feature processing, model development, hyperparameter optimization, and stratified 5-fold cross-validation using Logistic Regression, Support Vector Machine (SVM), Random Forest, and XGBoost. Model performance was assessed using accuracy, precision, recall, F1-score, ROC-AUC, confusion matrices, and computational efficiency, while the Friedman test was used to examine differences in model performance across cross-validation folds. The results indicated that XGBoost achieved the highest predictive performance, with an accuracy of 96.27%, precision of 96.3%, recall of 95.8%, F1-score of 96.0%, and ROC-AUC of 0.982, followed by Random Forest with an accuracy of 94.18%, SVM with 91.36%, and Logistic Regression with 87.42%. XGBoost also produced the lowest false-positive and false-negative counts (18 and 21, respectively), whereas Logistic Regression required the least training time (1.84 seconds). The Friedman test indicated statistically significant differences among the algorithms for accuracy (χ²=12.84, p=.005), precision (χ²=11.76, p=.008), recall (χ²=12.31, p=.006), F1-score (χ²=12.57, p=.006), and ROC-AUC (χ²=13.42, p=.004). Overall, the findings identify XGBoost as the most effective algorithm for reliable predictive analytics in high-dimensional data environments, while demonstrating that model selection should balance predictive performance with computational efficiency.

Read PDF

Similar papers

Open access Sep 2026

Advanced Machine Learning Approaches for Predictive Analytics: Comparative Evaluation of Classification Performance in High-Dimensional Data

This study examined advanced machine learning approaches for predictive analytics by comparatively evaluating the classification performance of Support Vector Machine (SVM), Random Forest, and Gradient Boosting in high-dimensional data. A high-dimensional dataset containing multiple observations and a large number of f...

Imtiaz Ali, M. Ali, Shahrukh Nawaz · 0 citations
Conference Open access 2026

Supervised Learning for Classification in Data Science: A Comparative Perspective

Overall, logistic regression demonstrates strong and good generalization ability, while ensemble methods constitute robust alternatives for binary classification on structured data.

Zahra Benider, H. Bouzahir, Jaafar Idrais · 0 citations
Open access 2026

Comparative analysis of Feature Selection Algorithms and Performances on Medical Classification Problem

The study recommends adopting CAE as the default choice in routine clinical applications due to its efficiency, and using RFE in research studies requiring maximum accuracy, to guiding researchers and clinicians in selecting the optimal combination of feature selection and classification algorithms according to their s...

Yahyia BenYahmed · 0 citations
Open access Sep 2026

Machine Learning-Based Predictive Analytics: Investigating the Influence of Feature Selection and Model Optimization on Prediction Accuracy

Overall, the findings demonstrate that integrating feature selection with model optimization substantially enhances classification performance, with the optimized Random Forest emerging as the most accurate and balanced model for the evaluated dataset.

Muhammad Ahsan Tariq, Fasie Haider, Taaha Shahzad et al. · 0 citations
Review Open access Aug 2026

Hybrid Machine Learning Models for Predictive Analytics and Intelligent Decision-Making in Complex Data Environments

Logistic Regression, Random Forest, soft voting, and weighted voting using a publicly available educational dataset comprising 4,424 student records, 36 predictors, and three outcome classes provided accurate, interpretable, and decision-oriented predictions, although external validation and prospective evaluation are...

Haleeful Jud · 0 citations
Open access Sep 2026

MACHINE LEARNING APPROACHES FOR EARLY DIABETES PREDICTION: A COMPARATIVE STUDY USING CLINICAL DATA

This study focuses on the accurate and early prediction of diabetes, which plays a vital role in improving clinical care and treatment planning. The research evaluates the performance of three machine learning techniques - Logistic Regression, Random Forest, and Support Vector Machine (SVM) - using data collected from...

N. Sriram, P. Arumugam, M. G. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.