Oct 2026· International Journal of Medical Informatics· Vol 223, pp.
106740
· 0 citations· 62 references
Medicine
TL;DR
A systematic review and meta-analysis of ML-based BSI prediction models to quantify their discriminative performance and appraise the certainty of the evidence concluded that Rigorous external validation, calibration and decision-analytic reporting, and adherence to prediction-model reporting standards are needed before clinical implementation.
Abstract
Purpose
Bloodstream infection (BSI) is a life-threatening condition for which culture-based diagnosis is slow, motivating interest in machine learning (ML) models that predict BSI from routine clinical data. To date, this evidence has been summarized only narratively, without quantitative synthesis or formal appraisal of methodological quality. We performed a systematic review and meta-analysis of ML-based BSI prediction models to quantify their discriminative performance and appraise the certainty of the evidence.
Methods
We searched five databases for English-language studies published between 2013 and 2025. The area under the receiver operating characteristic curve (AUROC) was the primary discrimination measure and was pooled using random-effects models. Risk of bias was assessed with the Prediction model Risk Of Bias Assessment Tool (PROBAST), and certainty of evidence was assessed with GRADE.
Results
Twenty-six studies were included, of which 24 (28 estimates) contributed to the meta-analysis. The pooled AUROC was 0.82 (95 % confidence interval, 0.77-0.86), with extreme heterogeneity (I2 = 99.9 %) and a wide 95 % prediction interval (0.46-0.96). Discrimination declined as validation became more stringent, from internal validation (0.86) to external/temporal validation (0.77; P = 0.005), indicating a generalizability gradient, whereas performance did not differ significantly by clinical setting (P = 0.52) or target organism (P = 0.53). Most studies (96 %) were at high risk of bias in the PROBAST analysis domain, and the overall certainty of evidence was very low.
Conclusion
ML models showed promising discrimination for BSI prediction (pooled AUROC 0.82). However, the prediction interval was wide (0.46-0.96) and performance declined under external validation, indicating limited generalizability; moreover, the current evidence is of very low certainty. Rigorous external validation, calibration and decision-analytic reporting, and adherence to prediction-model reporting standards are needed before clinical implementation.
Infective endocarditis (IE) continues to be an often fatal condition despite improvements in cardiac surgical procedures and antibiotic therapy, and conventional scoring tools show poor generalizability. Machine learning (ML) addresses these limitations by capturing complex, nonlinear clinical relationships, outperform...
Vatsalya Choudhary, Muskan Jain, F. Tamanna et al.· Cardiology in Review· 0 citations
While multimodal models offer notable performance advantages over unimodal approaches, their application in VHD remains limited and future research should prioritize the integration of heterogeneous data sources alongside rigorous external validation to ensure clinical generalizability and facilitate adoption in valvul...
V. Idakwo, C. Strote, C. Goelz et al.· European Heart Journal· 0 citations
Objective This study systematically evaluates the construction methods, predictive factors, and performance of risk prediction models for anti-tuberculosis drug-induced liver injury (ATB-DILI). It aims to furnish evidence-based evidence for early detection of East Asian individuals at high risk of ATB-DILI and the deve...
Hong-Jiao Li, Xin-Yi Feng, Xi Zheng et al.· Frontiers in Public Health· 0 citations
Objective: To determine how predictive performance varies across artificial intelligence model architectures for predicting unplanned readmission and mortality in the intensive care unit (ICU), evaluated either as separate or composite outcomes. Methods: A systematic review was conducted following PRISMA guidelines. Se...
Luis E. Fernandez-Curbelo, Tania Rivero-Blanco, C. Cruz-Corona et al.· Big Data and Cognitive Compu...· 0 citations
Background Machine learning models have been proposed for identifying prediabetes, but their methodological quality, generalisability, and readiness for primary care implementation remain uncertain. Methods We conducted a Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020-compliant systema...
Liang Wang, Yan Zhang, Hao Yang et al.· Frontiers in Medicine· 0 citations
ABSTRACT Background Tuberculosis (TB) remains a significant global health problem, particularly in low‐ and middle‐income countries (LMICs), where accurate prediction of TB incidence is crucial for effective public health interventions. Objective This review assessed and compared statistical, machine learning (ML), and...
D. Singh, Bipindra Pandey, Bibek Giri et al.· Public Health Challenges· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.