Evidence supported GenAI use for high-recall title/abstract screening and structured first-pass data extraction within human-in-the-loop workflows with explicit oversight, and performance was most reliable within clearly defined workflows.
Abstract
Objectives
Systematic literature reviews (SLRs) are foundational to evidence-based medicine, including health technology assessment (HTA) and health economics and outcomes research (HEOR). Generative artificial intelligence (GenAI) tools are increasingly used in SLR workflows, yet no good practice guidance exists. This ISPOR Task Force report provides evidence-informed recommendations for responsible GenAI use across core SLR tasks.
Methods
A PRISMA-adapted rapid evidence assessment identified 115 empirical studies evaluating GenAI in SLR tasks published between November 2022 and July 2025. Findings were synthesized qualitatively across seven tasks. A structured task-level assessment framework spanning eight domains informed good practice recommendations, derived through Task Force consensus among experts in SLR methodology, HTA, AI development, bioethics, and regulatory science.
Results
Evidence supported GenAI use for high-recall title/abstract screening and structured first-pass data extraction within human-in-the-loop workflows with explicit oversight. Autonomous deployment was not supported. Evidence for full-text screening, qualitative synthesis, and report writing was more conditional, depending on workflow design and oversight, while risk of bias assessment showed the lowest readiness. End-to-end autonomous SLR generation was not recommended. Performance was most reliable within clearly defined workflows, with pre-specified rules for flagging records and explicit human review and conflict-resolution processes.
Conclusions
Based on current evidence, GenAI can augment, but not replace, human expertise in SLRs. Responsible use requires evaluating GenAI suitability for each review task, retaining human accountability at all decision points, and documenting AI use as a core methodological component. Because GenAI evolves rapidly, these recommendations reflect evidence through July 2025 and warrant periodic updating.
This review aims to identify current evidence concerning AI use during preliminary SLR reference screening and describes characteristics such as the different metrics used for reporting performance and how the different algorithms, pipelines, workflows or web applications are validated.
A. M. Barragán, Sara Elena Ortiz Bonett, Eliana-Isabel Rodríguez-Grande et al.· Cochrane evidence synthesis...· 0 citations
By explicitly prioritizing health equity, transparency, inclusion, and education, there is potential to meaningfully regulate AI in healthcare to redress systemic inequities in care and advance health and well-being in populations throughout the world.
Caroline R. Efird, Claudia Park, Parth Mishra et al.· Health affairs scholar· 0 citations
This study aimed to map the literature on patient-facing AI tools in PHC, including study characteristics, tool types, patient-journey stage, AI lifecycle stage, public availability, and health-system outcomes.
Alireza Habibi, Kathleen McMahon, Sian Hsiang-Te Tsuei et al.· BMC Medicine· 0 citations
ARISMA treats AI as an inspected, benchmarked, logged, and reversible assistant rather than an autonomous reviewer, built around one governing principle: every consequential scientific decision must remain human-interpretable, human-auditable, and human-accountable.
The evidence base describes agentic clinical systems in architectural detail and increasingly in safety terms, but provides limited empirical documentation of procurement standards, liability allocation, workforce assessment, and patient recourse.
This work analyzes SciLitBench, a corpus of 888 review-automation papers with 14,726 annotations, to characterize changes in methods, review-stage use, evaluation and reported limitations, and introduces PRISMA-LLM, an empirically grounded framework separating implementation disclosure from consequence-sensitive evalua...
Miguel Zabaleta, Bai-Han Lin· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.