Skip to content
Review Open access

Evidence, use cases, and implementation safeguards of large language models in primary care

Aug 2026 · Communications Medicine · Vol 6 · 0 citations · 74 references
Medicine

TL;DR

A pragmatic adoption approach is emphasized to prioritize high-volume, lower-risk clerical and communication workflows; maintain clinician verification and accountability; and apply governance and equity safeguards before scale-up before scale-up.

Abstract

Recent developments in large language models (LLMs) have created new opportunities to support primary care, where much of clinical work is text-mediated. This narrative review synthesizes evidence on LLM applications relevant to primary care workflows and summarizes implementation safeguards. Across studies, the most consistently supported near-term value is workflow augmentation, particularly documentation and inbox management (e.g., drafting portal replies and summarizing information for clinician review) and communication support, where benefits are reported primarily as process endpoints (time, acceptability, perceived communication quality) rather than hard patient outcomes. Evidence for improvements in clinician diagnostic reasoning, treatment planning, and downstream patient outcomes is more limited and context-dependent, and many evaluations remain simulated or conducted in adjacent settings, limiting generalizability to routine primary care. Accordingly, potential roles in population health and cost reduction should be treated as hypothesis-generating and evaluated prospectively. Challenges related to privacy, security, transparency, and model reliability shape organizational governance requirements and evolving regulatory expectations for the clinical use of generative AI in primary care. We emphasize a pragmatic adoption approach: prioritize high-volume, lower-risk clerical and communication workflows; maintain clinician verification and accountability; and apply governance and equity safeguards (e.g. privacy, security, transparency, auditability, monitoring for drift and error) before scale-up. Christof et al. provide a narrative review that synthesizes evidence on LLM applications relevant to primary care workflows and summarizes implementation safeguards. They highlight the remaining need to demonstrate improved patient outcome of clinical improvement in many studies and outline a pragmatic adoption approach in practice.

Read PDF

Similar papers

Review Open access Aug 2026

Large language models in clinical nutrition practice: opportunities, risks, and governance

This paper provides a clinic-ready “LLM Safety & Quality Checklist” to support dietitians and clinical teams in verifying outputs against authoritative guidelines, identifying high-risk cases requiring clinician review, ensuring transparent disclosure to patients, and safeguarding privacy.

Sedat Arslan · 0 citations
Review Aug 2026

How large language models can be used for teamwork and communication in healthcare settings: A scoping review.

LLMs hold substantial potential to enhance healthcare teamwork by supporting clinical decisions, streamlining administrative workflows, and improving patient communication, however, ethical, legal, and accountability concerns remain.

Ilse Super, Olya Rezaeian, Onur Asan · 0 citations
Review Open access Jul 2026

An Acceptance Criteria Framework for Determining the Implementation Fit of Custom Large Language Models in Public Health Interventions

This work proposes an acceptance criteria framework (ACF) to determine implementation fit, defined as meeting prespecified minimum performance standards and demonstrating nonproblematic behavior under anticipated use and demonstrates how the ACF can guide deployment decisions.

Andy J. King, Anthony Banks, L. Hernández et al. · 0 citations
Review Open access Sep 2026

Effectiveness, Safety, and Workflow Burden of Large Language Model–Based Medical Report Generation: Systematic Review

Abstract Background Systems based on large language models (LLMs), multimodal LLMs, and vision-language foundation models are increasingly being evaluated for medical report generation in imaging and related clinical workflows. Existing reviews have summarized technical architectures, radiology applications, readability, and benchmark performance, but clinical readiness remains uncertain because safety, human oversight, and workflow outcomes are sparsely and inconsistently reported. Objective The aim of this study is to assess the effectiveness (expert acceptance and blinded preference), safety (clinically significant, omission, and commission errors), and workflow burden (reporting time, corrections, edit distance, and editing burden) of LLM-based medical report generation. Methods We searched PubMed/MEDLINE, Embase, Web of Science Core Collection, Scopus, and the Cochrane Library for studies published from January 1, 2016, through May 15, 2026. Eligible studies evaluated LLMs, multimodal LLMs, or vision-language foundation models for image-to-report generation, impression generation from findings, report drafting, or structured reporting in imaging workflows. Two reviewers performed screening, extraction, risk-of-bias assessment, and Grading of Recommendations Assessment, Development, and Evaluation–informed narrative certainty assessment. Outcomes were clinically significant error rate, omission error rate, commission error rate, reporting time, edit burden, expert acceptance, and blinded expert preference. Meta-analysis was not performed because no comparable outcome had at least 2 studies with compatible task structure and analyzable data. Results A total of 101 studies were included. Chest x-ray was the largest modality group (36 studies), followed by computed tomography, magnetic resonance imaging (MRI), ultrasound, endoscopy, pathology, ophthalmic, electrocardiographic, dental, and mixed-modality contexts. No study was judged at low risk of bias; 15 were moderate, 72 high, and 14 serious. Safety and workflow evidence remained heterogeneous and largely nonpoolable. In a chest x-ray study, AI report acceptance was similar to that of radiologist reports (6047/8580, 70.5% vs 6288/8580, 73.3%), but false-negative findings were slightly higher (1584/8580, 18.5% vs 1527/8580, 17.8%). In a clinician-collaboration chest x-ray study, AI reports were equivalent or preferred in 233 of 300 (77.7%) and 170 of 303 (56.1%) cases across 2 datasets; yet, clinically significant errors persisted. In a brain MRI study, AI assistance reduced reading time from 61 to 53 seconds, whereas impression drafting increased editing time and edit distance. Conclusions This review shifts the synthesis from plausible report generation to clinically interpretable effectiveness, safety, and workflow effects. Expert acceptance and preference suggested assistive value in selected supervised settings, but these signals were limited by inconsistent reporting of clinically significant errors, omissions, commissions, and failed generations. Workflow effects were mixed, with some studies reporting shorter reading time or drafting support, and others reporting greater editing time or edit distance. The evidence remains too heterogeneous, biased, and sparse on case-level end points to support a pooled meta-analysis or autonomous clinical-readiness claims. Adoption should remain locally validated, clinician-supervised, and accompanied by standardized reporting of acceptance, preference, omissions, commissions, failed generations, reporting time, corrections, and editing burden.

Jie-Li Huang, Ji-Qing Zhu, Xiao-Guang Ni · 0 citations
Review Open access Aug 2026

Safety-Oriented Evaluation of Large Language Models in Health Care: Guideline-Informed Systematic Review

Current evaluations emphasize accuracy while underreporting privacy, security, robustness, explainability, and verifiability, underscoring the need for comprehensive, guideline-based, multidomain evaluation before deployment in high-stakes clinical settings.

Hikaru Matsuoka, Takayuki Takahashi, Takayuki Semitsu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.