Sep 2026· Pakistan Journal of Medical Sciences· 0 citations· 13 references
TL;DR
Clinicians and healthcare organizations must distinguish between protecting patients from unwanted technological involvement and requiring institutions to provide additional resources or alternative workflows to ensure that patient preferences are addressed consistently without compromising safety, fairness, privacy, or professional accountability.
Abstract
As large language models (LLMs) become embedded in clinical decision support, clinicians and institutions will increasingly encounter patients who object to their use. At present, LLMs should be regarded as adjunctive, clinician-supervised tools rather than substitutes for professional clinical judgment or autonomous diagnostic and treatment decision-makers. This paper reasons that refusal of LLM-assisted care should be considered meaningful only when patients receive transparent disclosure, understand how the technology contributes to their care, and can identify which forms of LLM involvement may reasonably be avoided. The ethical basis for such refusal extends beyond autonomy to include data protection, human oversight, accountability, and justified concerns about model performance in underrepresented populations. However, a patient’s interest in avoiding LLM involvement does not necessarily create an unlimited institutional obligation to maintain a fully parallel non-AI pathway. Clinicians and healthcare organizations must therefore distinguish between protecting patients from unwanted technological involvement and requiring institutions to provide additional resources or alternative workflows. Clear governance is needed to define when LLM use is optional, avoidable, or integral to care, and to ensure that patient preferences are addressed consistently without compromising safety, fairness, privacy, or professional accountability.
This review examines the main factors that shape patient trust in AI-assisted diagnosis and triage and argues that trust in medical AI should be understood as calibrated confidence rather than simple approval or rejection.
Oliwer Műller, Jagoda Pałubska, Zuzanna Rafałowska et al.· International Journal of Inn...· 0 citations
Large language models (LLMs) are increasingly used in primary care for documentation, patient communication, and clinical decision support. However, many clinicians are adopting these tools for patient care without structured training or a clear understanding of their limitations. LLM output may appear authoritative bu...
Christopher R. Stephenson, Christopher A. Aakre, I. Croghan et al.· Journal of Primary Care & Co...· 0 citations
This work presents a benchmark of 208 clinically grounded rare disease vignettes and identifies a strong authority-framing effect: models favor justice in committee-based contexts and shift toward beneficence and autonomy only when final decisions are framed as being made by clinicians or patients respectively.
Min-Da Zhao, Xuheng Han, R. Goel et al.· 0 citations
Recent work has mapped what is legally permitted, commercially practiced, and technically coming for ambient AI in clinical care, yet it has not addressed the prior question of what the recording is for. This Perspective offers a policy argument, not an empirical evaluation. Documentation, workflow efficiency, patient...
V. Misrai, A. Bruchon, P. Dasgupta et al.· Frontiers in Digital Health· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.