Skip to content
#explainable ai Review Open access

Transparency and Explainability in Human Factors — A Systematic Review of Usability Assessment Practices for AI Medical Devices

Aug 2026 · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · Vol 15, pp. 62 - 66 · 0 citations · 19 references

TL;DR

Results identify a "symmetry of modality": qualitative interviews correlate with written text explanations, while Think-Aloud protocols better assess cognitively demanding tools like SHAP values.

Abstract

While AI-enabled medical devices (AIeMD) are redefining healthcare, safety relies on human-AI interaction as much as algorithmic performance. This systematic review of 53 studies reveals that 58.2% of research omits Explainable AI (XAI) methods, despite transparency being a regulatory and safety necessity. Results identify a "symmetry of modality": qualitative interviews correlate with written text explanations, while Think-Aloud protocols better assess cognitively demanding tools like SHAP values. Currently, AI-specific risks like automation bias, driven by algorithmic opacity, are critically under-reported. To ensure safe adoption, practitioners must move beyond "user satisfaction" to treat transparency and XAI as safety-critical requirements for trust calibration.

Read PDF

Similar papers

Book Open access Jul 2026

A Multidimensional Approach to Usability Engineering, Clinical Performance and Human-AI Interaction in AI-Enabled Medical Devices

This project aims to establish robust methodologies for evaluating transparency and trust, integrating human factors and clinical performance into a multidimensional validation pipeline, ensuring that AI-enabled health solutions are clinically reliable, transparent, and compliant.

Mariana de Oliveira · 0 citations
Book Open access Jul 2026

Human-AI Interaction in Healthcare - A Manifesto for Improved Usability Evaluation

This position paper presents a manifesto for a longitudinal, three-fold methodological pivot in health human-AI interaction, and proposes moving beyond static satisfaction metrics towards relational metrics —Longitudinal Trust Calibration, Automation Bias Drift, and Error Recovery Velocity—that track the maturity and r...

Mariana de Oliveira, Célia F. Cruz, Nuno Matela · 0 citations
Conference Open access 2026

Explainable AI in Telemedicine: A Scoping Review of Clinical Usability Gaps and Research Directions for GP-Centred Design

A scoping review of XAI applications in telemedicine is presented, examining 20 studies published between 2022 and 2026 to characterise the methods used, their evaluation approaches, and gaps between technical explainability and clinical usability.

Ana Vesic, M. Zivkovic · 0 citations
Open access Jul 2026

Cognitive Friction in Clinical Decision Support: A Comparative Study of Judicial and Adjunct Human–AI Interaction Protocols

Overall findings suggest that the effectiveness of decision-support systems depends not only on model performance and explanation quality but also on interaction design, and judicial protocols showed promise in mitigating automation bias and promoting active cognitive engagement in clinical decision support.

Samuele Pe, Laura Bergomi, G. Nicora et al. · 0 citations
Review Open access Aug 2026

Validation of an AI-powered mobile application for personalizing medical note explanations: a mixed-methods evaluation

This mixed-methods evaluation suggests that a deliberately constrained, language-focused AI system can improve the accessibility of medical notes while preserving clinical accuracy and safety while extending into clinical interpretation.

Nicholas Lamb · 0 citations
Open access Aug 2026

Lessons from the field: usability (engineering) in regulated healthcare

It is argued that usability engineering should be a formative, safety-critical discipline integrated throughout the product lifecycle, including aftermarket deployment, and not merely a compliance task.

Preetha Moorthy, Till Nagel, Eva Hornecker · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

GPT-Lab Oct 14, 2026

Building trustworthy AI: The role of AI harnesses, intent contracts and evals

AI is moving beyond impressive demos. After World Summit AI 2026 in Amsterdam, GPT-Lab's Muhammad Waseem reflects on what organizations need to make AI agents reliable, responsible and genuinely useful in everyday work. The post Building trustworthy AI: The role of AI harnesses, intent contracts and evals appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.