Skip to content
#software testing Open access

Large Language Model-Powered 3D Avatars to Train Shared Decision-Making in Undergraduate Medical Students: Design and Mixed Methods Acceptance Study.

Oct 2026 · JMIR Formative Research · Vol 10, pp. e102449 · 0 citations
Medicine

Abstract

Background

Shared decision-making (SDM) is a core competency in patient-centered care, yet it is challenging for physicians. Simulation-based education with standardized patients (SPs) offers valuable practice opportunities for undergraduate medical education (UME), but is limited by cost, scalability, and variable feedback quality. Advances in large language model (LLM) technology and virtual patient (VP) design present a promising pathway toward accessible, realistic, and high-quality SDM skill training.

Objective

This study aimed to develop LLM-powered, real-time interactive 3D avatars for SDM training in UME and to evaluate their acceptance among undergraduate medical students.

Methods

We conducted a descriptive, cross-sectional mixed methods study at KU Leuven, Belgium (November-December 2025). The avatar system was developed through an iterative, interdisciplinary collaboration between medical educators, SDM experts, software developers, user experience designers, and AI engineers, grounded in prior work on physicians' educational needs and SDM learning mechanisms. Development comprised prototype case authoring, usability testing with medical students, and iterative refinement. The final system is a web-based platform featuring real-time, LLM-powered spoken dialogue with diverse, photorealistic 3D patient avatars; layered prompts configuring avatar personality, clinical scenario, and difficulty; an educator panel for case authoring; and automated AI-generated formative feedback structured around 6 phases of SDM. After using the system for 1 month, a convenience sample of UME students completed a 9-item, 5-point Likert scale questionnaire grounded in the technology acceptance model (TAM), assessing perceived usefulness, perceived ease of use, and intention to use. Optional open-text responses were narratively analyzed to triangulate these findings.

Results

Of 25 recruited participants, 24 were included in the analysis. Internal consistency was acceptable for perceived usefulness (α=0.76) and intention to use (α=0.78), but not for perceived ease of use (α=0.69). All construct means exceeded the scale midpoint of 3, suggesting high overall acceptance. Students rated perceived usefulness highest (mean 4.43, SD 0.50), followed by intention to use (mean 4.42, SD 0.59), and perceived ease of use was the lowest (mean 3.81, SD 0.68). Fourteen participants provided open-text responses. These highlighted the value of a safe, low-pressure environment for practicing communication without patients or peers present; reported mixed experiences with avatar realism, with reservations directed at behavioral rather than physical realism; and identified technical difficulties (microphone issues, freezing, and crashes) as the most frequent area for improvement.

Conclusions

LLM-powered, real-time interactive 3D avatars are feasible and well-accepted tools for SDM training in UME. Students found the system educationally valuable and intended to use it again. Technical reliability and behavioral realism should be prioritized in future development. The modular architecture and automated feedback pipeline support scalable deployment across disciplines, institutions, and languages. Larger, multi-institutional studies with objective learning outcome measures are needed to establish efficacy.

Read PDF

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54
#computer vision Review Mar 2008

Agile methods in European embedded software development organisations: a survey on the actual use and usefulness of Extreme Programming and Scrum

The results show that the embedded industry has been able to apply agile methods in its development processes and that the appreciation of the agile methods and their individual practices appears to increase once adopted and applied in practice.

O. Salo, P. Abrahamsson · 238 citations · ⚡9
#computer vision Open access Jul 2017

What happens when software developers are (un)happy

Consequences of happiness and unhappiness that are beneficial and detrimental for developers' mental well-being, the software development process, and the produced artifacts are found.

D. Graziotin, Fabian Fagerholm, Xiaofeng Wang et al. · 236 citations · ⚡13
#computer vision Open access Oct 2004

Mobile-D: an agile approach for mobile application development

The Mobile-D approach is briefly outlined here and the experiences gained from four case studies are discussed, which helped develop an agile development approach for mobile application development.

P. Abrahamsson, Antti Hanhineva, H. Hulkko et al. · 225 citations · ⚡18

Related blog posts

Microsoft Research Blog Oct 30, 2026

From synthetic enterprise data evaluations to real Microsoft Copilot AI confidence

Evaluating Microsoft Copilot at enterprise scale requires test data that captures the full complexity of real organizations, yet real enterprise data contains sensitive information that cannot be used for evaluation under any circumstances. The post From synthetic enterprise data evaluations to real Microsoft Copilot AI confidence appeared first on Microsoft Research.

Microsoft Research Blog Oct 29, 2026

Microsoft Research Focus – Edition #97

Host Sowbhagya Suresh shares some of the latest news and cutting-edge research from across Microsoft—from understanding the challenges facing coding agents to uncovering how people use AI at work and improving extended-range weather forecasting. The post Microsoft Research Focus – Edition #97 appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.