Before 'Expert-Level' Performance: Reproducibility and Reference-Standard Concerns in Evaluating Large Language Models for Endodontic Diagnosis.
Unknown authors
Sep 2026· Australian Endodontic Journal· 0 citations
Medicine
TL;DR
Findings are best viewed as preliminary evidence of high concordance under controlled conditions and should use transparent model reporting, repeated runs, consensus reference standards, and clinically representative multimodal cases before expert-level performance is inferred.
BACKGROUND
Large language models (LLMs) are increasingly used by clinicians and learners for endodontic information, yet their reliability for irrigation-related knowledge remains unclear. This study evaluated the accuracy, readability, hallucination profile, clinical risk, and temporal stability of 4 general-purpose L...
It is suggested that LLMs may support report-based spine imaging diagnosis as clinical assistive tools, but deployment should account for disease prevalence, prompt sensitivity, and the need for domain-specific optimisation.
Hao-Lai Liu, Hao Zhang, Hai-Xin Wei et al.· npj Digital Medicine· 0 citations
Background/Objectives: Large language models (LLMs) are consulted for clinical decision support, and their reliability is judged by hallucination prevalence—a measure treating every unsupported element as equivalent, although a fabricated citation and a fabricated protocol differ in what a clinician acting on them woul...
Ferdi Allaf, Mustafa Özcan· Diagnostics· 0 citations
ChatGPT-5.2 had the highest observed performance across several predefined outcomes, although absolute differences were modest for some measures, particularly MCQ accuracy.
This review aims to critically assess the reliability and safety of LLMs in dental education, patient communication, and clinical decision-making, with a focus on their use in dental practice.
T. F. Eyüboğlu, M. Özcan· Current Oral Health Reports· 0 citations
Evaluating the response accuracy of 2 advanced large language models found the Gemini-3.0 Flash responses excelled in highly structured, direct-response questions to relevance, clarity, and closeness to the article, whereas the ChatGPT-5.2 response demonstrated greater scientific accuracy at all levels and performed be...
Pranay Jain, F. R, A. V et al.· The Journal of prosthetic de...· 0 citations