Skip to content

Before 'Expert-Level' Performance: Reproducibility and Reference-Standard Concerns in Evaluating Large Language Models for Endodontic Diagnosis.

Unknown authors
Sep 2026 · Australian Endodontic Journal · 0 citations
Medicine

TL;DR

Findings are best viewed as preliminary evidence of high concordance under controlled conditions and should use transparent model reporting, repeated runs, consensus reference standards, and clinically representative multimodal cases before expert-level performance is inferred.

View source

Similar papers

Aug 2026

Evaluating Large Language Models in Endodontic Irrigants: A Structured Assessment of Accuracy, Readability, Hallucination Subtypes and Clinical Risk.

BACKGROUND Large language models (LLMs) are increasingly used by clinicians and learners for endodontic information, yet their reliability for irrigation-related knowledge remains unclear. This study evaluated the accuracy, readability, hallucination profile, clinical risk, and temporal stability of 4 general-purpose L...

Damla Erkal, Yunus Emre Çakmak, Kürşat Er · 0 citations
Open access Aug 2026

Multicenter evaluation of four large language models for automated spine imaging diagnosis

It is suggested that LLMs may support report-based spine imaging diagnosis as clinical assistive tools, but deployment should account for disease prevalence, prompt sensitivity, and the need for domain-specific optimisation.

Hao-Lai Liu, Hao Zhang, Hai-Xin Wei et al. · 0 citations
Review Open access Sep 2026

Severity Stratification Changes What Hallucination Rates Mean: An Item-Matched Audit of Five Large Language Models in Orthodontic Decision Support

Background/Objectives: Large language models (LLMs) are consulted for clinical decision support, and their reliability is judged by hallucination prevalence—a measure treating every unsupported element as equivalent, although a fabricated citation and a fabricated protocol differ in what a clinician acting on them woul...

Ferdi Allaf, Mustafa Özcan · 0 citations
Open access Sep 2026

Laboratory Medicine Decision Support—Beyond Exam Passing: A Blinded 100-Case Text-Based Benchmark of Diagnostic Accuracy, Management Quality, and Safety for ChatGPT, Gemini, and DeepSeek—LLM Decision Support in Laboratory Medicine

ChatGPT-5.2 had the highest observed performance across several predefined outcomes, although absolute differences were modest for some measures, particularly MCQ accuracy.

K. Ulutaş, A. Pekmezci · 0 citations
Sep 2026

Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels.

Evaluating the response accuracy of 2 advanced large language models found the Gemini-3.0 Flash responses excelled in highly structured, direct-response questions to relevance, clarity, and closeness to the article, whereas the ChatGPT-5.2 response demonstrated greater scientific accuracy at all levels and performed be...

Pranay Jain, F. R, A. V et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.