Skip to content
Review

Comparative Evaluation of Large Language Models in Frontal Sinus Fracture Management: A Multidisciplinary Expert-Based Vignette Study.

Sep 2026 · The Journal of craniofacial surgery (Print) · 0 citations · 20 references
Medicine

TL;DR

Under this evaluation framework, no model advantage was demonstrated, while safety concerns remained frequent and evaluator perspective materially influenced judgments, suggesting large language model recommendations in frontal sinus trauma require expert review and multidisciplinary oversight.

Abstract

Frontal sinus fracture management requires integration of aesthetic, sinonasal, and intracranial risks, making it a demanding test of artificial intelligence-generated clinical advice. This study compared ChatGPT, Gemini, and DeepSeek across 30 systematically developed frontal sinus fracture vignettes. Ninety model-vignette responses were independently evaluated by 9 clinicians-3 plastic surgeons, 3 otorhinolaryngology/head and neck surgeons, and 3 neurosurgeons-using 9 one-to-five clinical domains and 5 binary safety outcomes. Three cyclic masking sequences counterbalanced model position; evaluators worked without a fixed time limit and could pause across sessions. The design generated 810 expert assessments. Mean total scores were 30.63±2.28 for ChatGPT, 30.50±2.37 for Gemini, and 30.72±2.13 for DeepSeek (maximum, 45), with no detectable overall difference (P=0.404; Kendall W=0.003). No domain-level difference remained significant after Holm adjustment. At least one safety concern was recorded in 45.2%, 41.1%, and 48.1% of individual assessments, respectively (P=0.255); majority consensus occurred for 35 of 90 responses and did not differ by model (P=0.056). Agreement on the composite safety outcome was limited. Under this evaluation framework, no model advantage was demonstrated, while safety concerns remained frequent and evaluator perspective materially influenced judgments. Large language model recommendations in frontal sinus trauma require expert review and multidisciplinary oversight.

View source

Similar papers

Open access Sep 2026

Large Language Models for Ankle Fracture Classification and Management Prediction from Routine Clinical Documentation: A Single-Center Exploratory Study.

It is suggested that LLMs can extract structured information from routine clinical documentation, performing well for standardized classification but less reliably for procedure-level prediction.

Benjamin Schwarberg, C. Ketzer, B. Thiel et al. · 0 citations
Oct 2026

Large Language Models vs Expert Response: A Comparative Analysis of Patient Education Quality After Skull Base Surgery

Objective: Patients undergoing endoscopic skull base surgery (ESBS) often seek postoperative guidance. Large language models (LLMs) are increasingly accessible resources, but their quality in this setting remains poorly studied. This study compared LLM-generated responses with expert responses for common postoperative...

M. Manavi, Noel F. Ayoub, Arifeen S. Rahman et al. · 0 citations
Open access Oct 2026

Comparative performance of Gemini and DeepSeek large language models in surgical decision support for mastoidectomy in chronic otitis media with cholesteatoma

G Gemini demonstrated superior performance in postoperative recommendations, whereas DeepSeek benefited from clearer indicators of disease severity, which support the potential of LLMs as adjunctive tools in otologic surgical decision-making.

Huseyin Isik, Deniz Baklacı, Gökhan Furkan Kılıç et al. · 0 citations
Review Open access Sep 2026

Regional fracture-detection false-negative patterns of a multimodal large language model in confirmed pediatric physeal fractures: a case-only analysis

Pediatric physeal fractures can be difficult to assess radiographically. We characterized regional fracture-detection failure patterns of a multimodal large language model (MLLM) in confirmed pediatric physeal fractures. This retrospective, single-center, case-only study included 805 confirmed physeal frac...

S. E. Erginoğlu, N. Ülgen, Ali Said Nazlıgül et al. · 0 citations
Open access Sep 2026

Evaluating artificial intelligence-generated clinical guidance for patellar dislocation: accuracy, readability and qualitative appraisal of DeepSeek-R1 responses

Introduction Large language models (LLMs) are increasingly used to answer patient questions, but the readability and information quality of patellar dislocation guidance remain unclear. Methods A series of clinical questions covering etiopathogenesis, mechanisms, clinical manifestations, diagnosis, treatment, complicat...

Shuo Liu, Xi-Yang Sun, Yun-Fei Ma et al. · 0 citations
Sep 2026

Artificial intelligence-assisted diagnosis of pediatric supracondylar humerus fractures: a deep learning-based clinical decision support model.

Accurate detection of pediatric supracondylar humerus fractures remains a diagnostic challenge in emergency settings. To address this, we developed and validated a transfer-learning model, benchmarking its performance against board-certified emergency physicians. A retrospective dataset of 1440 anonymized pediatric elb...

Yaşar Samet Gokçeoğlu, M. Darılmaz, Ömer Levent Karadamar et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.