Sep 2026· The Journal of craniofacial surgery (Print)· 0 citations· 20 references
Medicine
TL;DR
Under this evaluation framework, no model advantage was demonstrated, while safety concerns remained frequent and evaluator perspective materially influenced judgments, suggesting large language model recommendations in frontal sinus trauma require expert review and multidisciplinary oversight.
Abstract
Frontal sinus fracture management requires integration of aesthetic, sinonasal, and intracranial risks, making it a demanding test of artificial intelligence-generated clinical advice. This study compared ChatGPT, Gemini, and DeepSeek across 30 systematically developed frontal sinus fracture vignettes. Ninety model-vignette responses were independently evaluated by 9 clinicians-3 plastic surgeons, 3 otorhinolaryngology/head and neck surgeons, and 3 neurosurgeons-using 9 one-to-five clinical domains and 5 binary safety outcomes. Three cyclic masking sequences counterbalanced model position; evaluators worked without a fixed time limit and could pause across sessions. The design generated 810 expert assessments. Mean total scores were 30.63±2.28 for ChatGPT, 30.50±2.37 for Gemini, and 30.72±2.13 for DeepSeek (maximum, 45), with no detectable overall difference (P=0.404; Kendall W=0.003). No domain-level difference remained significant after Holm adjustment. At least one safety concern was recorded in 45.2%, 41.1%, and 48.1% of individual assessments, respectively (P=0.255); majority consensus occurred for 35 of 90 responses and did not differ by model (P=0.056). Agreement on the composite safety outcome was limited. Under this evaluation framework, no model advantage was demonstrated, while safety concerns remained frequent and evaluator perspective materially influenced judgments. Large language model recommendations in frontal sinus trauma require expert review and multidisciplinary oversight.
It is suggested that LLMs can extract structured information from routine clinical documentation, performing well for standardized classification but less reliably for procedure-level prediction.
Benjamin Schwarberg, C. Ketzer, B. Thiel et al.· Journal of imaging informati...· 0 citations
Objective: Patients undergoing endoscopic skull base surgery (ESBS) often seek postoperative guidance. Large language models (LLMs) are increasingly accessible resources, but their quality in this setting remains poorly studied. This study compared LLM-generated responses with expert responses for common postoperative...
M. Manavi, Noel F. Ayoub, Arifeen S. Rahman et al.· Skull Base· 0 citations
G Gemini demonstrated superior performance in postoperative recommendations, whereas DeepSeek benefited from clearer indicators of disease severity, which support the potential of LLMs as adjunctive tools in otologic surgical decision-making.
Huseyin Isik, Deniz Baklacı, Gökhan Furkan Kılıç et al.· Frontiers in Neurology· 0 citations
Pediatric physeal fractures can be difficult to assess radiographically. We characterized regional fracture-detection failure patterns of a multimodal large language model (MLLM) in confirmed pediatric physeal fractures.
This retrospective, single-center, case-only study included 805 confirmed physeal frac...
S. E. Erginoğlu, N. Ülgen, Ali Said Nazlıgül et al.· BMC Medical Imaging· 0 citations
Introduction Large language models (LLMs) are increasingly used to answer patient questions, but the readability and information quality of patellar dislocation guidance remain unclear. Methods A series of clinical questions covering etiopathogenesis, mechanisms, clinical manifestations, diagnosis, treatment, complicat...
Shuo Liu, Xi-Yang Sun, Yun-Fei Ma et al.· Frontiers in Digital Health· 0 citations
Accurate detection of pediatric supracondylar humerus fractures remains a diagnostic challenge in emergency settings. To address this, we developed and validated a transfer-learning model, benchmarking its performance against board-certified emergency physicians. A retrospective dataset of 1440 anonymized pediatric elb...
Yaşar Samet Gokçeoğlu, M. Darılmaz, Ömer Levent Karadamar et al.· Journal of pediatric orthope...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.