Skip to content

Language model-assisted label refinement for accurate sepsis detection from electronic health records

Sep 2026 · medRxiv · 0 citations
Medicine

TL;DR

STRIDE, a machine-learning framework for sepsis detection across seven hospitals with a scalable approach to label quality, outperformed SOFA and Epic on discrimination and showed favorable calibration by Brier score, while retaining strong discrimination among SIRS-positive non-septic encounters.

Abstract

Sepsis is a leading cause of hospital mortality, yet timely recognition is hampered by nonspecific presentations and label noise in code-based case definitions. We developed STRIDE, a machine-learning framework for sepsis detection across seven hospitals with a scalable approach to label quality. We refined a pragmatic operational definition using a large language model applied to discharge summaries, with an independent physician-adjudicated cohort as the gold standard. We compared 8-, 24-, and 48-hour observation windows and benchmarked against SOFA, SIRS, and Epic, assessing calibration and discrimination. Among 356,610 encounters, the 8-hour model achieved an AUC of 0.960 in derivation and 0.878 in physician-adjudicated validation, matching or outperforming longer-window models. STRIDE outperformed SOFA and Epic on discrimination and showed favorable calibration by Brier score, while retaining strong discrimination among SIRS-positive non-septic encounters and reaching 78.2% specificity at 80% sensitivity in validation. These findings support accurate sepsis surveillance while limiting unnecessary alerts and requiring minimal prior history.

Read PDF

Similar papers

Review Open access Sep 2026

Beyond ICD Codes: Fine-Tuning LLMs for In-Hospital Cardiac Arrest Identification from EHR Notes

Large language model (LLM)-based systems that incorporated physician-defined clinical knowledge through guideline-enriched prompting, supervised fine-tuning, and a self-correction procedure enabled accurate identification of IHCA events and locations from routine clinical documentation.

D. Weissenbacher, J. Vo, A. Uy-Evanado et al. · 0 citations
Open access Aug 2026

Early Sepsis Prediction Using Interpretable Models.

Sepsis remains a major cause of morbidity and mortality in Intensive Care Units (ICUs). Timely identification of sepsis can prevent severe complications by enabling early treatment, such as administering antibiotics. Despite advances in diagnostic biomarkers and scoring systems, these approaches often lack the ability...

C. Stylianides, Andria Nicolaou, A. Vavlitou et al. · 0 citations
Open access Sep 2026

Large language models for pneumonia detection in radiology reports via text analysis

Overall, LLMs demonstrated high accuracy in interpreting radiology reports for detecting radiographic evidence of pneumonia, and the RAG architecture further enhanced robustness and generalizability through knowledge augmentation, providing a methodological basis for automated radiology report analysis and large-scale...

Wei-Sheng Chen, Xin-Ya Li, Zhong-Kai Qu et al. · 0 citations
Open access Sep 2026

HeartVar: An LLM-Assisted Tool for Clinical Classification of Variants in Cardiovascular Disease Cohorts

HeartVar demonstrates that an LLM constrained by a domain-specific prompt and grounded in structured evidence can produce variant interpretations of first-pass quality for a cardiovascular disease cohort; however, it is not intended to replace manual assessment by a qualified variant curator.

Jamie-Lee M. Thompson, Debjani Das, Sally L. Dunwoodie et al. · 0 citations

Related blog posts

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.