Skip to content
Open access

Semantic de-identification of burned-in PHI in DICOM medical images: a deep learning–NLP pipeline validated on clinical and phantom TMM datasets

Jul 2026 · Frontiers of Computer Science · Vol 8 · 0 citations · 33 references

TL;DR

A semantic de-identification pipeline integrating YOLOv11n-based text detection, domain-optimized EasyOCR, and a hybrid natural language processing (NLP) classification module combining regular expressions, keyword matching, and named entity recognition is proposed, confirming that the pipeline preserves quantitative pixel fidelity when applied to institutional and device identifiers embedded in phantom acquisitions.

Abstract

The growing adoption of AI-based healthcare research has increased the need for properly anonymized medical imaging datasets. PHI within DICOM files - particularly burned-in pixel-level text - poses significant privacy and regulatory risks. Existing methods either focus solely on metadata or remove all detected text indiscriminately, sacrificing clinically relevant annotations. This paper proposes a semantic de-identification pipeline integrating YOLOv11n-based text detection, domain-optimized EasyOCR, and a hybrid natural language processing (NLP) classification module combining regular expressions, keyword matching, and named entity recognition. A dual-path architecture processes metadata and pixel-level PHI in parallel, enabling complete DICOM sanitization while preserving non-PHI clinical annotations. The system was evaluated on 1,042 multi-modality DICOM images (CT, MRI, X-ray, ultrasound). As a secondary evaluation, the pipeline was also applied to two tissue-mimicking material (TMM) phantom datasets from TCIA - the RIDER Phantom MRI and Phantom FDA CT (RIDER = Reference Image Database to Evaluate Therapy Response; FDA = Food and Drug Administration) - which served as surrogates for controlled evaluation of metadata and burned-in identifier removal. The system achieves an F1-score of 95.4%, 96.1% recall, a structural similarity index measure (SSIM) of 0.969, a peak signal-to-noise ratio (PSNR) of 28.9 dB, and processes each image in 2.8 s. It achieves SSIM of 0.986 and PSNR of 49.0 dB on RIDER Phantom MRI, and SSIM of 0.974 and PSNR of 31.5 dB on Phantom FDA CT. These results confirm that the pipeline preserves quantitative pixel fidelity when applied to institutional and device identifiers embedded in phantom acquisitions, supporting blinding for domain-generalization studies across institutions. The modular design supports institutional customisation, making it suitable for clinical research workflows and privacy-compliant phantom imaging pipelines.

Read PDF

Similar papers

#generative ai Preprint Aug 2026

Masking Is Not Enough: Generative Restoration for Multimodal De-Identification in Medical AI

ClinX is introduced, an end-to-end multimodal PHI sanitization framework for medical image-text data, and results show that OCR-only masking is not sufficient as a standalone solution, and restoration-based sanitization better preserves clinically relevant visual context while sharply reducing recoverable PHI.

S. Shrestha, Zongxing Xie, Chen Zhao et al. · 0 citations
#natural language process... Preprint Sep 2026

SIFTING: A Novel LLM-Based Framework for Structured and Transparent Information Extraction from Clinical Free-Text Reports, with Application to Tumor Staging in Lung Cancer

Background: Large language models (LLMs) show promise for extracting information from clinical free-text documents, but their outputs are often unstructured and lack traceability, complicating validation and adoption in clinical workflows. In this work we introduce SIFTING, an LLM-based framework designed to address these shortcomings. Methods: SIFTING combines the language comprehension capabilities of LLMs with segment-level processing and structured prompts with strict output control, linking findings to the source text to enable both accurate and transparent information extraction. To demonstrate its capabilities, we applied the framework to the task of extracting tumor T-stage information from 130 lung cancer radiology reports (SIFTING-T-stage). A compact 4-bit quantized version of the open-source LLM Llama-3.3-70B (35 GB) was used in a fully self-hosted setup, providing full control over data and model. Performance was evaluated against a reference standard created by four clinical experts and compared with a range of LLMs as used in a conventional single-prompt approach, using bootstrap resampling to estimate confidence intervals. Results: SIFTING-T-stage achieved an accuracy of 90% (95% CI: 84-95) against the reference standard. We found its performance to be comparable to even the largest state-of-the-art LLMs with reasoning capabilities and to be interchangeable with clinical experts (p<0.001), while at the same time offering full traceability through source text references. Conclusion: SIFTING enables accurate, structured, and traceable information extraction from clinical free-text documents. It ensures data control, reproducibility, and verifiable outputs that can support clinical validation and workflow integration.

Mirco Hess, Gerben van Veenendaal, Joris Wakkie et al. · 0 citations
Conference Aug 2026

MedXAIgnosis: a metadata-enhanced graph-fusion pilot for thorax disease classification

Classifying medical images is essential for the diagnosis of thorax diseases, often aided by deep learning (DL) techniques. However, traditional DL approaches typically focus on a single image type input and overlook valuable insights from clinical header data. To address this, MedXAIgnosis introduces a multimodal framework that combines chest radiograph images and available clinical data (age, sex, view-position) to reorganize image features without extra clinician typing. The framework utilizes DenseNet to extract features from chest radiographs and a Multilayer Perceptron (MLP) to map clinical header data fields into a compatible space. These features are fused and passed to a Graph Neural Network (GNN) equipped with a learnable edge threshold that prunes noisy relations on-the-fly. On the original NIH and CheXpert test sets, the plug-in reaches an AUC of 0.8078 and an accuracy of 0.8425 (NIH) and an AUC of 0.7891 with an accuracy of 0.7997 (CheXpert), which is within the same range as other metadata-only models. For model transparency, explainable AI (XAI) techniques Gradient-weighted Class Activation Mapping (Grad-CAM) and GNNExplainer are implemented. Grad-CAM highlights the most relevant pixel regions in chest X-ray images, while GNNExplainer identifies influential subgraph patterns in the GNN, outputting a compact explanation that clinicians can inspect at a glance.

Datenji Sherpa, D. Pant, J. Heikkonen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.