Experimental results demonstrate that LoRe-MIM consistently outperforms the corresponding state-of-the-art baselines across these tasks, highlighting its potential as a scalable and generalizable self-supervised learning framework for whole-body PET/CT analysis.
Abstract
Deep learning models for whole-body positron emission tomography/computed tomography (PET/CT) hold significant clinical potential for disease detection, treatment planning, and response assessment. However, the time and cost associated with expert annotations remain major bottlenecks in developing robust and generalizable models. Although self-supervised learning (SSL) has emerged as a promising approach to mitigating annotation scarcity, its application to whole-body PET/CT remains relatively underexplored due to the limited availability of large-scale datasets and the challenges associated with learning complementary cross-modal representations. To address these limitations, we curate a heterogeneous, multi-tracer, multi-institutional cohort comprising 6,531 whole-body PET/CT scans and propose LoRe-MIM (Lost-Or-Replaced Masked Image Modelling), a novel self-supervised framework designed to learn multimodal representations through masked image reconstruction. Specifically, LoRe-MIM introduces a masking strategy in which image regions are either replaced with zeros (Lost) or substituted with corresponding complementary imaging modality (Replaced), encouraging the model to capture both modality-specific characteristics and cross-modal relationships. We evaluate the learned representations across multiple downstream tasks, including multimodal PET/CT image reconstruction, patch-based classification into cancer vs. non-cancer, whole-body lesion segmentation, label-efficient training, and robustness assessment. Experimental results demonstrate that LoRe-MIM consistently outperforms the corresponding state-of-the-art baselines across these tasks, highlighting its potential as a scalable and generalizable self-supervised learning framework for whole-body PET/CT analysis.
Positron Emission Tomography (PET) provides important metabolic information for tumor detection and staging but remains significantly less accessible than Computed Tomography (CT) due to its high cost, infrastructure requirements, and reliance on injected radioactive tracers. CT-to-PET image translation using generativ...
Y. Bourdé, Lea Bogensperger, Arnela Hadzic et al.· 0 citations
Reducing radiation exposure in Positron Emission Tomography (PET) is important for patient safety; however, ultra-low-dose imaging suffers from severe noise, which may affect diagnostic interpretation without appropriate image enhancement. While current 3D deep generative models, particularly diffusion models, have sho...
Jia-Le Shen, Guo-Lin Wang, Chen-Hao Wang et al.· arXiv.org· 0 citations
Total-body positron emission tomography (TB-PET) enables fast, low-dose, and dynamic imaging over a long axial field of view, but reconstruction remains challenging due to reduced counts, large image volumes, and increased data dimensionality. Generative models offer powerful learned priors for low-count PET, yet expli...
Movindu Dassanayake, George Webber, Denis Prokopenko et al.· 0 citations
Artificial intelligence in PET/CT is evolving from narrowly optimized systems toward reusable pretrained representations and multimodal models. PET/CT is a demanding test case because clinically meaningful interpretation must preserve quantitative molecular information while integrating anatomic CT, acquisition metadat...
A. Muneer, Maliazurina B. Saad, Hui Xu et al.· Frontiers in Nuclear Medicin...· 0 citations
UniPET is introduced, a unified approach for whole-body CT-to-PET translation based on curriculum learning that provides a promising approach for augmenting CT-based workflows with synthetic metabolic information, with potential applications in screening triage, in low-resource environments where PET is unavailable, an...
Francesco Di Feola, V. Guarrasi, Mikael Johansson et al.· Frontiers in Artificial Inte...· 0 citations
Background: Diagnostic I-131 whole-body planar imaging in differentiated thyroid cancer (DTC) is count-limited by low administered activity, and quality worsens under rapid acquisition. Models trained on such data struggle because their targets lack photon statistics. Purpose: To test whether high-quality post-therapeu...
Bo-Yang Pan, Hang Yang, Jian-Chen Pan et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.