The emergence of foundation models has revolutionized neuroimaging analysis, offering universal representations for decoding complex brain functions. However, existing fMRI-based foundation models predominantly rely on standard group-level atlases neglecting inter-subject heterogeneity. They often operate on voxel-wise time series with inherent low signal-to-noise ratios (SNR) and employ single-objective pre-training strategies that fail to capture fine-grained local structures and global discriminative representations. To bridge these gaps, we present BrainNetGFM, a novel graph-based foundation model for brain network construction that integrates individualized geometry with joint self-supervised learning, pre-trained on a massive dataset of 44,476 samples. First, we introduce an individualized brain atlas construction method utilizing region growing on functional priors to ensure precise alignment of subject-specific functional topology. Brain network graphs integrating functional connectivity strength with individualized spatial geometry is constructed. Second, we propose a joint self-supervised learning (SSL) framework that synergizes generative and contrastive paradigms. Specifically, we combine graph masked autoencoders (GMAE) to reconstruct masked node and edge features for learning fine-grained local structures, alongside multi-level graph contrastive learning (GCL) spanning both node and graph levels to enforce global discriminative representations. Extensive experiments on downstream tasks including the diagnosis of 8 brain disorders, age and cognition prediction, demonstrate that BrainNetGFM outperforms 9 state-of-the-art methods. Moreover, BrainNetGFM exhibits superior interpretability, identifying neurologically meaningful network biomarkers for clinical analysis. The code is publicly available at https://github.com/BrainLabA/BrainNetGFM.
Chunzhi Zhao, T. Adalı, Jing Sui et al.· Proceedings of the 32nd ACM...· 0 citations
Modeling shared and subject-specific structure in multisubject spatiotemporal data remains challenging, particularly in neuroimaging, where both spatial and temporal patterns exhibit rich variability across subjects. Existing matrix and tensor decompositions provide interpretable factorizations, but rely on fixed multilinear structures or coupling schemes that may limit their flexibility in capturing complex variability. In this work, we introduce a spatiotemporal variational tensor decomposition (ST-VTD) framework that combines a tensor factorization generative model with structured priors to jointly represent spatial maps and temporal dynamics. Spatial factors are regularized to promote a low-rank structure inspired by the LL1 decomposition, while temporal factors are modeled using a learned Long short-term memory (LSTM)-based prior, enabling flexible and adaptive dynamics. Posterior inference is performed using an amortized variational formulation by unrolling iterations of an optimization algorithm, leading to an interpretable and parameter-efficient architecture. The proposed inference framework employs a warm-start strategy based on group independent component analysis, which we found to improve optimization performance. Experiments on a realistic synthetic functional MRI (fMRI) dataset demonstrate that the proposed approach significantly improves latent factor recovery compared with representative classical and probabilistic decomposition benchmarks.
L. Montaldo, R. Borsoi, Sebastian Miron et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.