This review systematically analyzes the emerging landscape of FMs in omics research, spanning sequence modeling, cell state characterization, and multimodal integration, and proposes a roadmap for the next generation of FMs, advocating for architectures that move beyond statistical correlation to incorporate causal reasoning, temporal dynamics, and autonomous experimental validation.
Abstract
Abstract The rapid expansion of high-throughput omics has created molecular datasets of unprecedented scale and complexity. These data are rich in biological information yet inherently sparse and high-dimensional, often limiting the effectiveness of conventional machine learning techniques. Foundation models (FMs), built on large-scale self-supervised pretraining, offer a robust alternative by learning generalizable representations directly from raw biological data. This review systematically analyzes the emerging landscape of FMs in omics research, spanning sequence modeling, cell state characterization, and multimodal integration. We organize the current literature into three distinct paradigms—sequence-centric, cell-centric, and multi-omics—to clarify a field currently fragmented by diverse tokenization strategies and architectural choices. Beyond methodology, we evaluate the practical utility of these models in tasks ranging from biomarker discovery to perturbation response prediction. We also identify critical barriers to adoption, including high computational costs, interpretability challenges, and the lack of standardized benchmarks. To support reproducible research, we provide a curated catalog of essential datasets and evaluation frameworks. Finally, we propose a roadmap for the next generation of FMs, advocating for architectures that move beyond statistical correlation to incorporate causal reasoning, temporal dynamics, and autonomous experimental validation.
MB-SupCon-cont improves prediction accuracy by incorporating a generalized contrastive loss function that defines similarity and dissimilarity for continuous responses using three distance-based weighting methods, and provides superior representation learning and improves data visualization in lower-dimensional spaces.
Sen Yang, Shidan Wang, Yiqing Wang et al.· Frontiers in microbiomes· 0 citations
Results suggest that PLAT provides an effective and interpretable framework for high-dimensional transcriptomic classification and functional enrichment analyses consistently highlighted biological processes and disease pathways associated with breast cancer, supporting the biological relevance of the learned latent re...
Kamal Elatifi, Nicolas Jäger Gallego, Á. Sánchez-Pla et al.· Applied Sciences· 0 citations
This manuscript evaluates sure screening, a class of filter-based feature selection methods which provide analytical guarantees for true feature set retention and identified BcorSIS as the most effective and computationally efficient screening method across various omics datasets.
Erik Vonkaenel, Lisa M. Bramer, J. Flores et al.· PLoS Computational Biology· 0 citations
OmicFormer, a Transformer-based architecture that embeds two complementary statistical priors, i.e., feature-label associations and feature-feature dependencies, directly into its representation learning, provides an interpretable and generalizable foundation for omics-based precision medicine.
H. Jiang, C. Yang, M. Qin et al.· medRxiv· 0 citations
A multi-tier, explainable AI framework designed to risk-stratify patients and predict overall survival using clinical and genomic covariates is developed and demonstrates that explainable machine learning models can robustly predict survivability and highlight actionable features for oncology dashboards.
Monroe is presented, a new MFM with several innovations over the existing state of the art: increased scale allowing pre-training on over 81 million molecules from the PM6 quantum chemistry dataset; improved graph representation of stereochemistry; improved training losses including conformer denoising and embedding de...
Błażej Banaszewski, Andrew W. Fitzgibbon· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.