Jul 2026· Medical Image Anal.· Vol 113, pp.
104206
· 0 citations· 46 references
Computer ScienceMedicine
TL;DR
STAG is proposed, a dual-branch framework for gene-aware expression prediction and spatial context modeling that leverages gene semantic information as biological guidance by encoding gene names with a foundation model, enabling coordinated gene-aware interactions beyond independent gene prediction.
Abstract
Spatial transcriptomics (ST) enables spatially resolved gene expression profiling within intact tissue sections. However, its widespread adoption is constrained by the high cost and low throughput of current sequencing-based protocols. This has motivated growing interest in computationally predicting gene expression directly from routinely acquired histology images. Existing methods are largely restricted to isolated 2D tissue slices and fail to capture richer spatial relationships or structured dependencies among spot-level gene expression profiles. In this paper, we propose STAG, a dual-branch framework for gene-aware expression prediction and spatial context modeling. A Query branch predicts ST expression for an individual target spot, while a Neighbor branch acts as an auxiliary branch to model structured relationships among multiple spots. By leveraging hypergraph learning, the Neighbor branch captures higher-order spatial and molecular dependencies, enabling unified modeling of both intra-slice and inter-slice relationships. This design supports standard 2D settings (a single slice) and naturally extends to 3D scenarios when adjacent tissue sections are available. Moreover, STAG leverages gene semantic information as biological guidance by encoding gene names with a foundation model, enabling coordinated gene-aware interactions beyond independent gene prediction. STAG achieves an average gain of 5.16% in PCC@250 across six datasets. Under highly variable gene selection, STAG maintains the lowest RMSE and highest PCC@50 across three datasets. The effectiveness of the learned representations is further demonstrated in pseudo-3D prediction and downstream cancer classification tasks. Code is available at https://github.com/MCPathology/STAG.
Spatial transcriptomics (ST) profiles gene expression within tissue architecture, but its cost and experimental complexity limit routine use. Predicting spatial expression from routinely available hematoxylin and eosin (HE) images therefore offers a scalable alternative. However, conventional methods often fit high-dim...
Shi-Ting Ruan, Xi-Tong Ling, Qi-Ming He et al.· 0 citations
This work proposes to reformulate morphology-to-transcriptomics prediction as conditional generation in transcriptional program space, thereby exploiting coordinated transcriptional variation instead of predicting genes independently and substantially lowers the dimensionality of the conditional generative task.
CorrFlow is proposed, a correlation-guided flow matching framework for histology-to-ST prediction that explicitly models gene-gene dependencies through two complementary mechanisms and introduces an annealed masked flow matching strategy, encouraging the model to infer masked genes conditioned on the remaining genes an...
Yu-Pei Zhang, Hao Chen, Li Pan et al.· 0 citations
A Spot-Adaptive Structural Rectification method that projects gene expression profiles onto a unit hypersphere to maximize angular distances, effectively separating spots falsely clustered by high total counts and surpasses state-of-the-art methods in spatial clustering.
Huan-Jia Zhao, Shang-Hui Deng, Shunfanyi Li et al.· Proceedings of the Thirty-Fi...· 0 citations
G2T (Gene-to-Tissue), a generative deep learning model that reassembles a tissue from gene expression by predicting the matrix of pairwise distances between cells in a learned embedding space, yields a compact, scalable building block for reconstructing tissue from dissociated cells.
Sebastian Birk, Fabian J. Theis, M. Lotfollahi· bioRxiv· 0 citations
This work introduces spaGFM, a graph foundation model that serializes cellular neighborhoods through random walks to generate transformer-compatible representations of tissue organization that transfer across tissues, disease contexts, and spatial technologies.
Yu Zhong, Fei He, Xiao-Jie Jin et al.· Research Square· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.