Residual-stream geometry of single-cell foundation models carries incremental gene-regulatory signal across tissues
Single-cell foundation models such as scGPT and Geneformer learn rich representations of gene expression programs, but whether these representations encode gene regulatory relationships beyond expression-level confounds remains unclear. Attention patterns in these models have been shown to capture co-expression rather...