This study establishes pathoentity shuffling as an effective principle for pathological image analysis, bridging biological insight and computational design to enhance diagnostic modeling and morphological hierarchy learning.
Abstract
Pathological examination is the current gold standard in cancer diagnosis, yet artificial intelligence (AI) methods still struggle to capture the multi-scale heterogeneity of tumor morphology across patients, tissues, and magnifications. Here, we introduce the PAthoentity Shuffle Strategy (PASS), a principled framework that explicitly models pathoentities, the critical biological structures such as cells, glands, and tissues, and their hierarchical relationships. By controlled shuffling of pathoentities within and across samples, PASS enriches the relational structure available to neural networks, encouraging them to learn both local homogeneity and global heterogeneity. We provide theoretical analysis showing that PASS achieves error bounds comparable to state-of-the-art methods, supporting shuffling as a generalizable computational principle rather than a heuristic. Extensive evaluation on 10 datasets spanning 8 diseases, 9 organs, and 4 magnification levels demonstrates consistent performance gains, robust generalization, and scalability across diverse pathological contexts. Importantly, PASS further shows translational value in a rapid onsite evaluation (ROSE) scenario in gastroenterology, highlighting its potential for clinical deployment. Overall, this study establishes pathoentity shuffling as an effective principle for pathological image analysis, bridging biological insight and computational design to enhance diagnostic modeling and morphological hierarchy learning.
Multi-Resolution Pyramid Transformer (MRPT) is introduced, a model that hierarchically aggregates multi-resolution information from cellular to tissue and WSI levels and surpasses recent foundation models and Multimodal Large Language Models in cancer subtype classification, tissue phenotyping, and Visual Question Answ...
B. Alawode, Moshira Abdalla, Dwarikanath Mahapatra et al.· 0 citations
A foundation model that uses natural language descriptions to segment structures across anatomical regions and spatial scales is presented, establishing a unified framework for flexible pathology segmentation with potential utility for clinically interpretable image analysis.
Zhixuan Chen, Jun Hou, Li-Qi Lin et al.· Nature Computational Science· 1 citation
Pathology foundation models (PFMs) have transformed computational pathology through powerful representation learning from histopathological images. PFMs provide rich, discriminative representations for whole slide image (WSI) analysis, enabling tasks such as slide-level classification under multiple instance learning (...
I. Carretero, Pablo Meseguer Esbri, R. del Amor et al.· 0 citations
MagViT, an interpretable multi-magnification transformer framework with scale-gated fusion and patient-level model selection, is presented, an interpretable multi-magnification transformer framework with scale-gated fusion and patient-level model selection relative to prior ViT-centered BreakHis work.
Nabil Ashab, Soumitra Kundu, Saif Mahmud Parvez et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.