Skip to content
Open access

T2ID: Towards trustworthy incomplete modality diagnosis via dual-axis adaptive completion and confidence-aware integration.

Sep 2026 · Medical Image Analysis · Vol 115, pp. 104331 · 0 citations · 42 references
Medicine

TL;DR

The T2ID is proposed, a multimodal diagnostic framework, which adaptively completes missing modalities and explicitly models cross-modal interactions while maintaining trustworthiness and robustness against missing modality scenarios.

Abstract

Multimodal medical images provide abundant and complementary diagnostic cues that are often indispensable for accurate clinical decision-making. However, various constraints, such as limited equipment availability, physical limitations of patients, etc. often lead to incomplete modality of medical data acquisition in the real world. This scenario makes it difficult to design robust and trustworthy diagnostic AI models under missing-modality conditions. In addition, for some samples, cross-modal completion may not always be beneficial when the available modality representation can already support a reliable prediction. Blindly completing every missing modality may introduce noisy or mismatched complementary features, increase unnecessary computation, and potentially degrade model performance. To address these limitations, we propose T2ID, a multimodal diagnostic framework, which adaptively completes missing modalities and explicitly models cross-modal interactions while maintaining trustworthiness and robustness against missing modality scenarios. Our framework incorporates two key innovations. Firstly, we design a Dual-axis Adaptive Modality Completion (DAA) module, which integrates vertical and horizontal completion strategies to efficiently estimate whether retrieval-based cross-modal completion is expected to provide reliable complementary evidence for the current sample, or cross-modal retrieval is needed for adaptive modality completion. Secondly, we introduce Dynamic Collaborative Confidence-aware Modality Integration (DCC) module, which estimates both unimodal-confidence and synergistic-confidence to capture synergistic or conflicting interactions across modalities, thereby ensuring trustworthy diagnostic predictions. Extensive experiments on three multimodal medical imaging datasets demonstrate that our T2ID achieves superior performance compared with other state-of-the-art methods under diverse missing-modality scenarios. The implementation code is publicly available at https://github.com/lijing-coder/T2ID.

Read PDF

Similar papers

Selective Cross-modal Feature Enhancement Through Collaborative Learning

Selective Cross-Modal Learning is introduced, a lightweight pre-fusion refinement framework that enriches unimodal embeddings by selectively incorporating complementary cues from concurrently available modalities and maintains its advantage under missing-pathology and missing-genomics conditions.

Mohammed Belghadi, Younès Bennani, Valérie Paradis · 0 citations
Conference Open access Sep 2026

Towards Reliable Multimodal Clinical Decision Support: From Quality-Aware Fusion to Patient Digital Twins

This doctoral research addresses fragility in multimodal deep learning by shifting the paradigm from generative imputation to uncertainty-guided abstention and introducing QA-MoE (Quality-Aware MoE), which explicitly decouples reliability estimation from the routing process.

Lin-Peng Sun · 0 citations
Preprint Aug 2026

UniMod: Enhancing Multi-Modal Medical Diagnosis through Cross-Modality and Within-Modality Alignment

Multi-modal learning combining medical images and clinical text is promising for disease diagnosis. However, standard multi-modal training leads to shortcut learning: models exploit the easier modality (e.g., diagnostic cues in text) while neglecting harder-to-learn features (e.g., subtle visual patterns). We propose U...

Zijian Gu, Weikai Lin, Shuang Zhou et al. · 0 citations
#machine learning Preprint Sep 2026

SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis

A unified learning paradigm is proposed that jointly optimizes predictive performance and modality-specific explainability by identifying the most informative elements inside each modality that contribute to diagnostic decisions by employing a matrix-based Renyi's $\alpha$-order entropy functional under the assumption...

Yu-Qing Yang, Alexander Schmatz, Zhao-Zhao Ma et al. · 0 citations
Preprint Sep 2026

When Fusion Fails: Corruption-Aware Rebalanced Fusion for Multi-Modal Medical Image Segmentation

CoReFuse-Med is proposed, a Corruption-aware Rebalanced Fusion framework that suppresses corruption during feature transmission and rebalances modality contributions during high-level fusion, demonstrating improved accuracy and robustness under modality-quality discrepancies.

Yu-Chen Pei, Xiao-Yu Hu, Yi-Xiong Zou et al. · 0 citations
Conference Open access Sep 2026

QA-MoE: Quality-Aware and Stable Multimodal Mixture-of-Experts for Robust Clinical Prediction in Noisy and Missing-Modal Settings

Evaluations on clinical benchmarks demonstrate that QA-MoE outperforms strong multimodal baselines, improving reliability while cutting down unnecessary computation, indicating that QA-MoE offers a robust solution for multimodal decision support, especially in clinical settings prone to noise and missing data.

Lin-Peng Sun, Victor S. Sheng · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.