This review provides a comprehensive synthesis of efficient and lightweight deep learning architectures specifically tailored for the medical domain, and examines key model compression strategies and their efficacy in maintaining diagnostic performance while reducing hardware requirements.
Abstract
Deep learning has revolutionized medical image analysis, playing a vital role in modern clinical applications. However, the deployment of large-scale models in real-world clinical settings remains challenging due to high computational costs, latency constraints, and patient data privacy concerns associated with cloud-based processing. To address these bottlenecks, this review provides a comprehensive synthesis of efficient and lightweight deep learning architectures specifically tailored for the medical domain. We categorize the landscape of modern efficient models into three primary streams: Convolutional Neural Networks (CNNs) for local inductive bias, Lightweight Transformers for global context under constrained attention, and emerging Linear Complexity Models for scalable global context. Furthermore, we examine key model compression strategies (including pruning, quantization, knowledge distillation, and low-rank factorization) and evaluate their efficacy in maintaining diagnostic performance while reducing hardware requirements. By identifying current limitations and discussing the transition toward on-device intelligence, this review serves as a roadmap for researchers and practitioners aiming to bridge the gap between high-performance AI and resource-constrained clinical environments.
Extensive experiments across three medical imaging benchmarks, two brain tumor classification datasets (SARTAJ, Br35H) and dental radiography analysis demonstrate that CENet variants achieve state-of-the-art efficiency-accuracy trade-off.
Amina Benabid, Kangjie Cheng, Yun-Feng Liu et al.· Journal of King Saud Univers...· 0 citations
Empirical evidence from recent studies demonstrates that fine-tuning and network-based DTL strategies, including federated learning, consistently enhance diagnostic accuracy, robustness, and generalization across multiple medical imaging modalities, particularly in data-limited clinical scenarios.
M. A. S. Banu, A. Dhavapandiammal, K. Palanisamy· Current medical imaging· 0 citations
A dual-perspective framework to systematically bridge the gap between algorithmic advances and practical demands of pathological diagnosis and prognosis is proposed, which offers practical guidance for selecting and designing AI solutions tailored to specific clinical goals.
Yun-Qiu Gao, Teng Ma, Lisha Li et al.· Chinese Medical Journal· 0 citations
Major deep learning architectures, including CNNs, residual networks, UNet, attention-based models, Vision Transformers, and hybrid approaches, along with their clinical applications are summarized and emerging directions such as self-supervised learning, Explainable AI, federated learning, and lightweight models are h...
Lakshmi Sai Anusha Dadi, Pravallika Devi Kommana· International Journal for Re...· 0 citations
The optimisation of lightweight deep learning models for smartphone-based oral cancer screening is presented and it is confirmed that with targeted architectural selection and streamlined optimisation, interpretable and robust lightweight AI models exhibit high potential for edge deployment to enable automated triage i...
Siddhant Bharadwaj, Aakash Shedsale, T. Subramanya et al.· 0 citations
Results demonstrate that Adaptive-CGAN can improve diagnostic performance, synthetic image quality, computational efficiency, and environmental sustainability in AI-assisted healthcare.
W. Saber, A. El-Baz, R. Rizk· Cluster Computing· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.