Skip to content

Efficient Medical Segmentation Anything Model for Robust Lightweight Segmentation under Imperfect Data in Embedded Healthcare.

Aug 2026 · IEEE journal of biomedical and health informatics · Vol PP, pp. 1-16 · 0 citations
Medicine

TL;DR

This paper replaces the SAM image encoder with an Efficient Vision Transformer (EfficientViT) backbone and introduces offline knowledge distillation to transfer domain-aware feature representations from the Medical Segment Anything Model (MedSAM) to a compact student network, demonstrating stable performance under imperfect inputs and inexact supervision.

Abstract

Healthcare Industry 5.0 is accelerating the deployment of medical imaging intelligence on embedded and edge devices, where medical data are often imperfect due to acquisition noise, low-contrast regions, and boundary ambiguity, while computational budgets remain tight. Although the Segment Anything Model (SAM) provides promptable segmentation, its heavy encoder hinders edge deployment and its zero-shot behavior can be unreliable for specialized medical imaging scenarios. This paper presents an efficient and lightweight medical image segmentation pipeline tailored for embedded healthcare systems. We replace the SAM image encoder with an Efficient Vision Transformer (EfficientViT) backbone and introduce offline knowledge distillation to transfer domain-aware feature representations from the Medical Segment Anything Model (MedSAM) to a compact student network. To emulate imperfect supervision in practical use, bounding-box prompts are generated from ground truth masks with random per-side perturbations of up to 20 pixels, reflecting the coarse, time-constrained box prompts typical of bedside and field workflows. In addition, an uncertainty-based refinement strategy is incorporated to improve boundary consistency in ambiguous regions. We train and evaluate the proposed approach on 173,024 image-mask pairs spanning seven medical imaging modalities, using the Dice Similarity Coefficient (DSC), the 95th percentile Hausdorff Distance (HD$_{95}$), and the Normalized Surface Dice (NSD). Experimental results show that the lightweight model achieves segmentation accuracy within 0.02 DSC of MedSAM while reducing inference latency to below one-eighth of MedSAM. Robustness is assessed across multiple prompt-perturbation magnitudes ($r\in \lbrace 0,10,20\rbrace$ pixels) and multiple additive Gaussian noise levels ($\sigma \in \lbrace 0,0.05,0.1,0.2\rbrace$, with $\sigma {=}0$ the clean reference), where the proposed model exhibits stable performance under imperfect inputs and inexact supervision, supporting practical deployment in real-time Internet of Medical Things (IoMT) applications.

View source

Similar papers

Conference Jul 2026

GroundMed-SAM: Prompt-based Zero-shot Medical Image Segmentation

Medical image segmentation is a key component of computer-aided diagnosis and treatment planning. Despite substantial progress in deep learning–based models, most existing approaches depend heavily on large annotated datasets and often fail to generalize across heterogeneous clinical environments, limiting their deployment in real-world settings characterized by domain shifts and scarce expert annotations. This paper presents a zero-shot learning framework named GroundMed-SAM for medical image segmentation. The framework integrates GroundingDINO for prompt-based region localization and MedSAM for mask generation. To address the weak alignment between visual features and medical semantics in GroundingDINO, which is pretrained on general domain image-text pairs, we introduce learnable medical text embeddings that explicitly parameterize domain-specific terminology in a continuous semantic space. These embeddings are optimized during training to better align medical concepts with visual representations, thereby strengthening text-image correspondence and improving detection-guided segmentation. The proposed framework preserves true zero-shot capability, enabling segmentation of previously unseen anatomical structures without task-specific labels. Extensive experiments on multiple public datasets across diverse modalities and clinical contexts demonstrate that our method achieves competitive segmentation performance in-domain while exhibiting superior robustness under cross-domain evaluation. Although supervised baselines outperform the proposed framework by only 3–5% on in-domain datasets, they experience substantial performance degradation when evaluated on unseen domains. Additionally, the framework achieves an AUC of 98.9 in endoscopic polyp detection, highlighting the effectiveness of the proposed medical-aware textual embeddings in guiding region localization. These results demonstrate the effectiveness of the proposed framework in improving cross-domain generalization for medical image segmentation with limited annotations.

V. Nguyen, Hoang Quan Luong, Phuc Ngoc Pham · 0 citations

TvaraNet: A Lightweight Mamba Neural Network for Real-Time Medical Image Segmentation

TvaraNet is pro-posed, an extremely lightweight segmentation network designed to preserve boundary fidelity under strict efficiency constraints and achieves competitive or superior boundary-aware performance compared to heavier architectures.

Sridhatta Jayaram Aithal, Vandana Bharti · 0 citations
Jul 2026

VSS-SAM++: Visual State Space-Aware SAM for 3D Medical Image Segmentation.

The Segment Anything Model (SAM) has demonstrated groundbreaking performance in natural image segmentation, yet its direct application to medical imaging remains suboptimal due to domain shifts in data distributions and the inherent 3D nature of medical data. Although recent SAM-based methods have employed parameter-efficient transfer learning (PETL) to adapt SAM for medical tasks, they often overlook the critical 3D contextual information essential for accurate volumetric segmentation. To address this limitation, we introduce VSS-SAM++, a novel dual-branch architecture that combines SAM's foundational visual priors with Vision Mamba's capacity for modeling long-range spatial dependencies. In this framework, SAM serves as the primary encoder for high-level feature extraction, while a parallel Mamba branch captures cross-slice dependencies in 3D medical volumes. A gated hybrid attention module then dynamically fuses complementary features from both branches, adaptively weighting multi-view representations to minimize feature ambiguity and enhance segmentation precision. Extensive evaluations across nine public CT and MRI datasets demonstrate that VSS-SAM++ outperforms existing methods by 0.2-11.3% in Dice score on multi-organ and lesion segmentation tasks. The framework's robustness to domain shifts and scalability across diverse modalities highlights its potential for clinical deployment.

Jinxuan Lyu, Bin Zhang, Yipan Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.