Skip to content

VPRef: A Cross-Domain Benchmark for Referring Remote Sensing Image Segmentation

Sep 2026 · arXiv.org · Vol abs/2609.16486 · 0 citations · 38 references
Computer Science

TL;DR

This paper establishes the first cross-domain RRSIS benchmark, designated as the Vaihingen-Potsdam Referring (VPRef) dataset, and develops a tailored parameter-efficient domain adaptation baseline anchored on the Segment Anything Model (SAM3) via Low-Rank Adaptation (LoRA).

Abstract

Rapid advancements in vision-language models have propelled Referring Remote Sensing Image Segmentation (RRSIS) to the forefront of Earth observation. However, practical deployments suffer severe performance degradation under a coupled dual-drift paradigm: visual domain drift from cross-spatial-resolution mismatches and spectral variations, alongside textual logic drift from unconstrained, variable user-input granularities. To mitigate these bottlenecks, this paper establishes the first cross-domain RRSIS benchmark, designated as the Vaihingen-Potsdam Referring (VPRef) dataset, comprising 46,972 language-image-annotation triplets organized into a three-tier linguistic hierarchy. Building upon this benchmark, we develop a tailored parameter-efficient domain adaptation baseline anchored on the Segment Anything Model (SAM3) via Low-Rank Adaptation (LoRA). Our framework counteracts visual distribution discrepancies through pseudo-label-driven self-training and addresses textual logic drift via random multi-granularity text prompt mixing. Crucially, the distribution of empirical metrics across ablative variants suggests a potential decoupling between cross-modal semantic robustification and visual domain alignment, demonstrating that linguistic variance drives fine-grained semantic invariance while pseudo-label propagation governs macro-scale spatial grid alignment. Extensive benchmarks demonstrate the proposed framework achieves superior cross-domain segmentation boundaries while modifying merely 1.08\% of the foundational parameter footprint, establishing a robust baseline for future multi-modal remote sensing domain adaptation research. The dataset and code will be available at https://github.com/quanweiliu/VPRef.

View source

Similar papers

Open access 2026

ConceptSeg: Zero-Shot Geospatial Concept Segmentation for Remote Sensing Images

ConceptSeg is presented, a text-guided multimodal segmentation framework that enables zero-shot segmentation of linguistically described geospatial objects in remote sensing imagery, supporting concept-driven segmentation for complex geospatial reasoning.

Yang Zhao, Ya-Wei Bai, Ming-Ming Jia et al. · 0 citations
Sep 2026

PromptRefine: source-free unsupervised domain adaptation for remote sensing image classification via CLIP filtering

This work proposes PromptRefine, a white-box SFUDA framework designed to anchor target adaptation through cross-modal intelligence, and leverages the zero-shot semantic priors of large-scale vision–language models to rectify source-biased predictions via a dynamic prompt fine-tuning mechanism.

Unknown authors · 0 citations
Open access 2026

M3RIS: Mutual Modulation Mamba Network for Referring Remote Sensing Image Segmentation

Referring remote sensing image segmentation (RRSIS) aims to map natural language queries to pixel-level masks within complex geographic scenes, requiring precise cross-modal semantic alignment. In recent years, Mamba has demonstrated impressive performance in various remote sensing tasks due to its powerful contextual...

Hu Guo, Bin Sun, Wei-Qing Lu et al. · 0 citations
2026

S2CLNet: Structure-Constrained Semantic Contrastive Learning for Referring Remote Sensing Image Segmentation

Referring remote sensing image segmentation (RRSIS) aims to segment target ground objects in high-resolution remote sensing imagery according to textual descriptions. Due to complex backgrounds and large-scale variations, accurately aligning linguistic semantics with spatial regions remains a challenging problem. Exist...

Sen Lei, Shuai Li, Xin-Yu Xiao et al. · 2 citations
Open access 2026

Dual-Level Prototype Alignment via Cross-Attention for Few-Shot Remote Sensing Semantic Segmentation

DLPANet is proposed, a novel dual-level prototype alignment network centered on Prototype-Guided Spatial Attention, enabling simultaneous modeling of scene context and fine-grained details and demonstrates that the decoupled dual cross-attention mechanism provides superior prototype-query alignment compared to prior gl...

Mustafa Alawadi, M. Fateh · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.