Skip to content
Preprint

SparseNav: Instruction-conditioned Sparse Semantic Perception for Training-Free Vision-Language Navigation

Sep 2026 · 0 citations · 32 references
Computer Science

TL;DR

SarseNav, a training-free framework that follows a less-is-more principle for semantic navigation, is presented and validated its effectiveness across multiple indoor environments using instruction-conditioned waypoint navigation.

Abstract

Map-based vision-language navigation (VLN) relies on persistent spatial representations to connect language understanding with geometric planning. However, acquiring semantics beyond the needs of the current instruction can introduce unnecessary perception cost and irrelevant annotations. Continuously accumulating unrelated objects may not only waste computation, but also clutter the visual-spatial representation consumed by the vision-language model (VLM) planner. To address this problem, we present SparseNav, a training-free framework that follows a less-is-more principle for semantic navigation. SparseNav persistently maintains a lightweight geometric bird's-eye-view (BEV) map and sparse landmark memory, acquiring new semantics on demand using the active sub-instruction to decide what is worth grounding. An instruction manager first tracks navigation progress and identifies the active landmark query. An instruction-conditioned perception mechanism then invokes open-vocabulary segmentation when the queried landmark is visible and its metric location can inform the next decision. The resulting landmark memory supports VLM selection among hybrid frontier and local directional waypoint candidates. Without any additional training, SparseNav achieves success rates of 42.8% on R2R-CE and 40.7% on RxR-CE, both on the Val-Unseen splits. Controlled ablations examine semantic perception strategies and the contributions of individual framework components. Furthermore, we successfully deployed SparseNav on a Unitree Go2 quadruped equipped with an Intel RealSense D455 RGB-D camera for geometric mapping and landmark grounding and a Livox MID-360 LiDAR for localization, without a prebuilt map. We validated its effectiveness across multiple indoor environments using instruction-conditioned waypoint navigation.

View source

Similar papers

Sep 2026

FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigation

FINE is introduced, a Future-Informed Navigation Encoding framework that extracts this latent supervision from existing demonstrations and improves success rate on R2R-CE and RxR-CE val-unseen, recovering roughly one-third of the performance lost by reducing the training demonstrations.

Khang Nguyen, Hoang Pham Quang Nguyen, Ha Phuong Nguyen et al. · 0 citations
Preprint Sep 2026

LG-VLN: A Zero-Shot Vision-and-Language Navigation Framework with LangGraph State Orchestration

Continuous-environment vision-and-language navigation (VLN-CE) requires interpreting natural-language instructions in unseen 3D environments and executing continuous low-level actions. Existing methods often depend on LiDAR, panoramic cameras, or extra sensors; separate geometric-mapping and semantic-navigation visual...

Jian-He Zhao, Yan-Hua Qiu, Zhi-Yu Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

One MLLM, One Call: Efficient Zero-Shot Vision-and-Language Navigation via Spatial-Aware Waypoints

O2C-Nav is proposed, an efficient zero-shot navigation framework that calls only a single large model once per decision step and introduces a training-free structured waypoint generator and a novel abstract representation that projects sparse, history-aware candidate waypoints directly onto RGB images as visual markers...

Shi-Qi Pan, Qi Zheng, Hanmeng Sun et al. · 2 citations · ⚡1
Sep 2026

What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior

This work uses intervention-based metrics that measure how visual observations, instructions, and visual memory causally influence navigation decisions and shows that these navigation policies are sensitive to all input modalities and do not depend on a single one.

Débora Oliveira Makowski, Samiran Gode, Abhijeet Nayak et al. · 0 citations
Sep 2026

A Topological Representation with Object-Path Graphs for Open-Vocabulary Instance Navigation

This work proposes an object--path graph that unifies open-vocabulary semantic reasoning with topological navigation, and introduces a navigation strategy that combines global path planning with local inter-node execution through lightweight node localization and semantic visual servoing, enabling navigation directly o...

Lin-Wei Zheng, Dao-Jie Peng, Bing-Tao Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.