Skip to content

Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigation

Jul 2026 · arXiv.org · Vol abs/2607.23181 · 0 citations · 62 references
Computer Science

TL;DR

Results indicate that minimally sufficient world representations provide an effective foundation for robust VLN, and propose BrainNav, a navigation framework grounded in the Principle of Minimal Sufficiency.

Abstract

Vision-and-Language Navigation in continuous environments (VLN-CE) requires an agent to ground language in egocentric observations and plan in unseen scenes. Although recent multimodal large models and world-model-based methods have improved navigation, they often preserve excessive task-irrelevant detail, weakening generalization and increasing computational burden. We propose BrainNav, a navigation framework grounded in the Principle of Minimal Sufficiency. BrainNav consists of three components: a Logical Anchor Model that implements instruction-aware selective perception to suppress environmental noise, a Minimalist Constraint Alignment module that serves as a compact cross-modal bottleneck, efficiently synchronizing discrete linguistic intent with continuous latent dynamics while filtering out redundant information, and a Compression World Model that predicts action-conditioned states within a condensed, low-rank latent space. These modules align semantic intent with spatial perception, enhancing the agent's robustness and efficiency in complex tasks. Experiments show that BrainNav improves over prior SOTA by 2.0 % / 1.0 in SR/SPL on R2R-CE val-unseen and 0.94 % / 0.78 on RxR-CE val-unseen. These results indicate that minimally sufficient world representations provide an effective foundation for robust VLN.

View source

Similar papers

Aug 2026

Toward a Causally-Inspired Evolving World Model for Vision-and-Language Navigation in Continuous Environments

A causally-inspired evolving world modeling framework that formulates VLN-CE as a sequence of causal partially observable Markov decision processes that learns unified latent states that integrate vision, language, and action, and strengthens generalization across diverse navigation contexts.

Xuan Yao, Junyu Gao, Chang-Sheng Xu · 0 citations
Preprint Sep 2026

NavJev: Efficient Vision-Language Navigation via Action-Centric Visual Compression and Discriminative Action-Semantic Memory

Recent zero-shot Vision-and-Language Navigation (VLN) methods increasingly rely on multimodal large language models (MLLMs) to reason over visual observations, navigation instructions, and candidate actions. Although effective, repeatedly invoking autoregressive multimodal reasoning at every navigation step introduces...

Kai Sheng, Liu-Yi Wang, Jin-Long Li et al. · 0 citations
Review Open access Aug 2026

Vision-and-Language Navigation: A Component-Centric Survey of Interactions, Coupling, and Deployment

This survey revisits VLN from a component-internal perspective, viewing it as a navigation system composed of internal components such as instructions, environment representations, and embodied agents, and organizing existing work around the functions and interactions of these components.

Xiang-Xun Wu, Yin-Sheng Wu, Xiaojiang Peng · 0 citations
Preprint Sep 2026

FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigation

FINE is introduced, a Future-Informed Navigation Encoding framework that extracts this latent supervision from existing demonstrations and improves success rate on R2R-CE and RxR-CE val-unseen, recovering roughly one-third of the performance lost by reducing the training demonstrations.

Khang Nguyen, Hoang Pham Quang Nguyen, Ha Phuong Nguyen et al. · 0 citations
#artificial intelligence Preprint Aug 2026

LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation

LightNav-0 is presented, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads, and establishes compact VLMs as a unified and transferable backbone for generalist embodied navigation.

Shao-An Wang, Ao-Cheng Luo, Fei Huang et al. · 6 citations · ⚡1
#artificial intelligence Preprint Sep 2026

TAO-DA: Towards Autonomous Operation--A Dual-Arm Vision-Language-Action Model for Coordinated Manipulation

A symmetric Dual-Arm Expert (DAE) architecture built upon a shared Vision-Language Model (VLM) backbone with decoupled, arm-specific expert towers is proposed, providing preliminary evidence of emergent skill generalization from single- to dual-arm tasks (as well as the reverse), together with cross-arm motion-domain s...

Yong-Shen Zhao, Han Gao, Bao-Ping Cheng et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.