HM-Nav is presented, a brain-inspired architecture that bridges this cognitive gap by integrating transient sensory inputs with an evolving internal model to enable long-term object navigation and suggests that emulating human-like memory structures is essential for achieving resilient, long-term autonomy in complex, open-ended environments.
Abstract
Effortless object finding by humans, even in cluttered or unseen environments, relies on the seamless integration of perception, memory, and contextual inference. In contrast, embodied robots operating under egocentric perception and partial observability frequently struggle with dynamic spatial relations and long-term consistency, leading to inefficient, repetitive search behaviors. Here we present Human-like Memory Navigation (HM-Nav), a brain-inspired architecture that bridges this cognitive gap by integrating transient sensory inputs with an evolving internal model to enable long-term object navigation. HM-Nav employs three synergistic pillars: (i) Perception: a multi-view fusion module that reconciles viewpoint inconsistencies into unified representations; (ii) Memory: an adaptive dynamic knowledge graph that accumulates semantic-spatial associations over extended timescales; and (iii) Inference: an experience-driven trajectory optimization mechanism that learns from past failures to suppress cyclic and suboptimal search patterns. Validated in simulations and real-world trials, HM-Nav demonstrates superior navigation performance and robust sim-to-real transfer, significantly outperforming existing benchmarks. Our findings suggest that emulating human-like memory structures is essential for achieving resilient, long-term autonomy in complex, open-ended environments.
Spatial intelligence requires maintaining a coherent understanding of the world as the embodied agent moves. Like humans, the agent must use its own motion to interpret changes across observations and update object locations and spatial relations accordingly. Despite spatial post-training having substantially broadened...
Shi-Chao Li, Mei-Qi Wang, Fei Su et al.· 0 citations
VLMs have shown promise for autonomous driving, yet still suffer from hallucination, weak spatio-temporal perception, and limited generalization. Recent methods improve reasoning and decision-making through CoT explanations, retrieval-augmented generation or the static injection of tool outputs. Although these mechanis...
MachEmbodied-Brain (ME-Brain) is introduced, a self-evolving embodied system organized around a closed loop of action execution, experience acquisition, experience evolution, and improved execution that shifts embodied intelligence from train-and-freeze to deploy-and-evolve without model retraining.
Wei He, Heng-Tao Li, Chen-Feng Wang et al.· 1 citation
This work proposes a user-friendly, interactive framework that eliminates the reliance on globally consistent maps and integrates visual perception with Large Language Models (LLM) to interpret user commands via text or voice.
Praveen Kumar, K. Guruprasad, Tushar Sandhan· IEEE International Joint Con...· 0 citations
LightNav-0 is presented, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads, and establishes compact VLMs as a unified and transferable backbone for generalist embodied navigation.
This work proposes an agent-based active exploration framework that enables robots to dynamically interact with the environment rather than merely execute predefined instructions, and introduces a fine-grained perception-execution interleaving strategy, which tightly couples visual feedback with skill execution to impr...
Shi-Lin Ma, Chu-Bin Zhang, Xu-Long Bai et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.