M2-SMap is presented, a memory-efficient semantic mapping framework based on hierarchical multi-model representation that reduces the mean per-frame number of measured inter-object adhesion cases from 2.808 to 0, demonstrating efficient and semantically consistent scene representation.
Abstract
Dense point cloud maps, as a typically used mapping representation, are difficult to deploy on resource-constrained robots because their memory consumption grows rapidly with scene scale. Although compact single-model representations reduce memory cost, their fixed geometric expressiveness is insufficient for structurally diverse environments. Existing multi-model methods improve representational flexibility, yet their feature extraction and model selection are often dominated by local geometry, which can cause overfitting and adhesion between objects. To address these issues, this paper presents M2-SMap, a memory-efficient semantic mapping framework based on hierarchical multi-model representation. First, a hierarchical geometric decomposition partitions RGB-D point clouds into compact Gaussian components. Then, a projection-guided semantic annotation mechanism assigns instance identities to each component. Subsequently, these annotations are incorporated into an object-aware Gaussian fusion strategy. Furthermore, a multi-scale feature extraction strategy separates large planar regions, semantic objects, and complex residual structures, which are respectively represented by bounded planes, object-level superquadrics, and GMM primitives. Experiments on three RGB-D sequences show that M2-SMap runs in real time at no less than 29.37 Hz while achieving the lowest primitive count, with an average reduction of 18.7% over the best baseline. It also reduces the mean per-frame number of measured inter-object adhesion cases from 2.808 to 0, demonstrating efficient and semantically consistent scene representation.
Large-scale indoor mapping and positioning with vision sensors is fundamental to a wide range of applications, such as robotic navigation and augmented reality. However, the rapidly increasing number of detectable objects and the expanded spatial coverage jointly introduce matching ambiguity and high computational cost. Fine-grained object maps can improve accuracy but often accumulate redundant observations and slow down localization, whereas overly compressed scene representations may discard essential semantic and structural cues and degrade robustness. To balance accuracy and efficiency for indoor spatial sensing, we propose TS-MapLoc, a map-centric object-level localization framework based on cross-layer semantic co-mapping. It builds a lightweight topological–semantic map that integrates multi-scale information from the image layer and the object layer, reducing redundancy while preserving key structural constraints. On top of this map, a cognition-inspired progressive localization strategy performs coarse-to-fine inference via stage-wise filtering under cross-layer semantic consistency, effectively narrowing the search space and stabilizing matching. The proposed method supports efficient and accurate object-level localization for built-environment applications.
Cui-Yun Fang, Fan Wang, Ye-Dong Jiang et al.· IEEE Signal Processing Lette...· 0 citations
A modular mapping architecture is demonstrated that establishes 3D Semantic Scene Graphs (3DSSGs) as its foundational back-end, enabling the dense representation of extensive environments containing thousands of unique object instances and supporting open-vocabulary queries via CLIP features without requiring any additional post-processing steps.
F. Igelbrink, Lennart Niecksch, Martin G. ̈unther et al.· 0 citations
This framework combines simultaneous localization and mapping (SLAM), visual-language feature extraction, incremental semantic and instance label fusion, and spatial graph construction to enable a construction robot navigation framework that supports open-vocabulary language queries.
Charles M. Raines, I. Fernandez, Mandy Sun et al.· Journal of computing in civi...· 0 citations
This paper replaces the Stem layer in FRNet with the proposed FD-Stem, which improves feature representation while reducing computational complexity, and introduces long-range modeling capability with limited additional parameters, enabling effective learning of both spatial and channel-wise representations.
Ya-Dong Guo, Jing Liu, Wei Zheng et al.· Journal of Real-Time Image P...· 0 citations
Semantic mapping plays a crucial role in the ability of a robot to interact with objects, operate and navigate a complex environment. The most common pipeline for semantic mapping consists of geometric mapping and localization (SLAM), perception, semantic fusion and semantic representation. However, more recent works also integrate a form of prior knowledge in their application, most notably knowledge graphs or semantic scene graphs, to improve contextual understanding of the environment. In this paper, we present a hybrid pipeline for semantic mapping. Our system incorporates an external calibrated camera using homography projection for geometric mapping and localization, combined with object detection, persistent object tracking and ontology driven semantic updates to build a dynamic semantic world model. Linear regression models are also used for correction of the estimated values of real world coordinates. The system continuously updates object instances, spatial properties and semantic relations based on real time sensory data. Ontologies are selected as form of knowledge representation due to their hierarchical structure, semantic expressiveness and support for dynamic world modelling.
Konstantinos Dimitropoulos, Ioannis Hatzilygeroudis· 0 citations
3D vision-language models (3D VLMs) enable spatial reasoning over multi-view scenes but suffer from substantial token redundancy due to duplicated observations and large uninformative regions, leading to high computational cost. Although visual token compression has shown promise in accelerating 2D VLMs, it fails to capture the structured nature of 3D scenes and leads to incomplete spatial coverage and loss of fine-grained details. In this paper, we propose \textbf{HiSC}, a training-free framework for hierarchical spatial clustering token compression in 3D VLMs. HiSC lifts token compression from token-level selection to cluster-level processing by organizing tokens into spatially grounded clusters using joint geometric and semantic cues. Specifically, we first introduce a \textbf{spatial graph-based merging (SGraM) strategy} that models cross-view redundancy as spatial connectivity and consolidates physically consistent regions, effectively merging extremely similar redundant tokens prior to LLM inference. We then propose a \textbf{spatial clustering-based pruning (SCluP) paradigm} within LLM inference, which performs hierarchical compression across clusters and within clusters, preserving object instance completeness while retaining fine-grained details for important regions. Extensive experiments on diverse 3D reasoning benchmarks show validate the effectiveness of HiSC, particularly under high visual token pruning ratios. Besides, HiSC achieves over 90\% token reduction with minimal performance degradation. Code is accessible at https://github.com/elecreak/HiSC.
Jiuhe Qu, Yingping Liang, Ying Fu· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
