Jul 2026· IEEE Transactions on Visualization and Computer Graphics· Vol PP· 0 citations
Medicine
TL;DR
A geometry-semantics co-regularization framework that jointly optimizes geometry and semantics within 3DGS and develops a multi-view semantic consistency supervision to regularize the semantic distributions of Gaussian primitives, ensuring cross-view consistency for Gaussians corresponding to the same semantic category or instance.
Abstract
Recent advances in 3D Gaussian Splatting (3DGS) have significantly advanced indoor scene reconstruction, a key capability for AR/VR, robotics, and autonomous systems. However, existing methods that rely on 2D monocular priors often produce artifacts such as holes and unnatural protrusions due to insufficient or weak constraints. To address this limitation, we propose a geometry-semantics co-regularization framework that jointly optimizes geometry and semantics within 3DGS. On the geometric side, we introduce a multi-level geometric optimization strategy with two key contributions. First, inspired by neural implicit surface representations, we design a dual implicit architecture that integrates Implicit Moving Least Squares (IMLS) and Signed Distance Functions (SDFs). This structure enables mutual reinforcement between the two representations via local geometric approximation and global normal constraints, improving fine-grained surface modeling. Second, we develop a view-dependent normal consistency constraint that combines 2D observations with SDF gradients to refine surface accuracy. On the semantic side, we develop a multi-view semantic consistency supervision to regularize the semantic distributions of Gaussian primitives, ensuring cross-view consistency for Gaussians corresponding to the same semantic category or instance. Extensive experiments on the Replica and MuSHRoom datasets demonstrate that our approach achieves state-of-the-art geometric reconstruction quality and rendering fidelity. Check out the project page https://sgo-gauss.github.io for the source code and more results.
A semantic-guided 3D Gaussian splatting (3DGS) framework tailored to sparse-view industrial reconstruction was introduced, enabling robust reconstruction from limited viewpoints and offers a practical geometric foundation for automated inspection and remote equipment monitoring.
Boyang Li, Tian-Han Gao, Zuan Gu et al.· Visual Computing for Industr...· 0 citations
Extracting structured, parametric 3D representations from raw images remains a fundamental challenge in computer vision and graphics. While recent advancements in the 3D Gaussian Splatting (3DGS) pipeline integrate planar primitives to yield compact and editable geometry, these approaches typically treat planes as isolated, discrete sets. This lack of topological connectivity hinders robust geometric reasoning, leading to fragmented reconstructions and misaligned boundaries that fall short of the precision for rigorous spatial analysis and professional design workflows. To address this, we introduce TopoGS, the first 3DGS framework to explicitly integrate both planar and topological constraints for coherent 3D reconstruction. Specifically, we extract global 2D topological relationships from multi-view image segmentations and anchor Gaussian primitives to these structural elements. This formulation enables the joint optimization of plane parameters, rendering fidelity, and topological adjacency. By enforcing strict multi-view consistency alongside these topological constraints, our method significantly mitigates geometric misalignments and produces connected, structured 3D models. Extensive evaluations on the ScanNet++ dataset demonstrate that TopoGS achieves state-of-the-art performance, providing a highly robust solution for generating accurate, topologically sound, and visually faithful scene representations.
Shanshan Pan, Jialei Chen, Yilin Liu et al.· arXiv.org· 0 citations
This work investigates the integration of geometric priors, in the form of predicted normal and depth maps, into the 3DGS framework to improve the reconstruction quality and reveals that multi-view predictions, as they are done by the recent visual geometry grounded transformer (VGGT), outperform single-view alternatives.
A unified multi-axis taxonomy is introduced that enables us to classify the available methods in 3D Gaussian splatting methods in terms of five complementary categories: semantic vocabulary space, representation form, functional role, knowledge source, and query mechanism.
Abstract. In outdoor scene reconstruction, dynamic occlusions and multiscale structures often undermine multiview consistency and hinder effective gradient accumulation of high-frequency Gaussian primitives, leading to artifacts and the loss of fine details in Gaussian splatting–based radiance field methods. To address these challenges, we propose an uncertainty-aware hierarchical Gaussian splatting framework for outdoor 3D reconstruction. Specifically, our method constructs a hierarchical octree-based spatial representation from the results of aerial triangulation. It introduces level of detail constraints to enable structured management and progressive optimization of Gaussian primitives across different scales. This design effectively alleviates the imbalance in training and the redundant growth of Gaussian primitives commonly observed in multiscale outdoor scenes. In addition, we incorporate an uncertainty prediction mechanism that evaluates the consistency between rendered results and ground-truth images in the feature space, allowing the model to automatically identify dynamically occluded regions and suppress their gradient contributions during optimization. As a result, the adverse impact of dynamic artifacts on static scene modeling is substantially reduced. Experimental results demonstrate that, without incurring significant additional training overhead, our method consistently improves structural consistency and fine-detail reconstruction quality in outdoor scenes, while simultaneously reducing model complexity and maintaining real-time rendering performance. Furthermore, the proposed approach can be seamlessly integrated into multiple mainstream Gaussian splatting frameworks, exhibiting strong robustness and promising potential for practical deployment.
Junxing Yang, Haoran Gao, Chun-Yu Huang et al.· Journal of Electronic Imagin...· 0 citations
This work proposes an Iterative Spatial Decomposition framework that bridges dense geometric priors from Multi-View Stereo (MVS) with Gaussian Splatting and introduces Hierarchical Geometric Prior Sampling (HGPS), which substantially reduce redundancy in MVS point clouds while preserving critical details, thereby providing a more robust geometric foundation for reconstruction.
Zonghua Yu, Junhuai Li, Huaijun Wang et al.· ACM Transactions on Multimed...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
