Skip to content
Open access

3D Meshing of Challenging Surfaces using Gaussian Splatting

Jul 2026 · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · 0 citations · 6 references

TL;DR

This work investigates the potential of Mesh-In-the-Loop Gaussian Splatting (MILo), a recent extension of 3D Gaussian Splatting (3DGS) that integrates differentiable mesh extraction directly within the optimization process, enabling bidirectional consistency between volumetric and surface representations.

Abstract

Abstract. Accurate 3D reconstruction of Cultural Heritage (CH) assets remains a challenging task when scenes include complex geometries and non-Lambertian surfaces, such as dense vegetation, reflective ceramics, or polished materials, which often degrade the performance of traditional multi-view stereo (MVS) pipelines. This work investigates the potential of Mesh-In-the-Loop Gaussian Splatting (MILo), a recent extension of 3D Gaussian Splatting (3DGS) that integrates differentiable mesh extraction directly within the optimization process, enabling bidirectional consistency between volumetric and surface representations. The method is evaluated on three challenging CH datasets: a monumental Tilia tomentosa tree located in a UNESCO-listed urban garden, a reflective ceramic object from the Sarreguemines Earthenware Museum and the South Portal façade of the Notre-Dame Cathedral of Strasbourg. MILo-based reconstructions are compared against standard photogrammetric MVS results generated with Agisoft Metashape, using terrestrial laser scanner (TLS) point clouds as geometric reference. Quantitative accuracy assessment is performed through Multiscale Model-to-Model Cloud Comparison (M3C2), focusing on error distribution, standard deviation, outlier percentage, and preservation of fine-scale structures. Results indicate that while conventional MVS performs slightly better on stable architectural surfaces, MILo significantly improves reconstruction consistency for complex organic geometries, substantially reducing outliers and better preserving thin structures. These findings highlight the suitability of MILo for CH documentation scenarios characterized by challenging surface properties and intricate natural forms.

Read PDF

Similar papers

Open access Jul 2026

Gaussian splatting for the reconstruction of complex and highly detailed object

Three Gaussian splatting methods as implemented in the Postshot commercial software were tested and show that MILo shows very promising results in terms of detail reconstruction, while standard Gaussian splatting excels in visualisation but is still plagued by a high rate of noise especially when converted into a geometric point cloud form.

Sara Gonizzi Barsanti, D. Billi, E. Sommer et al. · 0 citations
Open access Jul 2026

Evaluating 3D Scene Representations for Aerial Photogrammetry across Diverse Cityscapes

Abstract. The proliferation of continuous Neural Radiance Field (NeRF) and 3D Gaussian Splatting (3DGS) has shifted the paradigm of 3D aerial reconstruction from relying solely on geometric stereo matching to inverse rendering optimization. However, while these emerging rendering-based frameworks excel in synthesizing photo-realistic novel views, their capability to extract accurate surfaces in complex aerial scenarios remains ambiguous compared to traditional methods. To establish a clearer understanding, this study presents a comprehensive evaluation of five representative frameworks spanning traditional Structure from Motion (SfM), purely Signed Distance Field (SDF) representations, unstructured 3D Gaussians, hybrid voxel-Gaussians, and strictly explicit sparse voxels. By systematically standardizing identical computational environments, inputs, and unified mesh-extraction pipelines on both real-world airborne LiDAR datasets and synthetic cityscapes, we assess their performance regarding visual fidelity, geometric accuracy, and resource efficiency. The experimental results reveal that while traditional MVS produces the highest overall geometric precision by strictly enforcing multi-view rigid geometry, it is prone to failures in texture-less regions. Among rendering-based representations, a fundamental trade-off exists: highly flexible, unstructured 3DGS achieve highest visual scores but degrade the underlying geometric surfaces; conversely, explicitly structured techniques demonstrate distinct superiority in regularizing topological coherence and floating artifact suppression. Furthermore, we observe that integrating structured voxels avoids the severe memory bottlenecks associated with extracting geometries from chaotic unorganized primitives. These empirical findings emphasize that for large-scale aerial photogrammetry, integrating explicit spatial structuralization into differentiable rendering pipelines is imperative for achieving scalable operations and bridging the geometric accuracy gap with traditional methods.

Shihan Chen, Zhaojin Li, Q. Yan et al. · 0 citations
Open access Jul 2026

In-Situ Gaussian Splatting-generated 3D Thermal Mesh Visualization for Urban Trees in Augmented Reality

A complete pipeline for in-situ 3D thermal mesh visualization of urban trees in Augmented Reality (AR), combining Thermal InfraRed image acquisition, Gaussian Splatting-based mesh reconstruction, quantitative validation, and mobile AR deployment is presented.

Chaimaa Delasse, D. Billi, I. Gede Mahendra Darmawiguna et al. · 0 citations
Open access Jul 2026

Automatic Segmentation of 3D Gaussian Splatting in Cultural Heritage Complex

Abstract. 3D Gaussian Splatting (3DGS) has emerged as a promising method for photorealistic scene reconstructions, yet its application to semantic segmentation in real-world heritage documentation remains underexplored. This study proposes and evaluates an automated semantic 3DGS segmentation pipeline integrating the Segment Anything Model 3 (SAM 3) with per-class prompting for Gaussian reconstruction, applied to a nadiral UAV dataset of the Siti Inggil heritage complex in Cirebon, Indonesia. Segmentation performance of four semantic classes (ground, roofs, vegetations, and water bodies) were assessed against manually segmented 2D and 3D reference data, supplemented by geometric accuracy assessment via the M3C2 analysis. Results reveal both the promise and the inherent challenges of applying 3DGS segmentation to complex real-world heritage scenes, where acquisition geometry, surface characteristics, and foundational model limitations can be observed.

W. A. Fadilah, Virgile Gauthier, Arnadi Murtiyoso et al. · 0 citations
Open access Jul 2026

Modelling Transparent Surfaces in Heritage Artefacts with Gaussian Splatting

Abstract. The 3D reconstruction of cultural heritage artefacts plays a crucial role in documentation, conservation and dissemination. While recent advances in photogrammetry, laser scanning and neural rendering techniques have significantly improved the geometric accuracy and visual realism of digitised assets, the reconstruction of transparent and reflective materials - typical in museal collections - remains a major challenge. Materials such as glass, glazes and varnishes exhibit complex optical behaviours, leading to incomplete or inaccurate 3D models. Recent developments in Gaussian Splatting (GS) offer a potential alternative by enabling efficient, high-fidelity scene representation without explicit surface modelling. However, their application to non-Lambertian and transparent heritage objects remains largely unexplored. This paper presents a study on GS methods for the 3D digitisation of transparent cultural heritage artefacts. Through a series of experimental reconstructions, the work investigates the potential and limitations of GS, highlight the opportunities of hybrid pipelines for addressing long-standing challenges in the digitisation of non-collaborative materials.

Marco Medici, Andrea Sterpin, Stefano Settimo et al. · 0 citations
Open access Aug 2026

GSSA: Gaussian Surfels with Spatial Awareness for Surface Reconstruction

This paper introduces Gaussian Surfels with Spatial Awareness (GSSA) for reconstruction, a spatially aware reconstruction framework that optimizes for Surfel distributions from geometric primitives via a 3D refiner, and constructs SDF by integrating signed distances from voxel vertices to nearby Surfels.

Hao Tang, Siyuan Zou, Hongbo Pan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.