Skip to content
Open access

In-Situ Gaussian Splatting-generated 3D Thermal Mesh Visualization for Urban Trees in Augmented Reality

Jul 2026 · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · Vol XLIX-B2-2026, pp. 1021-1028 · 0 citations

TL;DR

A complete pipeline for in-situ 3D thermal mesh visualization of urban trees in Augmented Reality (AR), combining Thermal InfraRed image acquisition, Gaussian Splatting-based mesh reconstruction, quantitative validation, and mobile AR deployment is presented.

Abstract

Abstract. Urban trees provide critical ecosystem services in dense city environments, yet current workflows for monitoring their thermal behaviour remain confined to 2D desktop-based analysis with no three-dimensional spatial context or field-deployable visualization capability. This paper presents a complete pipeline for in-situ 3D thermal mesh visualization of urban trees in Augmented Reality (AR), combining Thermal InfraRed (TIR) image acquisition, Gaussian Splatting-based mesh reconstruction, quantitative validation, and mobile AR deployment. TIR images of a Tilia tomentosa acquired with a FLIR T560 camera are preprocessed with a standardized false-colour palette and fed into the MILo (Mesh-In-the-Loop Gaussian Splatting) framework to reconstruct a thermally attributed 3D mesh. Geometric evaluation against a Z+F IMAGER 5016 TLS reference using the M3C2 algorithm demonstrates that MILo recovers 13.5 times more canopy geometry than traditional multi-view stereo under thermal imagery, with a standard deviation of 4.0 cm. A colourmap inversion procedure recovers per-vertex temperature estimates from the GS-derived mesh colours, yielding a mean absolute difference of 0.7°C against direct T-Cam measurements (thermal camera mounted on the laser scanner), within the combined instrument accuracy of both sensors. The resulting thermal Gaussian Splat was deployed in a custom Android AR application supporting hybrid marker-based and GPS-based spatial anchoring for in-situ visualization. These results demonstrate the technical feasibility of GS-based thermal reconstruction and mobile AR as a medium for communicating three-dimensional canopy thermal information to educators and urban forestry practitioners.

Read PDF

Similar papers

Open access Jul 2026

3D Meshing of Challenging Surfaces using Gaussian Splatting

This work investigates the potential of Mesh-In-the-Loop Gaussian Splatting (MILo), a recent extension of 3D Gaussian Splatting (3DGS) that integrates differentiable mesh extraction directly within the optimization process, enabling bidirectional consistency between volumetric and surface representations.

D. Billi, Chaimaa Delasse, Arnadi Murtiyoso et al. · 0 citations
Open access Aug 2026

Bridging Semantic Mesh, CityGML, and Gaussian Splatting for Urban Modelling and Visualization

Abstract. Urban digital twin systems require 3D city representations that reconcile semantic structure, geometric reliability, simulation capability, and photorealistic real-time rendering. Existing approaches usually prioritize a single modelling paradigm, limiting their ability to support both analytical and visualization needs. CityGML provides standardized semantics and topology but often lacks surface realism. Semantic mesh models preserve geometric detail suitable for environmental simulations but provide limited hierarchical semantics. In contrast, neural radiance-field approaches such as 3D Gaussian Splatting (3DGS) enable photorealistic rendering at interactive frame rates but do not explicitly encode topology or structured semantics. This study establishes a comparative framework linking LiDAR-derived CityGML, semantic mesh, 3D Gaussian Splatting, and Triangle Splatting within a unified urban modelling workflow. UAV data acquired using a DJI ZENMUSE L2 sensor serve as the geometric backbone for reconstructing CityGML LoD1–LoD2 models. The semantic model is transformed into a textured triangular mesh, while radiance-based models are generated from the same imagery using multiple 3DGS implementations and a triangle splatting framework. Comparative evaluation investigates geometric coherence, semantic preservation, and radiance consistency to identify structural correspondences across the representations. The results reveal complementary modelling layers that can be systematically mapped rather than treated as competing alternatives. Based on these findings, the paper proposes a conceptual foundation for a unified 3D urban model capable of transforming consistently into semantic, surface-based, and radiance-based representations for adaptive urban digital twin systems. Data are freely accessible for research purposes at https://github.com/3DOM-FBK/urban-representation-fusion/.

D. Suwardhi, Muhammad Arif Sudibyo, Agus Ambarwari et al. · 0 citations
Review Open access Jul 2026

Augmenting City Models with Handheld LiDAR and 3D Gaussian Splatting for Inclusive Pedestrian Infrastructure Assessment

Abstract. Urban digital twins increasingly require pedestrian-scale three-dimensional (3D) representations to support accessibility and inclusiveness assessment. However, existing approaches typically emphasize either geometric accuracy or visual realism, while lacking an integrated framework for analysing pedestrian-level conditions. This study proposes a hybrid workflow integrating handheld LiDAR and 3D Gaussian Splatting (3DGS) within a CityGML-based semantic framework for accessibility assessment. Handheld LiDAR provides centimetre-level geometric measurements, enabling the extraction of key indicators such as slope, surface roughness, and obstacle presence. In parallel, 3DGS reconstruction from 360° video imagery enhances visual realism and perceptual understanding. Both datasets are co-registered and structured within the CityGML 3.0 Transportation model to represent pedestrian environments in a unified spatial and semantic framework. Accessibility assessment was conducted using three approaches: LiDAR-based analysis, field survey observations, and immersive evaluation in a Virtual Reality (VR) environment. The LiDAR-based results were used as reference. Comparative analysis shows that field survey assessment achieves an agreement of approximately 85.7%, while VR-based assessment reaches approximately 75.4%. The results indicate that while VR does not replace metric-based analysis, it enables perception-driven and participatory evaluation. In particular, VR-based assessment shows potential to involve users, including people with disabilities, in accessibility evaluation through immersive and remote interaction. The proposed approach contributes to the development of human-scale urban digital twins by integrating metric accuracy, semantic structure, and participatory evaluation for more inclusive accessibility analysis.

D. Suwardhi, Wahyunan Andika, R. Widyastuti et al. · 0 citations
Open access Jul 2026

3D Point Cloud from Close-Range Photogrammetry for Defect Characterisation of Rubberised Concrete

Abstract. While three-dimensional (3D) point clouds are widely used in civil engineering, mainstream LiDAR systems such as Terrestrial Laser Scanning (TLS) are physically constrained to laboratory environments. Since their laser spot size typically exceeds the width of microcracks, the beam physically bridges over voids, rendering TLS unsuitable for fine-scale defect analysis. Alternatively, close-range photogrammetry utilising Structure-from-Motion (SfM) and Multi-View Stereo (MVS) algorithms offers a solution for testing highly tortuous materials, and its utility at fine-scale remains underexplored. This study adapts photogrammetric workflows specifically for rubberised concrete (RuC), a sustainable composite exhibiting high ductility and complex fracture morphologies. High-resolution image sets were captured using a Canon DSLR and an iPhone 16 to generate dense 3D models. Comparisons revealed that the DSLR-based reconstruction achieved sub-millimetre resolution, demonstrating superior performance for fine-scale surface monitoring. An RGB-guided crack extraction method was developed to enhance the identification of surface defects and isolate potential crack areas from the background. The extracted crack regions were visually distinguishable and provided a well-structured geometrical representation of defect morphology. Furthermore, a Pre and Post-Test deformation analysis was conducted to quantify surface displacement across testing stages. The results confirm that this close-range photogrammetry workflow is a flexible, high-resolution alternative to LiDAR for surface inspection and deformation monitoring of specimens in laboratory settings. Ultimately, this approach establishes a robust geometric baseline for future automated 3D feature characterisation and material performance evaluation.

Jiacheng Liu, M. Alnahhal, A. Hajimohammadi et al. · 1 citation
Jul 2026

MR-Compare: A Mixed-Reality Framework for Spatially Grounded Visual Comparison of 3D Gaussian Splatting and Mesh Reconstructions with the Physical Environment

We introduce MR-Compare, a mixed reality framework for spatially grounded visual comparison between 3D Gaussian splatting and mesh reconstructions with live video see-through (VST). Implemented on a PC-tethered Meta Quest~3, it combines a two-stage registration pipeline with a 3D Slider for cross-media comparison. We evaluated five representative desktop and mobile reconstruction workflows through a real-world benchmark with an exploratory user study ($n=30$) in two static indoor rooms. MR-Compare achieved centimetre-level translation error across all workflows. The two desktop 3DGS workflows showed the strongest overall pattern, with 3DGS-MCMC yielding the lowest registration error and strongest VST-referenced visual consistency. Room-session measures indicated high perceived usability and low workload. We further propose an anisotropy filter, a zero-shot module that leverages Gaussian anisotropies to improve 3DGS registration in MR-Compare. A controlled Replica threshold sweep shows that moderate pruning can improve robustness and reduce residual errors. These results establish system-level feasibility in the tested setting rather than task-level effectiveness or standalone deployment. The project is available at https://github.com/changruizhu96/MR-Compare.

Chang-Rui Zhu, E. Kruijff, Peng-Ju Zhang et al. · 0 citations
Open access Jul 2026

Using NeRFs for UAV-based 3D reconstruction of complex scenes: A comparison to MVS

Abstract. High-resolution 3D documentation of cultural heritage sites is essential for their preservation. While terrestrial laser scanning (TLS) remains the gold standard, it is often cost-intensive compared to photogrammetry. This study evaluates three image-based reconstruction techniques, Multi-View Stereo (MVS), Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), by applying them to a complex scene featuring a chapel and its surrounding vegetation, sensed from an uncrewed aerial vehicle (UAV). A hybrid TLS/MVS model provides a high-accuracy reference. Using identical interior and exterior camera parameters of the 105 UAV-acquired images, we generate dense point clouds with all methods and assess geometric accuracy and completeness using the M3C2 algorithm. Results show that MVS achieves superior accuracy (standard deviation of all M3C2 distances: MVS = 0.11 m, NeRF = 0.15 m), whereas NeRF attains up to 20% higher completeness, particularly in low-texture and vegetation-occluded regions. The 3DGS point cloud was deemed too sparse and was therefore not used for further analysis. The study highlights the potential of NeRFs to recover partially occluded or sparsely textured geometries that are challenging for MVS and suggests a complementary use of both approaches for cost-efficient documentation of cultural heritage.

Frederik Schulte, P. Akwensi, L. Winiwarter · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.