Visual perception system for urban roads: underground pipelines based on mixed reality technology

Abstract

To address the difficulty of perceiving coupled underground pipeline structures beneath urban roads, a visual perception system based on mixed reality (MR) technology is proposed. An efficient data communication architecture is designed to integrate a spatial pipeline database with Internet of Things (IoT) sensor data, enabling real-time synchronization of heterogeneous multi-source information. Using a head-mounted MR device, three-dimensional pipeline models, attribute data and operating states are spatially registered and overlaid onto the real road environment, forming a see-through visualization and interaction interface. Users can obtain the spatial location and dynamic status of concealed underground facilities directly through gesture-based and natural interactions. Experimental tests indicate that the system achieves good performance in terms of data timeliness and visual registration accuracy, and can effectively improve the efficiency and clarity of underground pipeline inspection and emergency assessment.