Powered By Gaussian Splats: From World Models to 3D Interactive Worlds
TL;DR
Every attendee has a live WebXR experience running on commodity XR hardware, informed by a conceptual map of where 3DGS world models sit in the broader ecosystem of generative spatial AI.
Abstract
The rapid maturation of 3D Gaussian Splatting (3DGS) as a native output format of generative world models has created a compelling but underserved workflow gap: developers and artists who can prompt a photorealistic volumetric scene into existence lack the practical skills to deploy it as a navigable, interactive extended-reality (XR) experience. This 90-minute, hands-on technical workshop bridges that gap. Participants survey the landscape of spatial world models — contrasting video-based, point-cloud, and 3DGS representations across four levels of spatial information — then follow a structured five-stage pipeline: world model generation and scene export, WebXR integration with Spark.js 2.0, level-of-detail (LOD) tuning for real-time performance, semantic object detection via Splat Analyzer to surface interactive trigger zones, and open build time for creative extension. All tools are open-source or browser-accessible; the only prerequisite is Node.js 20 or higher. By the end of the session, every attendee has a live WebXR experience running on commodity XR hardware, informed by a conceptual map of where 3DGS world models sit in the broader ecosystem of generative spatial AI.