INLA-SPDE Spatio-Temporal Bayesian Optimization is introduced, the first scalable BO framework for spatio-temporal data, that models the log-intensity with a Log-Gaussian Cox Process and performs inference via Integrated Nested Laplace Approximation and Stochastic Partial Differential Equations (INLA-SPDE) approach.
Abstract
Bayesian Optimization (BO) is a popular method for efficiently optimizing expensive black-box objectives. However, BO utilizing standard Gaussian Processes is ill-suited for doubly stochastic Cox Processes that are often used in spatio-temporal problem spaces. We introduce INLA-SPDE Spatio-Temporal Bayesian Optimization (ISBO): the first scalable BO framework for spatio-temporal data, that models the log-intensity with a Log-Gaussian Cox Process(LGCP) and performs inference via Integrated Nested Laplace Approximation and Stochastic Partial Differential Equations (INLA-SPDE) approach. Using a Matern field on meshes yields a sparse Gaussian Markov Random Field, where INLA provides fast and accurate posterior inference throughout sequential optimization. ISBO stably locates high-intensity regions and the peak of the latent intensity with minimal evaluations. A time-varying Upper Confidence Bound acquisition with masking avoids revisits, while penalized-complexity priors regularize early rounds. Experiments on synthetic and real-world spatio-temporal datasets show accurate peak discovery, intensity recovery, and substantial speedups over an RKHS-based baseline, positioning ISBO as a practical choice for BO with point-process data.
This work proposes two neural network architectures - Neural Bayes Estimation (NBE) and Neural Ratio Estimation (NRE) - to learn the parameters of Gaussian spatio-temporal Gneiting-Mat{\'e}rn models with advection, and adopts a sliding-window approach to achieve fully amortized inference.
Alexandre Loret, Lucia Clarotto, N. Desassis et al.· 0 citations
This paper shows three complete examples of how two-stage MCMC algorithms can be used to efficiently fit Bayesian spatio-temporal models to large datasets and compares the resulting posterior samples and computational efficiency with those obtained using a standard single-stage MCMC algorithm.
Mostafa Shams, Robert J. Erhardt, Staci A. Hepler· 0 citations
Statistical analysis of spatial point patterns often needs to deal with heterogeneous structures in intensity function estimation with possibly high‐dimensional covariate space. Likelihood based inference for spatial point process models needs to address the challenges in evaluating the multidimensional integral of...
Cox processes provide a principled Bayesian nonparametric framework for modeling event-based data through an underlying intensity function. However, existing inference methods for estimating the intensity typically rely on computationally expensive Markov chain Monte Carlo sampling or approximate inference techniques....
A divide-and-conquer neural Bayes estimation framework for spatial and spatiotemporal point process models that operates directly on raw point pattern realizations using transformer-based architectures on partitions of the spatiotemporal domain, together with an attention mechanism to optimally combine locally extracte...
Bokgyeong Kang, Andrew Zammit-Mangion, E. Schliep et al.· 0 citations
High-dimensional Bayesian optimization (BO) often fits Gaussian process (GP) surrogates from far fewer observations than input dimensions. Modern Vanilla BO can perform well in this regime with dimension-aware priors, initialization, and acquisition optimization, but it typically retains automatic relevance determinati...
Wei-Ting Tang, Madhav R. Muthyala, Joel A. Paulson· 0 citations
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.