A risk-aware framework that composes risk at three levels, each generalizing an ingredient of classical $I- and $G-optimal design: a deviation measure of the posterior predictive uncertainty, a risk measure across the prediction domain, and a risk measure over datasets.
Abstract
Traditional Bayesian optimal experimental design (OED) selects measurements that best inform a model's parameters. However, such measurements can be suboptimal for downstream predictions. Goal-oriented OED targets the prediction directly. However, the existing goal-oriented criteria value all reductions in predictive uncertainty equally, with no way to prioritize rare, high-consequence outcomes. In this article, we develop a risk-aware framework that composes risk at three levels, each generalizing an ingredient of classical $I$- and $G$-optimal design: a deviation measure of the posterior predictive uncertainty (generalizing the predictive variance), a risk measure across the prediction domain (interpolating $I$-optimal averaging and $G$-optimal worst-case selection), and a risk measure over datasets (generalizing the expectation). We generate each level from a regret function in the risk quadrangle, so that one triple specifies a practitioner's risk preference. We relax the design to continuous weights on the unit simplex and construct a nested-quadrature estimator that is differentiable in the design variable. This enables solving the optimal design problem with gradient-based methods, avoiding a combinatorial search over candidate designs. For a linear-Gaussian lognormal model and a nonlinear extension, we derive closed-form objectives. These give exact references against which we verify that the estimator converges. We demonstrate this framework for finding optimal sensor placements in an inverse problem governed by an advection-diffusion equation. We find that the risk-aware designs substantially outperform the expected-information-gain baseline, which is statistically indistinguishable from a random allocation.
The new modeling paradigm subsumes several classical SOC/MDP formulations, including risk-averse and distributionally robust SOC/MDPs as well as partially observed and Bayes-adaptive MDPs, and generates so-called preference robust SOC/MDP models.
Goal-oriented optimal experimental design (GO-OED) selects experiments according to the expected information gain (EIG) about a quantity of interest (QoI) rather than the full parameter vector. This work develops a variational GO-OED formulation for mixed discrete-continuous QoI laws arising in probabilistic mechanics...
This work characterize the optimal policy under known distributions, and shows that it reduces to a prediction set-based solution for the CVaR, which provides an operational interpretation of conformal prediction-type prediction sets.
Bayesian contextual optimization (BCO) is proposed, a framework that maintains a Gibbs posterior over the parameter space that weights candidate models by their empirical decision quality rather than statistical fit, thereby avoiding commitment to a potentially misspecified likelihood while encoding the full distributi...
Zhuo-Jun Xie, Adam F. Abdin, Yi-Ping Fang· 0 citations
Expected improvement based on stochastic kriging (SK) surrogate is widely used in continuous simulation optimization, but unknown heteroscedastic noise makes three basic design choices consequential: the incumbent to define improvement, replication allocation, and final recommendation. Existing methods typically either...
Song-Hao Wang, Jiang-Lin Xia, Hao-Wei Wang et al.· 0 citations
Actual, realistic domains are characterised by inherent uncertainty, compelling the development of planning strategies that enable the embracing of risks, where performing actions incurs costs, such as fuel and time, that cannot be predefined as constants during planning. In such domains, an agent’s perspective of desi...