This work considers the task of conditional causal discovery as a Bayesian inference problem, in which the posterior is targeted over causal graphs and parameters conditional on an event such as a causal-effect constraint, and adapts rare-event estimation techniques to perform inference the joint graph-parameter space.
Abstract
Causal discovery aims to uncover the underlying causal relationships given data generated from a system. The goal, however, is not merely to predict causal edges given data, but also to be able to interpret and explain either observed or hypothesized phenomena, such as a particularly large causal effect. We consider this task of conditional causal discovery and cast it as a Bayesian inference problem, in which we target the posterior over causal graphs and parameters conditional on an event such as a causal-effect constraint. Unfortunately, this poses a computational challenge: existing approaches to Bayesian causal discovery struggle when the event has small posterior mass. To address this, we adapt rare-event estimation techniques to perform inference the joint graph-parameter space. Our method gradually drives a particle population toward the constrained region while maintaining samples that approximate the conditional posterior. Empirical evaluation on synthetic graphs validates the accuracy of our approach at small and large scales, and we show in a case study on the Sachs protein dataset how our method can be used to aid scientific exploration by providing pathway-level summaries.
SVI-DAG is proposed, a structured variational inference approach to Bayesian causal discovery using observational data and prior beliefs that uses normalizing flows to model dependencies between edges, supporting expressive and multimodal posterior learning over DAGs.
The Causal Discovery Foundation Model (CDFM) is formulated as a unified, general-purpose framework for zero-shot structural inference, and a principled variational framework that treats unknown causal mechanisms as latent variables and mathematically decomposes the intractable marginal likelihood into distinct, tractab...
Jie Qiao, Ruichu Cai, Zijian Li et al.· arXiv.org· 2 citations
LoCaLS is proposed, a local causal structure learning algorithm that is sound and complete under standard assumptions and identifies the same direct causes and effects of a target variable as those identifiable by global causal discovery methods, while allowing for latent variables and selection bias.
Zheng Li, Hao Zhang, Ruxin Wang et al.· arXiv.org· 1 citation
A novel approach based on variational inference to simultaneously infer both the latent clusters and causal structures is presented and an approximate posterior over clusters and graph-structure is learned by considering variational distributions based on categorical and Bernoulli models.
Avni Rajpal, Anubhav Kumar, Rishabh Karnad et al.· 1 citation
Causal Discovery (CD) from observational data faces two fundamental challenges. First, purely statistical methods often lack the power to resolve structural ambiguities in low-sample regimes. Second, although LLM-assisted hybrid approaches improve structure recovery through semantic reasoning, the influence of that rea...
A. Thorat, Ravi Kolla, Vishak K Bhat et al.· 0 citations
DAG-FM is proposed, a novel foundation model architecture that amortizes causal discovery and introduces Mixture-of-Leaf-Experts (MoLE) to handle diverse and unknown Functional Causal Model (FCM) assumptions in real-world scenarios.