Skip to content
Preprint

Bayesian DAG Structure Learning with Simultaneous Shrinkage Covariance Estimation under Scale-Mixture Error Distributions in the Proportional High-Dimensional Regime

Jul 2026 · 0 citations · 63 references
Mathematics

Abstract

We propose a unified Bayesian framework namely robust DAG-Cholesky horseshoe (R-DACH) for joint directed acyclic graph (DAG) structure learning and precision matrix estimation in the high-dimensional proportional asymptotic regime $p/n \to c \in (0,\infty)$, under the scale mixture of normal errors. The construction places a global-local horseshoe-type prior directly on the strictly lower-triangular entries of the modified Cholesky factor of the DAG-Markov precision matrix, so that sparsity in the Cholesky parameters induces a coherent parent-set selection consistent with a topological ordering of the variables. A per-observation inverse-gamma scale mixture yields automatic robustness to heavy-tailed and contaminated observations and admits Student-$t$, Laplace, and slash distributions as special cases. We design a partially-collapsed blocked Gibbs sampler that traverses the joint space of orderings, sparsity patterns and continuous parameters. Simulations across $(n,p)$ configurations with $p$ up to several hundreds confirm the theoretical rates and demonstrate substantial gains over graphical-horseshoe, DAG-Wishart, and PC-based competitors under contamination. An application to RNA-seq gene-expression data from \emph{The Cancer Genome Atlas} reveals biologically interpretable regulatory structure that competing methods fail to recover.

View source

Similar papers

#machine learning Preprint Aug 2026

Causal Discovery in Equal Variance Linear Gaussian DAGs via SURE-Tuned Ridge Regression

This work proposes SURE-Ridge, a non-iterative, closed-form estimator for equal variance linear Gaussian SEM, which achieves the lowest structural Hamming distance in the small-sample regime and the lowest run time across all sample sizes tested, compared with NOTEARS, DAGMA, and GBNSL baselines.

Sambit Mishra, Urbashi Mitra · 2 citations
Preprint Jul 2026

Scalable Bayesian structure learning of directed acyclic graphs via Laplace approximation, with an application to breast cancer gene expression networks

A Laplace-approximated Bayesian scoring function for the non-conjugate Normal--Gamma prior is developed and, through the DAG-probit extension, predicts malignancy from nuclear morphometry with a cross-validated ROC-AUC of $0.94$ using a sparse, interpretable set of direct predictors.

Samaneh Nazari, Mohammad Arashi, Abdolnasser Sadeghkhani · 0 citations
Preprint Jul 2026

Exact computation of posterior distribution of mixture weights in hierarchical Bayesian models

The exact marginalization of the mixture weight is studied, and it is shown that the exact posterior of the weight is a finite mixture of Beta distributions, delivering closed-form posterior summaries, credible intervals and per-observation local false-discovery rates without any sampling.

G. Meshcheryakov · 0 citations
Preprint Jul 2026

Bayesian Graphical Models under Positivity Constraints: A Scalable generalized likelihood Approach

A novel data augmentation scheme that induces conditional independence among precision matrix entries, enabling joint updates is introduced and a fast matrix-normal sampler is developed that significantly reduces per-iteration complexity in high-dimensional settings.

Swarnali Raha, Partha Sarkar, Sirani M. Perera et al. · 0 citations
Preprint Aug 2026

Log-regularly varying scale mixture of asymmetric Laplaces for robust Bayesian quantile regression

Bayesian quantile regression based on the asymmetric Laplace (AL) distribution can be sensitive to extreme observations because of its exponentially decaying tails. We propose a robust error distribution constructed as a finite mixture of the AL distribution and a log-Pareto scale mixture of asymmetric Laplace distribu...

Dongu Han, Genya Kobayashi, Shonosuke Sugasawa · 0 citations
Preprint Jul 2026

Structure Learning on Clustered Data

A new approach is introduced that estimates a global structure while accounting for local cluster-level effects, and presents a differentiable graph coupling mechanism that guarantees the union of the fixed- and random-effects graphs remains acyclic.

Ryan Thompson, Matt P. Wand, V. Baladandayuthapani · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.