Skip to content
Preprint

Nonnegative DAG Learning via Concomitant Estimation

Sep 2026 · 1 citation · 30 references
Engineering Mathematics

TL;DR

The Nonnegative and Concomitant (NoCo) DAG estimator is proposed, which jointly recovers the weighted graph structure and the exogenous noise variances in the linear structural equation model for the observations and develops a method of multipliers'algorithm that accommodates both homoscedastic and heteroscedastic noise profiles.

Abstract

We study the problem of learning directed acyclic graphs (DAGs) with nonnegative edge weights from observational data. We propose the Nonnegative and Concomitant (NoCo) DAG estimator, which jointly recovers the weighted graph structure and the exogenous noise variances in the linear structural equation model for the observations. Different from prior art, this noise-adaptive formulation blends a smoothed concomitant lasso criterion with a simpler log-determinant acyclicity constraint that exploits nonnegativity and yields a more benign optimization landscape. Specifically, nonnegative weights allow us to impose acyclicity directly on the adjacency matrix without elementwise squaring of its entries, thus avoiding the well-documented degeneracy of the Karush-Kuhn-Tucker conditions. Computationally, we develop a method of multipliers'algorithm that accommodates both homoscedastic and heteroscedastic noise profiles. Within each iteration, we use block successive convex approximation to minimize the augmented Lagrangian, alternating between proximal gradient steps for the adjacency matrix and closed-form updates for the noise scales. Simulated experiments demonstrate NoCo's improved structural and edge-weight recovery relative to competing methods in a variety of settings, highlighting the benefits of exploiting nonnegativity along with noise adaptivity.

View source

Similar papers

MARCEDES: Score-based causal discovery under non-Gaussianity with continuous optimization

A score-based DAG learning method, named MARCEDES, formulated as an unconstrained score minimization problem, which can be efficiently solved using gradient-based optimization techniques, thereby circumventing the challenges associated with constrained optimization.

Anamitra Chaudhuri, Anirban Bhattacharya, Yang Ni · 0 citations
#machine learning Preprint Oct 2026

DAG Structure Learning with Node-Varying Heavy-Tailed Disturbances

DAG structures can be learned from observations by incorporating acyclicity via smooth constraints, such as DAGMA's log-determinant function. Typically, observations and the underlying DAG are related through linear structural equation models, with Gaussianity assumption on the disturbances at each node. Extending DAG...

Robin Francis, Sundeep Prabhakar Chepuri · 0 citations
Review Oct 2026

DAG-CLIP: A DAG Learning Framework in the Presence of Latent Variables

Learning directed acyclic graphs (DAGs) to uncover causal mechanisms has attracted substantial attention in machine learning. While most existing methods focus exclusively on observed variables, many variables of substantive interest are latent constructs defined by statistical measurement models. Such constructs are p...

Si-Liang Zhang, Yun-Xiao Chen, I. Moustaki · 1 citation
#artificial intelligence Preprint Nov 2026

Structurally Separated DAG Learning with Multi-Scale Normalized Closure

Continuous DAG learning commonly enforces acyclicity through scalar functions of a weighted adjacency that aggregate evidence from weighted closed walks. We add a complementary layer: matrix-valued closure logits---explicit multi-hop structural relation scores for each ordered pair---supervised alongside data fit, spar...

Shuai Feng, Hao Yan · 0 citations

T-ARC: Topology-Aware Randomized Clustering via Distributionally Robust Stochastic Block Models

In this work, we introduce a new clustering method, namely T-ARC (Topology-Aware Randomized Clustering), that corrects the geometric bias of K-means by embedding topological information directly into the optimization objective. Building on the assumption that the data admits an underlying hidden structure modeled via a...

S. D. De Benedictis, A. Ang, N. Del Buono et al. · 0 citations
#machine learning Preprint Nov 2026

Clique Constraints for Exact Causal Structure Learning

Exact score-based causal structure learning supports explicit structural constraints and optimisation certificates, but its branch-and-cut search can be computationally demanding. We augment exact causal structure learning methods with an upper bound on the maximum clique size of the learned undirected skeleton, enforc...

Xiaoyu He, Pavel Rytíř, Petr Rysavý et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.