Skip to content

Finite-Time Node Separation in Recurrent Graph Neural Networks with Persistent Gaussian Perturbations

Sep 2026 · 0 citations · 38 references
Computer Science

TL;DR

This paper proves almost-sure pairwise noncollision, derive a uniform finite-horizon guarantee, and establish permutation equivariance in distribution for the stochastic dynamics and permutation-invariant graph outputs.

Abstract

Persistent Gaussian perturbations have been shown to prevent asymptotic oversmoothing in recurrent Graph Neural Networks (GNNs) by ensuring a positive stationary Dirichlet energy. However, this global energy bound does not guarantee that individual node representations remain distinct at finite depths. In this paper, we provide a complementary finite-time analysis of the same persistent-noise architecture. Let \(d\) denote the representation dimension and \(\sigma\) the noise standard deviation. We first prove an exact second-moment decomposition for the expected squared distance between any two node representations, yielding the universal lower bound \(2\sigma^2 d\) at every positive time step without contraction or stationarity assumptions. More precisely, conditional pairwise distances have a noncentral chi-square characterization: the noncentrality parameter is the deterministic message-passing separation normalized by \(2\sigma^2\). This yields dynamics-aware fixed-time and finite-horizon near-collision bounds that retain information discarded by the central worst-case analysis. The earlier central Gaussian bound is recovered as the worst-case zero-separation case. We additionally prove almost-sure pairwise noncollision, derive a uniform finite-horizon guarantee, and establish permutation equivariance in distribution for the stochastic dynamics and permutation-invariant graph outputs. Our results complement the asymptotic energy analysis of prior work and provide rigorous finite-time guarantees on node-level representation separation.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Multi-Attractor GNNs: Set-Valued Expressivity Beyond Unique Equilibria

It is shown that multiple equilibria enable one weight-tied message-passing GNN to represent set-valued equivariant maps: different initializations approach different valid solutions and converge almost surely to valid solutions and reach every solution branch with positive probability.

Jia-Lin Liu · 0 citations
Preprint Aug 2026

Stochastic Gradient Tracking over Time-Varying Networks: One-Step Lyapunov Analysis

A time-varying quadratic norm is constructed that turns this window contraction into an exact one-step Lyapunov identity, leading to coupled one-step recursions for the centroid and disagreement errors, without unrolling the dynamics over communication windows.

Sulaiman A. Alghunaim · 0 citations
#artificial intelligence Preprint Sep 2026

Critical initialization destabilizes higher input derivatives in wide scalar-input networks

The edge-of-chaos condition preserves first-order input perturbations in wide randomly initialized networks, but physics-informed losses, score matching and derivative regularization depend on higher input derivatives. For smooth scalar-input fully connected networks, using a joint Gaussianity of the finite derivative...

Prashant Singh, Pranav Singh · 0 citations
#artificial intelligence Preprint Sep 2026

A Unified Uncertainty Representation for Graph Neural Networks via Doubly-Spectral Stochastic Expansion

A capacity theorem shows that, under a full-rank feature assumption, a restricted subfamily matches the chaos coefficients of any Gaussian-latent random graph signal, with exponentially decaying truncation error under a growth condition; the task-level claims are established empirically.

Fred Xu, Thomas Markovich, Florence Regol et al. · 0 citations
#graph neural networks Review Sep 2026

Shaping Graph Neural Networks with Dynamical Systems

This work presents a unified dynamical-systems perspective for shaping approaches that explicitly control and regulate the degree of propagation, conservation, and dissipation of information throughout the neural flow, and highlights how neural differential equations provide a coherent theoretical framework for designi...

Alessio Gravina · 0 citations
#machine learning Preprint Sep 2026

Correlated initialization of deep residual networks

We study the large-depth behavior of residual networks whose weights are correlated across layers at initialization. Our results confirm and extend a conjecture of Marion et al. [2025], according to which correlated initializations should interpolate continuously between the Brownian stochastic differential equation ar...

Felix Benning, I. Nourdin, G. Peccati · 1 citation

Related blog posts

MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.