A family of premetrics that capture different degrees of structural similarity between graphs are introduced and relate these similarities to generalization, and consequently, the performance of expressive GNNs are related.
Abstract
Graph Neural Networks (GNNs) are powerful tools for learning on structured data, yet the relationship between their expressivity and predictive performance remains unclear. We introduce a family of premetrics that capture different degrees of structural similarity between graphs and relate these similarities to generalization, and consequently, the performance of expressive GNNs. By considering a setting where graph labels are correlated with structural features, we derive generalization bounds that depend on the distance between training and test graphs, model complexity, and training set size. These bounds reveal that more expressive GNNs may generalize worse unless their increased complexity is balanced by a sufficiently large training set or reduced distance between training and test graphs. Our findings relate expressivity and generalization, offering theoretical insights supported by empirical results.
HARMONIA achieves stronger explanation recovery than existing interpretable graph baselines while maintaining competitive predictive performance and scaling to graphs with millions of nodes, and shows that interpretable graph learning can remain both faithful and scalable without sacrificing predictive effectiveness.
This work proposes Transferable Graph Metanetworks, which extends the graph metanetwork paradigm with a set of modifications that make performance transferable across input networks of different widths, and proves size-generalization guarantees for the model on $\mu$P-trained inputs.
Yu-Xin Ma, A. Dayan, Yam Eitan et al.· 0 citations
Achieving strong performance with graph neural networks (GNNs) typically requires training and hyperparameter tuning for each dataset, incurring repeated costs and effort. Graph in-context learning (ICL) avoids this by using a single pretrained model to predict unknown node labels directly from labeled context nodes. E...
Dooho Lee, Jin-Mo Lee, Minho Jeong et al.· 0 citations
In (high)-dimensional data, deep learning-based Knowledge Graph Embedding (KGE) models have shown better capacity in learning the true pattern of latent features. However, they are typically used as "black boxes", where statistical correlation is preferred over explicit logical inference. These are geometrically feasib...
Ahmed H. Mohammed· Dijlah Journal of Engineerin...· 0 citations
Graph Neural Additive Networks (GNANs) have emerged as effective, interpretable-by-design architectures for graph learning. They achieve transparency by combining per-feature shape functions with simple distance-based reweighting. However, GNANs have three limitations. First, node-wise relevance scores aggregate inform...
C. Álvarez-Rodríguez, Steve Azzolin, Vincenzo Marco De Luca et al.· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 28, 2026
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
MIT News · Artificial Intelligence· news.mit.eduOct 27, 2026
Prabha Jha used her experience with MIT Open Learning’s program for senior executives to develop AI solutions for her employer, Verizon, and to write a book.
Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.