Skip to content

TOWARDS FAULT PROPAGATION MODELING IN THE WLCG USING GRAPH NEURAL NETWORKS

Sep 2026 · Zenodo (CERN European Organization for Nuclear Research)

Abstract

Reliable data movement is essential to the Worldwide LHC Computing Grid. This project asks whether FTS queues that share a storage endpoint contain useful information about one another’s future state. I process 52,037,899 raw queue records from January 2026 into 23,820,642 sparse queue states sampled every 2 minutes. At each prediction time, observed storage endpoints form graph nodes and directed FTS queues form temporal edges. A convolutional neural network (CNN) followed by a long short-term memory (LSTM) network first encodes the previous 20 minutes of every queue independently. One simple message-passing layer then averages incident edge embeddings at each endpoint and returns the source and destination context to the target edge. The resulting graph neural network (GNN), a parameter-matched multilayer perceptron (MLP), and a degree-preserving random graph are compared to isolate the effect of real WLCG endpoint assignment. On the final test period, real topology did not give a convincing advantage for throughput regression: random topology performed at least as well, and persistence retained the lowest mean absolute error. In contrast, the real GNN reached 0.5704 ± 0.0049 average precision for 20-minute bad-link onset, compared with 0.5212 ± 0.0031 for random topology. As a sanity check, the GNN was also compared with two simple rules based on the current bad states at the two endpoints. The stronger rule reached only 0.2627 AP. The graph advantage remained in direct and autoregressive bad-state forecasts up to 60 minutes. Matched seven-input regressions gave a target-dependent result: real topology improved success-rate MSE, while throughput showed no clear graph advantage when the inputs and selected queue windows were kept the same. This makes an explanation based only on classification being easier less likely. The results suggest that endpoint context is useful for degradation-related FTS controller quantities, but not clearly for workload-driven throughput. This is a first step towards fault-propagation modelling. The current model predicts only queues observed at the forecast origin; it does not predict future queue appearance or disappearance.

View source

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Related blog posts

Microsoft Research Blog Jul 13, 2026

Verifying Rust cryptography in SymCrypt, from standards to code

Cryptographic code supports vital protections in modern computing systems. Learn how a new method helps verify code as developers write it while preserving speed and adaptability as it gets implemented and evolves. The post Verifying Rust cryptography in SymCrypt, from standards to code appeared first on Microsoft Research.

GPT-Lab Sep 17, 2026

Beyond Prompt Engineering: The Role of Tacit Knowledge in Software Engineering

AI is making software generation faster, but speed does not remove the need for expertise. As more work is delegated to AI, tacit knowledge may become one of the most important human advantages in software engineering. The post Beyond Prompt Engineering: The Role of Tacit Knowledge in Software Engineering appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.