Skip to content
#data science Open access

Thirty agent-assisted replications, published as nanopublications: the honest debrief

Sep 2026 · Zenodo (CERN European Organization for Nuclear Research) · 2 references
Scientific Computing and Data Management

Abstract

Slides of the talk given at the FORRT AI in Metascience Online Conference (session T1, Reproducing the record), 29 September 2026. Reproducible is not robust: rerunning the authors' code on their data returns their answer. We replicate the specific claim we rely on, with independent data and software, using AI agents constrained by guardrails: a FORRT replication template, MCP tools (replication-radar, forrt-research-mcp), FAIR vocabularies and research-software standards. Every step, from the verbatim quote to the verdict and the typed citation, is published as a signed nanopublication and can be searched on the Science Live platform. Worked example: Oliver et al. 2018, marine heatwaves (validated for the satellite era). Scale: 47 claims from 19 papers. Limits: computational work only. The last slides list every link used in the talk.

View source

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Trajectory Balance: Improved Credit Assignment in GFlowNets

It is proved that any global minimizer of the trajectory balance objective can define a policy that samples exactly from the target distribution, and empirically demonstrate the benefits of the trajectories balance objective for GFlowNet convergence, diversity of generated samples, and robustness to long action sequenc...

Esmeralda S. Whitammer, Moksh Jain, Emmanuel Bengio et al. · 302 citations · ⚡60

Related blog posts

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.