Skip to content

CogniGraph: Governed Graph-of-Agents Reasoning over Knowledge Graph Topologies with Semantic SHACL Validation and Constrained F1 Evaluation

Sep 2026 · Zenodo (CERN European Organization for Nuclear Research)
Advanced Graph Neural Networks

Abstract

Abstract. Multi-agent large language model (LLM) systems are increasingly deployed for regulatoryand high-stakes reasoning, yet none of the prevailing flat-topology frameworks—AutoGen, CrewAI,LangGraph—enforce semantic governance over what each agent may say, in whose name, and withinwhich scope. The result is what we term ungoverned creativity at scale: plausible-sounding answers thatmix regulatorovisions, misattribute framework requirements, or drift beyond an agent’s intendedboundary. We ask: can a knowledge graph itself act as the coordination substrate of a multi-agentreasoning system, and can semantic validation gates supply the governance guarantees that the EU AIAct mandates?We present CogniGraph, a Graph-of-Agents framework in which each activated node of a domainknowledge graph hosts an autonomous LLM agent, communication follows the graph’s typed edgetopology via convergent message passing, and a SemanticSHACLGate enforces three-layer semanticvalidation—framework fidelity, scope boundary, and cross-reference integrity—on every agent output.A Prize-Collecting Steiner Tree (PCST) sub-graph activation step bounds per-query reasoning cost atO(|V∗|·R) independently of |V |; a zero-inference-cost MasterObserver provides complete provenancetraces; and the system is evaluated using a new joint quality–governance metric, Constrained F1.On MultiGov-30, a 30-question multi-regulation EU governance benchmark spanning the AI Act,GDPR, DORA, and NIS2, CogniGraph (Semantic-SHACL) achieves Constrained F1 of 0.756against 0.328 for an ungoverned single-agent Claude Sonnet 4.6 baseline (+130%), with governanceaccuracy of 99.4% (framework fidelity 100%, scope adherence 100%, cross-reference integrity 98.3%).The transition from format-based to semantic SHACL validation independently lifted token F1 by 18%(0.437 → 0.517) by eliminating 49% false-rejection of correct answers. CogniGraph is distributedas the open-source GraQle SDK (pip install graqle, CLI graq); the MultiGov-30 benchmark,the SemanticSHACLGate specification, and the full reference implementation are released underApache 2.0 to enable independent replication.1Version 3.3 (corrected). This version supersedes v3.2 (27 May 2026). A provenance audit traced every number in v3.2 to a dataset file, a run log and a results file. The MultiGov-30 headline comparison, per-tier, cost, latency and gate-layer figures are measured (one run, 11 March 2026) and are now printed exactly as recorded: Constrained F1 0.757 vs 0.328 (+131%), governance accuracy 0.997. The following items in v3.2 had no underlying computation or data and are withdrawn: Cohen's kappa 0.82 and the implied second annotation; all bootstrap confidence intervals, Wilcoxon p-values and Cohen's d; "mean over 3 seeds" and seed 42; per-query token counts; the contraction constant 0.45; the description of ablation rows A3/A6 as re-runs (no ablation has been run); and several smaller details. The Format-SHACL comparison is marked as not reproduced. Availability statements are corrected: the benchmark JSON and reproduction script named in v3.2 do not exist; the question set, knowledge-graph builder and harness are public in the GraQle SDK repository; the gate implementation used in the run is not public, so the governed result cannot currently be replicated by third parties. The paper now states plainly that the baseline's governance accuracy is zero by definition and that governance accuracy is self-scored by the system's own rule-based gate. The unsupported statistics were introduced during AI-assisted drafting and were not caught before posting; the author is responsible. No new results are introduced.

View source

Similar papers

#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Conference Open access Dec 2013

Affordable and Energy-Efficient Cloud Computing Clusters: The Bolzano Raspberry Pi Cloud Cluster Experiment

The ongoing work building a Raspberry Pi cluster consisting of 300 nodes is presented, with potential use cases being an inexpensive and green test bed for cloud computing research and a robust and mobile data center for operating in adverse environments.

P. Abrahamsson, S. Helmer, Nattakarn Phaphoom et al. · 110 citations · ⚡7

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.