Skip to content
#small language model Open access

Claim Limits in AI Audit Records: Naming What a Record Cannot Prove

Sep 2026 · Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI

Abstract

The EU Artificial Intelligence Act requires high-risk AI systems to record events automatically, requires providers and deployers to keep those logs, and gives authorities access to them. The Act says what logs are for - traceability, monitoring, post-market surveillance - but it does not say what a log proves. That silence matters. A well-made audit record is good evidence of a small number of things: that an event was recorded, by which system or party, at what time, and that the record has not been altered since. It is not evidence that the decision was correct, that the inputs were true, that the model was unbiased, that a human reviewer exercised real judgement, or that the law was satisfied. Yet a record that is tidy, signed and complete-looking invites exactly those inferences. We call this the over-reading problem, and its institutional consequence the "auditable-but-wrong" moral hazard: an organisation that can produce an impeccable record of a bad decision is better placed to defend that decision than one that kept no record at all. This position paper argues that AI audit records should carry an explicit claim-limit declaration: a short statement, readable by people and processable by machines, of what the record attests and what it does not. We (i) read Article 12, Article 13, Article 14, Article 19 and Article 26 of the Act for what they ask of records; (ii) offer a vendor-neutral taxonomy that separates four things a record can attest (occurrence, integrity, origin, time) from eight things it cannot attest on its own (completeness, input veracity, output correctness, fairness, explanatory fidelity, quality of human oversight, legality, and generalisation); (iii) show that declared limits are an established practice in neighbouring fields - the auditor's opinion under the International Standards on Auditing, the rules of evidence on electronic records, the eIDAS presumptions, content-provenance and software-supply-chain specifications, and model cards and datasheets; and (iv) state normative requirements for the content, placement, language and stability of such a declaration, with two plain-language illustrations (a credit assessment record and a remote biometric identification record) and a worked application of the taxonomy to the published evaluation record of the author's own system. We also examine how the idea can fail: as boilerplate, as a liability shield, and through limit inflation. The paper is conceptual. It reports no empirical results, and its taxonomy has not been tested with auditors, courts or regulators.

View source

Similar papers

#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Open access Feb 2018

Lean Internal Startups for Software Product Innovation in Large Companies: Enablers and Inhibitors

This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.

Henry Edison, Nina M. Smørsgård, Xiaofeng Wang et al. · 78 citations · ⚡6

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.