Skip to content
Preprint

Who Wrote This? Turing, Total Variation, and the Mathematics of AI-Text Detection

Sep 2026 · 0 citations · 13 references
Mathematics

TL;DR

This article examines the limits of AI-text detection as an inference from a completed object to an unobserved history using Turing's imitation game and statistical decision theory.

Abstract

What can a finished text reveal about the process that produced it? Drawing on Turing's imitation game and statistical decision theory, this article examines the limits of AI-text detection as an inference from a completed object to an unobserved history. For two known source distributions with equal prior probabilities, a standard identity gives the minimum average classification error as half their probability overlap. This overlap is one minus their total variation distance. Perfect detection therefore requires nonoverlapping distributions; useful discrimination does not. In practice, the problem is harder: human and machine writing form changing families of distributions, posterior probabilities depend on base rates, and ``AI-written''becomes ambiguous when people and software contribute to the same text. Turing's interrogator can ask another question; a detector restricted to finished prose cannot. Distinguishability, source attribution, authentication, and compliance are different inferential tasks. The paper's own documented human-AI provenance shows what a production history can reveal that a binary label cannot.

View source

Similar papers

Review Open access Sep 2026

New Asymmetries

This article argues that “AI use” is too blunt a category for judging what happens when a student writes a humanities paper with a large language model. Taking the most intensive case, a paper built with AI from research to final review, it follows the changing relation between student, model, sources, and draft. In re...

Joshua Leonardo Lupowitz · 0 citations
#artificial intelligence Preprint Sep 2026

Does AI Assistance Leave a Temporal Fingerprint? Detecting Overreliance in AI-Assisted Writing and Programming

This work analyzes three public corpora: CoAuthor (1,447 keystroke-level co-writing sessions), RealHumanEval (editor telemetry from 243 programmer records), and a pre-LLM CS1 corpus as a human-only baseline, comparing minimal-AI work, collaborative AI use, and simulated wholesale delegation.

Eduardo Davalos, Yi-Ke Zhang · 0 citations
Preprint Aug 2026

Tacet: A Language and Type System for Automatic Statistical Validity Accounting

Tacet is introduced, a language in which an analysis declares what it generated, states what it expects to find, and is refused any claim it cannot afford or cannot properly test, and is proved the metatheory machine-checked in Lean 4 with no admitted gaps.

Chiké Abuah · 0 citations
#machine learning Preprint Sep 2026

Detectable Only Where It Is Confounded: What Verified Duplication Counts Say About Membership Evidence in Language Models

When a language model finds a sentence unusually cheap to predict, it is tempting to conclude that the sentence was in its training data. Almost every published test of that inference has had to guess which sentences were in the training data, the members, and which were not. This paper removes the guessing. Two model...

Arman Nik Khah · 0 citations
Open access Sep 2026

Misinformation without liars: How invisible data-processing choices manufacture false conclusions in automated text analysis

Official statistics increasingly draws on non-traditional sources, such as social-media posts and other web-scraped text, analysed with AI language models for nowcasting, indicator production, and crisis monitoring. We show that such pipelines can manufacture false statistics with no misinformation actor involved: ordi...

N. Komendantova, Petr Pesov · 0 citations
#generative ai Review Open access Sep 2026

The pitfalls of AI detection in academic writing: bias, false positives, and the need for inclusive assessment

The paper distinguishes genuine false positives from definitional boundary cases involving AI-assisted translation and polishing, engages the counter-argument that AI-polished prose may itself flatten linguistic diversity in academic English, and proposes a concrete process-oriented assessment model based on declared s...

Victor Angelier · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.