Skip to content
Review

Defensive Writing in GPT Models

Oct 2026 · 0 citations · 34 references
Computer Science

TL;DR

This work asks GPT versions and models from other developers to rewrite paragraphs from papers written before ChatGPT, or to write from an evidence sheet that lists a paper's method and results, and tests two explanations: the model corrects the authors' overclaiming, or it writes for an anticipated reviewer.

Abstract

Researchers increasingly use ChatGPT to revise their papers, and when asked to make a paper hold up under review, recent GPT versions often narrow or even retract the authors'claims. We call such changes defensive writing when the given material does not support them, and we test two explanations: the model corrects the authors'overclaiming, or it writes for an anticipated reviewer. We ask GPT versions and models from other developers to rewrite paragraphs from papers written before ChatGPT, or to write from an evidence sheet that lists a paper's method and results. From GPT-5.5 on, GPT versions add clearly more ungrounded qualifications than the authors'originals contain, and GPT-6-astra adds the most and often retracts the authors'claims. Each explanation fits one part. Checked against the full papers, GPT-6-astra's retractions mostly correct overstated claims or explanations, but most added qualifications are redundant. The qualifications follow the request: they are absent under polishing, appear with any request to check the claims, and peak when the prompt names a reviewer's concerns. AI reviewers score such rewrites higher and score them lower once only the qualifications are removed, while human readers in a small study find them harder to read. Combining AI writing with AI review may reward qualifications that readers pay for.

View source

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.