Skip to content

A Benchmark & Dataset for Detecting AI-Manipulated Visual Evidence in the Court System

Sep 2026 · Proceedings of the 35th ACM International Conference on Information and Knowledge Management · pp. 8962-8966 · 0 citations · 23 references
Computer Science

TL;DR

The CIFAR Synthetic Evidence Corpus for Detecting AI-Manipulated Images is introduced, a benchmark for evidentiary image authentication in court and justice-system contexts and establishes state-of-the-art baselines with publicly available image-manipulation detectors, showing that current systems exhibit error profiles that remain problematic for evidentiary use.

Abstract

Photographic evidence is becoming increasingly vulnerable to forms of alteration and fabrication that existing legal and technical workflows are not well equipped to evaluate. Surveillance frames, dashcam stills, and phone photographs may be used to establish presence, sequence, causation, damage, or identity, yet contemporary generative systems allow non-experts to alter or fabricate such images through ordinary prompt-based interfaces. Existing image-forensics benchmarks provide important resources for face manipulation, classical tampering, and general synthetic-image detection, but they are not organized around the forms of visual evidence submitted in courts, the localized edits that can change what an exhibit appears to prove, or the consumer-tool threat model now facing the justice system. We introduce the CIFAR Synthetic Evidence Corpus for Detecting AI-Manipulated Images, a benchmark for evidentiary image authentication in court and justice-system contexts. The corpus contains 1,505 photographic items, including 720 authentic controls and 785 manipulated or fabricated images, spanning surveillance, dashcam, and consumer-photo imagery. Manipulations are organized into scene-condition edits, localized element edits, and full fabrications produced with contemporary generative systems. Each item is released with structured metadata covering source provenance, manipulation tier, subtype, generator, prompt template, and scene attributes, enabling controlled evaluation beyond aggregate binary detection. We also establish state-of-the-art baselines with publicly available image-manipulation detectors, showing that current systems exhibit error profiles that remain problematic for evidentiary use. The dataset, prompts, metadata manifest, code, and baseline evaluation scripts are released to support research on visual evidence authentication, information integrity, and trustworthy AI for the justice system.

Read PDF

Similar papers

Open access Nov 2026

AI-Based Image Forgery Detection System Using EfficientNet-B0 and Grad-CAM Explanations with a Web-Based Interface

The design and prototype implementation of an AI-based image forgery detection system that labels an uploaded picture as genuine or forged, reports a confidence value, and shows a Grad-CAM heat map of the regions that most influenced the decision is presented.

J. Bhoomika, Y. Yashaswini, L. L. Lakheesh et al. · 0 citations
Open access Sep 2026

Beyond Clean Benchmarks: A Reproducible Severity-Sweep Evaluation of AI-Generated Image Detector Robustness

A concise, replicable evaluation of the two public detectors that function using differing architectures, which indicated that UnivFD was more accurate than CNNSpot in detection of original images and that no transformation crossed the threshold for practical significance set at ten.

Aaranya Singh, Prakash Chand Jain, Ayushka Singh · 0 citations
Book Open access Nov 2026

GenText-Forensics: Challenge on Explainable Forensics and Adversarial Generation for Text-Centric Images

RealText-V2 is developed and the GenText-Forensics Challenge at ACM Multimedia 2026 is launched to advance reasoning-based text-centric image forensics, and analysis shows that leading systems consistently adopt modular expert pipelines, localization remains the primary performance driver, and evidence conditioning is...

Fan-Wei Zeng, Jian-Shu Li, Chang-Tao Miao et al. · 1 citation
#natural language process... Preprint Nov 2026

CuRSE-Bench: A Benchmark for Probing Cultural Blind Spots in Text-to-Image Safety Evaluation

Text-to-image (T2I) safety evaluation typically assigns each prompt or image a single culture-blind harm label, so content that is harmful only within a particular culture can pass as benign. We introduce CultureCraft, an agentic framework that constructs T2I prompts that appear benign under a general-purpose rubric ye...

Minsuk Jang, Minseok Son, KiHyun Seol et al. · 0 citations
Open access Oct 2026

AI-Generated Image Detection Using a Multi-Model Ensemble and Forensic Analysis

The rapid growth of generative AI has made it increasingly difficult to tell AI-generated images from real photographs, and a single detection model often fails on images from generators it was not trained on. This paper presents the AI Image Authenticator, a web-based system that combines a six-model neural ensemble w...

R. Vijayalakshmi, L. K, M. D et al. · 0 citations
Open access Oct 2026

Detecting AI-Generated Images via Fine-Tuned SigLIP 2: A Sigmoid-Contrastive Vision-Language Encoder for Binary Authenticity Classification

The accelerating sophistication of generative artificial intelligence has produced widespread availability of photorealistic synthetic imagery, creating serious challenges for digital media integrity, forensic evidence reliability, and public trust in visual information. In response, developing robust yet computational...

Kanwerjit Null, Gaurav Deep, Sumandeep Kaur · 0 citations

Related blog posts

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.