This work establishes a new paradigm for generated image detection by recasting the detection task as a problem of machine unlearning, and introduces two detection methods: data-free detection, which prunes model parameters to induce unlearning without data access, and data-driven detection, which optimizes LVMs to unlearn knowledge tied to generated images.
Abstract
Robust detection of generated images is critical to counter the misuse of generative models. Existing methods primarily depend on learning from human-annotated training datasets, limiting their generalization to unseen distributions. In contrast, large-scale vision models (LVMs) pre-trained on web-scale datasets exhibit exceptional generalization power through exposure to diverse distributions, offering a transformative paradigm for this task. However, our experimental results reveal that LVMs pre-trained on natural-image-dominated data can effectively capture the features of both natural and generated images, yielding comparably low losses and thus limited discriminative capacity between them. This prompts a key question: When and how do LVMs exhibit different behaviors when capturing features of natural and generated images? This investigation reveals an insight: during unlearning, LVMs exhibit disparate forgetting dynamics with feature degradation for generated images escalating faster than natural ones. Inspired by the disparate dynamics, we introduce two detection methods: 1) data-free detection, which prunes model parameters to induce unlearning without data access, and 2) data-driven detection, which optimizes LVMs to unlearn knowledge tied to generated images. Extensive experiments conducted on various benchmarks demonstrate that our unlearning-based approach outperforms conventional detection methods. By recasting the detection task as a problem of machine unlearning, our work establishes a new paradigm for generated image detection.
This work proposes RNSIDNet, a novel forensic framework that achieves robust detection through enhanced RGB-Noise representation learning, and designs a Hard Sample-aware Contrastive Learning (HSCL) strategy.
Zhen Li, Gang Cao, Tianyi Zhang et al.· 0 citations
This work formats the AI-generated image detection task as a Visual Question Answering problem, leveraging a fine-tuned vision-language framework to fully exploit the complementary information between visual and textual modalities, and proposes a novel high-resolution AI-generated image detector, termed LHSDet.
Qian Yao, Jun-Jie Huang, Yong-Jun Wang et al.· 0 citations
This work proposes GenRes, a novel framework for generative residual learning via a neural tensor network, which models fine-grained relational features between original and transformed samples to enhance generalization in scenarios involving multiple generative transformations.
PPM-CLIP is proposed, a new framework that shifts from static classification to conditional generative modeling based on the CLIP vision-language model, and a Probabilistic Prompt Modeling module is used as a generator that produces an adaptive distribution of prompts according to the input image.
Xinyu Wang, Yingxin Lai, Zhiming Luo et al.· 0 citations
GenSyn10 is introduced, a CIFAR-10-aligned synthetic image dataset of 60,000 images generated using three architecturally diverse state-of-the-art models, enabling controlled and systematic evaluation of out-of-distribution (OOD) generalization to novel generators.
Md Faraz Kabir Khan, Saeed Anwar, G. Hassan· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.