Skip to content

Training-Free Human-in-the-Loop Anomaly Detection via Memory Bank Correction

Aug 2026 · 0 citations · 41 references
Computer Science

Abstract

Anomaly detectors are hardest to deploy exactly where training data is scarcest: a newly commissioned production line has a handful of verified"golden"samples and no machine-learning engineer on the factory floor. We present a training-free human-in-the-loop framework in which a domain expert corrects a PatchCore detector by direct memory bank editing: no retraining, no gradients, no original training data. A false-positive correction inserts the reviewed image's normal patches through a self-calibrating novelty gate admitting only those beyond the median pool-normal nearest-neighbour distance. From a bank built on only ten golden samples, operator corrections close a median 66% of the gap to an uncorrected fully trained bank (mean 80%, raised by three categories that overshoot parity), significantly improving 12 of 15 MVTec AD categories and harming none: ten samples plus corrections outperform hundreds of samples without them. On already-trained banks the headroom is smaller and concentrated where the bank undersamples normal appearance (gated: toothbrush +0.10, metal nut +0.09, zipper +0.05, screw +0.05), and no category except grid is significantly harmed. Evaluation uses a held-out protocol (20 splits per category, Holm-corrected Wilcoxon), because corrected images entering the bank inflate naive evaluation toward AUROC 1.0 by memorisation. Passive and active querying are statistically indistinguishable; a matched-label-budget control attributes gains to deployment-time label production at 43% of exhaustive-review cost; a defect-memory extension fails decisively. Feedback is simulated from ground truth; live expert trials, where mislabelling is costliest on small banks, remain future work.

View source

Similar papers

Open access 2026

When Calibrated Detectors Meet New Attacks: Per-Category Reliability of Machine-Learning Intrusion Detection Under Distribution Shift

A decision-curve analysis and expected-cost comparison show that an uncalibrated score used at its nominal cost threshold is very costly, and that both recalibration and a target-tuned threshold reduce operating cost, with recalibration additionally improving the multiclass probabilities.

Khalid Alalawi · 0 citations
Preprint Aug 2026

What Memory Composition Does Not Tell Us About Anomaly Detection

This work uses CLEANCON, an out-of-bag cross-image support gate that changes candidate-image eligibility while fixing the representation, absolute mem- ory size, builder, and inference rule, to probe this coupling with sparse training contamination.

Joongwon Chae, Runming Wang, Pei-Wu Qin · 0 citations
Preprint Aug 2026

What Remains Normal? Clean Images Miss Useful Near-Defect Normal Patches for Anomaly Detection

Normal-only industrial anomaly detectors use patches from clean training images as normal references or reconstruction targets. This assumes that clean patches are sufficient for the normal regions encountered at test time. We test that assumption directly. On MVTec AD, admitting ground-truth-normal patches from real d...

Joongwon Chae, Runming Wang, Pei-Wu Qin · 0 citations
Preprint Aug 2026

LLM as Detector: An In-context Learning Approach for Tabular Anomaly Detection

LLM-Detector is proposed, a framework that utilizes the in-context learning capacity of LLMs for structured, prompt-conditioned scoring synthesis, enabling LLMs to derive anomaly detection logic from structured normal-state knowledge.

Tu Nguyen, Dang Nguyen, T. D. Le et al. · 0 citations
Preprint Sep 2026

Knowledge Distillation of a Normalising Flow for Real-Time Anomaly Detection at LHC Level-1 Trigger

We present a new strategy for unsupervised anomaly detection at the hardware-based first stage of event processing (Level-1 trigger) of the Large Hadron Collider (LHC). A normalising flow trained exclusively on Standard Model (SM) events provides a teacher anomaly score based on its exact negative log-likelihood, which...

J. Abson, F. Canelli, Valentina Guglielmi et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.