A novel weakly supervised cross-domain framework that enriches feature representations by explicitly integrating semantic cues from Human-Object Interactions (HOI) and action dynamics and achieves competitive performance against state-of-the-art methods under weak supervision in terms of AUC.
Abstract
Weakly supervised video anomaly detection remains a challenging problem, primarily due to the scarcity of abnormal training samples and the lack of diverse feature representations, which hamper the learning of discriminative models. To address these issues, we introduce a novel weakly supervised cross-domain framework that enriches feature representations by explicitly integrating semantic cues from Human-Object Interactions (HOI) and action dynamics. Specifically, we model domain-specific features using two independent encoders and fuse them via a bi-directional cross-attention mechanism to obtain a unified embedding. To further alleviate class imbalance and enhance feature discrimination, our network is jointly optimized with classification loss, a cross-domain contrastive loss, and a clip-level focal loss. The proposed method is evaluated with various visual backbones, demonstrating its adaptability and robustness. Extensive experiments show that our approach achieves competitive performance against state-of-the-art methods under weak supervision in terms of AUC. Specifically, our proposed method achieves 98.33% AUC and 87.96% AUC on two benchmark datasets, i.e., ShanghaiTech and UCF-Crime, respectively.
Weakly supervised video anomaly detection (WS-VAD) presents a significant challenge in security video surveillance, as it aims to accurately identify anomaly frames in untrimmed videos with only video-level supervision. Several recent studies exploit vision-language pre-training models, e.g., CLIP, to take advantage of...
Shuang-Qing Zhang, Wei Xu, Yu-Qi Fang et al.· IEEE Transactions on Informa...· 2 citations
Video Anomaly Detection (VAD) plays a critical role in intelligent surveillance and public safety by identifying rare, unexpected, or contextually abnormal events in complex video environments. Conventional deep learning approaches have substantially advanced VAD, but they remain largely driven by visual representation...
Furkan Mumcu, Lokman Bekit, Michael J. Jones et al.· IEEE Access· 0 citations
Video anomaly detection (VAD) is a challenging task for surveillance systems due to the scarcity and diversity of anomalous events. While semi-supervised VAD approaches have advanced the field, many rely on computationally intensive optical flow networks to capture motion dynamics. Convolutional neural networks (CNNs)...
Experimental results on UCF-Crime, ShanghaiTech, and XD-Violence demonstrate the effectiveness of multimodal DynaST, a multimodal framework for weakly supervised video anomaly detection, and the benefit of multimodal learning for robust anomaly detection.
Wen-Jian Zhang, Xin-Xin Fan, Qi-Wei Pan et al.· IEEE Access· 0 citations
This paper introduces a novel multimodal deception detection framework centered on feature reconstruction and temporal consistency modeling that outperforms baseline models across multiple metrics, including Accuracy, F1-score, and AUC.
This article proposes ActNet, a novel deep convolutional neural network architecture that combines multi-scale feature learning with a focus-aware attention mechanism to address the problem of recognizing human actions from still images.
Şafak Kılıç· PeerJ Computer Science· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.