Adversarial diffusion for few-shot scene adaptive video anomaly detection

被引:3
作者
Zahid, Yumna [1 ]
Zarges, Christine [1 ]
Tiddeman, Bernie [1 ]
Han, Jungong [2 ]
机构
[1] Aberystwyth Univ, Dept Comp Sci, Aberystwyth SY23 3FL, Wales
[2] Univ Sheffield, Dept Comp Sci, Sheffield S10 2TN, England
关键词
Few-shot learning; Video anomaly detection; Diffusion; GAN; One-class classification;
D O I
10.1016/j.neucom.2024.128796
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot anomaly detection for video surveillance is challenging due to the diverse nature of target domains. Existing methodologies treat it as a one-class classification problem, training on a reduced sample of nominal scenes. The focus is on either reconstructive or predictive frame methodologies to learn a manifold against which outliers can be detected during inference. We posit that the quality of image reconstruction or future frame prediction is inherently important in identifying anomalous pixels in video frames. In this paper, we enhance the image synthesis and mode coverage for video anomaly detection (VAD) by integrating a Denoising Diffusion model with a future frame prediction model. Our novel VAD pipeline includes a Generative Adversarial Network combined with denoising diffusion to learn the underlying non-anomalous data distribution and generate in one-step high fidelity future-frame samples. We further regularize the image reconstruction with perceptual quality metrics such as Multi-scale Structural Similarity Index Measure and Peak Signal-to-Noise Ratio, ensuring high-quality output under few episodic training iterations. Extensive experiments demonstrate that our method outperforms state-of-the-art techniques across multiple benchmarks, validating that high-quality image synthesis in frame prediction leads to robust anomaly detection in videos.
引用
收藏
页数:10
相关论文
共 62 条
[1]   Latent Space Autoregression for Novelty Detection [J].
Abati, Davide ;
Porrello, Angelo ;
Calderara, Simone ;
Cucchiara, Rita .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :481-490
[2]   GANomaly: Semi-supervised Anomaly Detection via Adversarial Training [J].
Akcay, Samet ;
Atapour-Abarghouei, Amir ;
Breckon, Toby P. .
COMPUTER VISION - ACCV 2018, PT III, 2019, 11363 :622-637
[3]  
Arjovsky Martin, 2017, P 5 INT C LEARN REPR, DOI DOI 10.48550/ARXIV.1701.04862
[4]  
Brock A., 2018, 6 INT C LEARN REPR I
[5]  
Chalapathy R, 2019, Arxiv, DOI [arXiv:1901.03407, 10.48550/arXiv.1901.03407, DOI 10.48550/ARXIV.1901.03407, 10.48550/ARXIV.1901.03407]
[6]  
Chen YX, 2023, AAAI CONF ARTIF INTE, P387
[7]  
Dehaene D., 2019, INT C LEARN REPR
[8]  
Dhariwal P, 2021, ADV NEUR IN, V34
[9]   Any-Shot Sequential Anomaly Detection in Surveillance Videos [J].
Doshi, Keval ;
Yilmaz, Yasin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :4037-4042
[10]  
Finn C, 2017, PR MACH LEARN RES, V70