Unsupervised moving object segmentation using background subtraction and optimal adversarial noise sample search

被引:9
作者
Sultana, Maryam [1 ,2 ]
Mahmood, Arif [3 ]
Jung, Soon Ki [1 ]
机构
[1] Mohamed Bin Zayed Univ AI, Dept Comp Vis, Abu Dhabi, U Arab Emirates
[2] Kyungpook Natl Univ, Sch Comp Sci & Engn, Daegu, South Korea
[3] Informat Technol Univ ITU, Dept Comp Sci, Lahore, Pakistan
关键词
Moving objects segmentation; Generative adversarial network; Background subtraction; LOW-RANK; MODEL;
D O I
10.1016/j.patcog.2022.108719
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Moving Objects Segmentation (MOS) is a fundamental task in many computer vision applications such as human activity analysis, visual object tracking, content based video search, traffic monitoring, surveillance, and security. MOS becomes challenging due to abrupt illumination variations, dynamic backgrounds, camouflage and scenes with bootstrapping. To address these challenges we propose a MOS algorithm exploiting multiple adversarial regularizations including conventional as well as least squares losses. More specifically, our model is trained on scene background images with the help of cross-entropy loss, least squares adversarial loss and l(1) loss in image space working jointly to learn the dynamic background changes. During testing, our proposed method aims to generate test image background scenes by searching optimal noise samples using joint minimization of l(1) loss in image space, l(1) loss in feature space, and discriminator least squares loss. These loss functions force the generator to synthesize dynamic backgrounds similar to the test sequences which upon subtraction results in moving objects segmentation. Experimental evaluations on five benchmark datasets have shown excellent performance of the proposed algorithm compared to the twenty one existing state-of-the-art methods. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:11
相关论文
共 56 条
[1]   Dynamic background subtraction with masked RPCA [J].
Ahn, Hyomin ;
Kang, Myungjoo .
SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (03) :467-474
[2]  
[Anonymous], 2019, MULTIMEDIA TOOLS APP
[3]   An Efficient Optimal Neural Network-Based Moving Vehicle Detection in Traffic Video Surveillance System [J].
Appathurai, Ahilan ;
Sundarasekar, Revathi ;
Raja, C. ;
Alex, E. John ;
Palagan, C. Anna ;
Nithya, A. .
CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2020, 39 (02) :734-756
[4]  
Bahri F., 2018, P 11 INDIAN C COMPUT, P1
[5]  
Bakkay MC, 2018, IEEE IMAGE PROC, P4018, DOI 10.1109/ICIP.2018.8451603
[6]   Deep neural network concepts for background subtraction: A systematic review and comparative evaluation [J].
Bouwmans, Thierry ;
Jayed, Sajid ;
Sultana, Maryam ;
Jung, Soon Ki .
NEURAL NETWORKS, 2019, 117 :8-66
[7]  
Brutzer S, 2011, PROC CVPR IEEE
[8]   Saliency-guided level set model for automatic object segmentation [J].
Cai, Qing ;
Liu, Huiying ;
Qian, Yiming ;
Zhou, Sanping ;
Duan, Xiaojun ;
Yang, Yee-Hong .
PATTERN RECOGNITION, 2019, 93 :147-163
[9]   Total Variation Regularized RPCA for Irregularly Moving Object Detection Under Dynamic Background [J].
Cao, Xiaochun ;
Yang, Liang ;
Guo, Xiaojie .
IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (04) :1014-1027
[10]   Spatiotemporal GMM for Background Subtraction with Superpixel Hierarchy [J].
Chen, Mingliang ;
Wei, Xing ;
Yang, Qingxiong ;
Li, Qing ;
Wang, Gang ;
Yang, Ming-Hsuan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (06) :1518-1525