Deep detector classifier (DeepDC) for moving objects segmentation and classification in video surveillance

被引:25
作者
Ammar, Sirine [1 ,2 ]
Bouwmans, Thierry [2 ]
Zaghden, Nizar [3 ]
Neji, Mahmoud [1 ]
机构
[1] Univ Sfax, Lab MIRACL, Sfax, Tunisia
[2] Univ La Rochelle, Lab MIA, Ave M Crepeau, F-17000 La Rochelle, France
[3] Univ Sfax, ESC, Sfax, Tunisia
关键词
image classification; image motion analysis; video surveillance; object detection; image segmentation; image sequences; learning (artificial intelligence); video signal processing; moving objects; video sequences; unsupervised anomaly discovery framework; generative adversarial networks; deep detector classifier; spatial context; temporal context; foreground object segmentation; generative models; segmented objects; videos surveillance; missing data imputation task; BACKGROUND SUBTRACTION; NEURAL-NETWORK; FEATURES; TRACKING; IMAGE;
D O I
10.1049/iet-ipr.2019.0769
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, the authors present a new approach to segment and classify moving objects in video sequences by combining an unsupervised anomaly discovery framework called DeepSphere and generative adversarial networks. The proposed deep detector classifier employs and validates DeepSphere, which aims mainly to identify the anomalous cases in the spatial and temporal context in order to perform foreground objects segmentation. For post-processing, some morphological operations are considered to better segment and extract the desired objects. Finally, they take advantage of the power of generative models, which recognise the problem of semi-supervised learning as a specific missing data imputation task in order to classify the segmented objects. They evaluate the method with multiple datasets and the results confirm the effectiveness of the proposed approach, which achieves superior performance over the state-of-the-art methods having the capabilities of segmenting and classifying moving objects from videos surveillance.
引用
收藏
页码:1490 / 1501
页数:12
相关论文
共 50 条
[31]   A method for moving objects segmentation based on human vision perception in infrared video [J].
Sun, Bin ;
Min, Chaobo ;
Zhang, Junju ;
Chang, Bengkang ;
Li, Yingjie ;
Yiyong, Han .
OPTICAL REVIEW, 2014, 21 (01) :27-34
[32]   An Efficient Framework for Detecting Moving Objects and Structural Lanes in Video Based Surveillance Systems [J].
Li, Zongmin ;
Zhong, Liangliang .
JCPC: 2009 JOINT CONFERENCE ON PERVASIVE COMPUTING, 2009, :355-358
[33]   Automated video surveillance system for snatching detection using heuristic analysis of moving objects [J].
China, Takahiro ;
Miyahara, Akira ;
Nagayama, Itaru .
IEEJ Transactions on Industry Applications, 2015, 135 (02) :99-106
[34]   New method for moving objects segmentation based on human vision perception in infrared video [J].
Min, Chaobo .
FIFTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2013), 2013, 8878
[35]   A novel foreground/background decision using in unsupervised segmentation of moving objects in video sequences [J].
Tsai, TH ;
Chen, GJ ;
Tzeng, WL .
Proceedings of the 46th IEEE International Midwest Symposium on Circuits & Systems, Vols 1-3, 2003, :714-717
[36]   A new video segmentation method of moving objects based on blob-level knowledge [J].
Carmona, Enrique J. ;
Martinez-Cantos, Javier ;
Mira, Jose .
PATTERN RECOGNITION LETTERS, 2008, 29 (03) :272-285
[37]   Complex Wavelet Based Moving Object Segmentation using Approximate Median Filter Based Method for Video Surveillance [J].
Kushwaha, Alok Kumar Singh ;
Srivastava, Rajeev .
SOUVENIR OF THE 2014 IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC), 2014, :973-978
[38]   Performance Evaluation of Various Moving Object Segmentation Techniques for Intelligent Video Surveillance System [J].
Kushwaha, Alok Kumar Singh ;
Srivastava, Rajeev .
2014 INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2014, :196-201
[39]   Holographic Classifier: Deep Learning in Digital Holography for Automatic Micro-objects Classification [J].
Zhu, Yanmin ;
Yeung, Chok Hang ;
Lam, Edmund Y. .
2020 IEEE 18TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), VOL 1, 2020, :515-520
[40]   A background modeling and foreground segmentation approach based on the feedback of moving objects in traffic surveillance systems [J].
Ling, Qiang ;
Yan, Jinfeng ;
Li, Feng ;
Zhang, Yicheng .
NEUROCOMPUTING, 2014, 133 :32-45