A Suspicious Multi-Object Detection and Recognition Method for Millimeter Wave SAR Security Inspection Images Based on Multi-Path Extraction Network

被引:18
作者
Yuan, Minghui [1 ]
Zhang, Quansheng [1 ]
Li, Yinwei [1 ]
Yan, Yunhao [1 ]
Zhu, Yiming [1 ]
机构
[1] Univ Shanghai Sci & Technol, Terahertz Technol Innovat Res Inst, Shanghai 200093, Peoples R China
基金
中国国家自然科学基金; 上海市自然科学基金;
关键词
SAR image; deep learning; object recognition; multipath feature pyramid (MPFP); residual block distribution; OBJECTS; FIELD;
D O I
10.3390/rs13244978
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
There are several major challenges in detecting and recognizing multiple hidden objects from millimeter wave SAR security inspection images: inconsistent clarity of objects, similar objects, and complex background interference. To address these problems, a suspicious multi-object detection and recognition method based on the Multi-Path Extraction Network (MPEN) is proposed. In MPEN, You Only Look Once (YOLO) v3 is used as the base network, and then the Multi-Path Feature Pyramid (MPFP) module and modified residual block distribution are proposed. MPFP is designed to output the deep network feature layers separately. Then, to distinguish similar objects more easily, the residual block distribution is modified to improve the ability of the shallow network to capture details. To verify the effectiveness of the proposed method, the millimeter wave SAR images from the laboratory's self-developed security inspection system are utilized in conducting research on multi-object detection and recognition. The detection rate (probability of detecting a target) and average false alarm (probability of error detection) rate of our method on the target are 94.6% and 14.6%, respectively. The mean Average Precision (mAP) of recognizing multi-object is 82.39%. Compared with YOLOv3, our method shows a better performance in detecting and recognizing similar targets.
引用
收藏
页数:18
相关论文
共 30 条
[1]   Automatic target detection using wavelet transform [J].
Arivazhagan, S ;
Ganesan, L .
EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2004, 2004 (17) :2663-2674
[2]  
Behboodi B, 2020, IEEE ENG MED BIO, P2117, DOI [10.1109/EMBC44109.2020.9175846, 10.1109/embc44109.2020.9175846]
[3]   Employing deep learning for automatic river bridge detection from SAR images based on Adaptively effective feature fusion [J].
Chen, Lifu ;
Weng, Ting ;
Xing, Jin ;
Li, Zhenhong ;
Yuan, Zhihui ;
Pan, Zhouhao ;
Tan, Siyu ;
Luo, Ru .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 102
[4]   First Results on Wake Detection in SAR Images by Deep Learning [J].
Del Prete, Roberto ;
Graziano, Maria Daniela ;
Renga, Alfredo .
REMOTE SENSING, 2021, 13 (22)
[5]   Contraband Detection Program [J].
Drolet, G .
CHEMISTRY- AND BIOLOGY-BASED TECHNOLOGIES FOR CONTRABAND DETECTION, 1997, 2937 :162-172
[6]   Study of the Extended Phase Shift Migration for Three-Dimensional MIMO-SAR Imaging in Terahertz Band [J].
Gao, Hang ;
Li, Chao ;
Wu, Shiyou ;
Geng, Hebin ;
Zheng, Shen ;
Qu, Xiaodong ;
Fang, Guangyou .
IEEE ACCESS, 2020, 8 :24773-24783
[7]   A Survey on Change Detection and Time Series Analysis with Applications [J].
Ghaderpour, Ebrahim ;
Pagiatakis, Spiros D. ;
Hassan, Quazi K. .
APPLIED SCIENCES-BASEL, 2021, 11 (13)
[8]   High-Performance Detection of Concealed Forbidden Objects on Human Body with Deep Neural Networks Based on Passive Millimeter Wave and Visible Imagery [J].
Guo, Lin ;
Qin, Shiyin .
JOURNAL OF INFRARED MILLIMETER AND TERAHERTZ WAVES, 2019, 40 (03) :314-347
[9]  
Guo PC, 2020, INT CONF ACOUST SPEE, P1414, DOI [10.1109/ICASSP40776.2020.9054030, 10.1109/icassp40776.2020.9054030]
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778