Local Patch Network With Global Attention for Infrared Small Target Detection

被引:52
作者
Chen, Fang [1 ,2 ,7 ]
Gao, Chenqiang [1 ,2 ,7 ]
Liu, Fangcen [1 ,2 ,7 ]
Zhao, Yue [1 ,2 ,7 ]
Zhou, Yuxi [1 ,2 ,7 ]
Meng, Deyu [3 ,4 ,6 ]
Zuo, Wangmeng [5 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing, Peoples R China
[2] Chongqing Key Lab Signal & Informat Proc, Chongqing, Peoples R China
[3] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Peoples R China
[4] Macau Univ Sci & Technol, Fac Informat Technol, Macau, Peoples R China
[5] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[6] Macau Univ Sci & Technol, Macau Inst Syst Engn, Taipa 999078, Macau, Peoples R China
[7] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Signal & Informat Proc, Chongqing 400065, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Object detection; Deep learning; Training; Task analysis; Complexity theory; Convolution; Attention mechanism; infrared image; local patch network (LPNet); small target detection; CONTRAST METHOD; DIM; KERNEL; MODEL;
D O I
10.1109/TAES.2022.3159308
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Infrared small target detection plays an important role in the infrared search and tracking applications. In recent years, deep learning techniques have been introduced to this task and achieved noteworthy effects. Following general object segmentation methods, existing deep learning methods usually process the image from the global view. However, the locality of small targets and extreme class-imbalance between the target and background pixels are not well-considered by these deep learning methods, which causes the low-efficiency on training and high-dependence on numerous data. A local patch network (LPNet) with global attention is proposed in this article to detect small targets by jointly considering the global and local properties of infrared small target images. From the global view, a supervised attention module trained by the small target spread map is proposed to suppress most background pixels irrelevant with small target features. From the local view, local patches are split from global features and share the same convolution weights with each other in an LPNet. By leveraging both the global and local properties, the data-driven framework proposed in this article has the ability of fusing multiscale features for small target detection. Extensive experiments on synthetic and real datasets show that the proposed method achieves the state-of-the-art performance in comparison with both traditional and deep learning methods.
引用
收藏
页码:3979 / 3991
页数:13
相关论文
共 57 条
[11]   Adaptive top-hat filter based on quantum genetic algorithm for infrared small target detection [J].
Deng, Lizhen ;
Zhu, Hu ;
Zhou, Quan ;
Li, Yansheng .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (09) :10539-10551
[12]  
Deng XY, 2018, INT C PATT RECOG, P2682, DOI 10.1109/ICPR.2018.8546043
[13]   Max-Mean and Max-Median filters for detection of small-targets [J].
Deshpande, SD ;
Er, MH ;
Ronda, V ;
Chan, P .
SIGNAL AND DATA PROCESSING OF SMALL TARGETS 1999, 1999, 3809 :74-83
[14]   CNN-based infrared dim small target detection algorithm using target-oriented shallow-deep features and effective small anchor [J].
Du, Jinming ;
Lu, Huanzhang ;
Hu, Moufa ;
Zhang, Luping ;
Shen, Xinglin .
IET IMAGE PROCESSING, 2021, 15 (01) :1-15
[15]   Infrared Small Target Detection Using Homogeneity-Weighted Local Contrast Measure [J].
Du, Peng ;
Hamdulla, Askar .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (03) :514-518
[16]   Dim infrared image enhancement based on convolutional neural network [J].
Fan, Zunlin ;
Bi, Duyan ;
Xiong, Lei ;
Ma, Shiping ;
He, Linyuan ;
Ding, Wenshan .
NEUROCOMPUTING, 2018, 272 :396-404
[17]   Generalised-structure-tensor-based infrared small target detection [J].
Gao, Ch-Q. ;
Tian, J-W. ;
Wang, P. .
ELECTRONICS LETTERS, 2008, 44 (23) :1349-+
[18]   Infrared small-dim target detection based on Markov random field guided noise modeling [J].
Gao, Chenqiang ;
Wang, Lan ;
Xiao, Yongxing ;
Zhao, Qian ;
Meng, Deyu .
PATTERN RECOGNITION, 2018, 76 :463-475
[19]   Infrared Patch-Image Model for Small Target Detection in a Single Image [J].
Gao, Chenqiang ;
Meng, Deyu ;
Yang, Yi ;
Wang, Yongtao ;
Zhou, Xiaofang ;
Hauptmann, Alexander G. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (12) :4996-5009
[20]   Infrared Small Target Detection Using a Temporal Variance and Spatial Patch Contrast Filter [J].
Gao, Jinyan ;
Lin, Zaiping ;
An, Wei .
IEEE ACCESS, 2019, 7 :32217-32226