Local Patch Network With Global Attention for Infrared Small Target Detection

被引:52
作者
Chen, Fang [1 ,2 ,7 ]
Gao, Chenqiang [1 ,2 ,7 ]
Liu, Fangcen [1 ,2 ,7 ]
Zhao, Yue [1 ,2 ,7 ]
Zhou, Yuxi [1 ,2 ,7 ]
Meng, Deyu [3 ,4 ,6 ]
Zuo, Wangmeng [5 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing, Peoples R China
[2] Chongqing Key Lab Signal & Informat Proc, Chongqing, Peoples R China
[3] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Peoples R China
[4] Macau Univ Sci & Technol, Fac Informat Technol, Macau, Peoples R China
[5] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[6] Macau Univ Sci & Technol, Macau Inst Syst Engn, Taipa 999078, Macau, Peoples R China
[7] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Signal & Informat Proc, Chongqing 400065, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Object detection; Deep learning; Training; Task analysis; Complexity theory; Convolution; Attention mechanism; infrared image; local patch network (LPNet); small target detection; CONTRAST METHOD; DIM; KERNEL; MODEL;
D O I
10.1109/TAES.2022.3159308
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Infrared small target detection plays an important role in the infrared search and tracking applications. In recent years, deep learning techniques have been introduced to this task and achieved noteworthy effects. Following general object segmentation methods, existing deep learning methods usually process the image from the global view. However, the locality of small targets and extreme class-imbalance between the target and background pixels are not well-considered by these deep learning methods, which causes the low-efficiency on training and high-dependence on numerous data. A local patch network (LPNet) with global attention is proposed in this article to detect small targets by jointly considering the global and local properties of infrared small target images. From the global view, a supervised attention module trained by the small target spread map is proposed to suppress most background pixels irrelevant with small target features. From the local view, local patches are split from global features and share the same convolution weights with each other in an LPNet. By leveraging both the global and local properties, the data-driven framework proposed in this article has the ability of fusing multiscale features for small target detection. Extensive experiments on synthetic and real datasets show that the proposed method achieves the state-of-the-art performance in comparison with both traditional and deep learning methods.
引用
收藏
页码:3979 / 3991
页数:13
相关论文
共 57 条
[1]   Small infrared target detection using absolute average difference weighted by cumulative directional derivatives [J].
Aghaziyarati, Saeid ;
Moradi, Saed ;
Talebi, Hasan .
INFRARED PHYSICS & TECHNOLOGY, 2019, 101 :78-87
[2]  
[Anonymous], 2015, 3 INT C LEARN REPR I
[3]  
[Anonymous], 2015, INT C LEARN REPR ICL
[4]   Analysis of new top-hat transformation and the application for infrared dim small target detection [J].
Bai, Xiangzhi ;
Zhou, Fugen .
PATTERN RECOGNITION, 2010, 43 (06) :2145-2156
[5]   A Local Contrast Method for Small Infrared Target Detection [J].
Chen, C. L. Philip ;
Li, Hong ;
Wei, Yantao ;
Xia, Tian ;
Tang, Yuan Yan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (01) :574-581
[6]   Asymmetric Contextual Modulation for Infrared Small Target Detection [J].
Dai, Yimian ;
Wu, Yiquan ;
Zhou, Fei ;
Barnard, Kobus .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, :949-958
[7]   Reweighted Infrared Patch-Tensor Model With Both Nonlocal and Local Priors for Single-Frame Small Target Detection [J].
Dai, Yimian ;
Wu, Yiquan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (08) :3752-3767
[8]   Infrared small target and background separation via column-wise weighted robust principal component analysis [J].
Dai, Yimian ;
Wu, Yiquan ;
Song, Yu .
INFRARED PHYSICS & TECHNOLOGY, 2016, 77 :421-430
[9]   Small Infrared Target Detection Based on Weighted Local Difference Measure [J].
Deng, He ;
Sun, Xianping ;
Liu, Maili ;
Ye, Chaohui ;
Zhou, Xin .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (07) :4204-4214
[10]   Infrared Small-Target Detection Using Multiscale Gray Difference Weighted Image Entropy [J].
Deng, He ;
Sun, Xianping ;
Liu, Maili ;
Ye, Chaohui ;
Zhou, Xin .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2016, 52 (01) :60-72