Patch-Based Semantically Enhanced Network for IR Dim and Small Targets Background Suppression

被引:1
作者
Tong, Yunfei [1 ,2 ]
Leng, Yue [1 ,2 ]
Yang, Hai [1 ,2 ]
Wang, Zhe [1 ,2 ]
Niu, Saisai [3 ,4 ]
Long, Huabao [3 ,4 ]
机构
[1] East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
[2] East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
[3] Shanghai Aerosp Control Technol Inst, Shanghai 201109, Peoples R China
[4] China Aerosp Sci & Technol Corp, Res & Dev Ctr Infrared Detect Technol, Shanghai 201109, Peoples R China
关键词
Signal to noise ratio; Generative adversarial networks; Clutter; Task analysis; Semantics; Object detection; Image segmentation; Background suppression; data imbalance; generative adversarial networks (GANs); multiscale feature fusion; low Signal-to-Noise Ratio (SNR) infrared (IR) scenes; MODEL;
D O I
10.1109/JSTARS.2024.3394953
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The task of background suppression in infrared small-target scenarios aims to eliminate irregular noisy backgrounds while preserving targets with high-frequency features. In infrared small-target scenes at long distances, the backgrounds become complex and the target features are degraded, highlighting a significant disparity between the detailed and realistic background and the limited features of the targets. To address these challenges, we propose a patch-based semantically enhanced generative adversarial network (GAN) named PSEnet for background suppression in infrared small-target scenarios. First, we introduce a patch-scale GAN that allows the model to concentrate on local background suppression. This shift from a global to local perspective simplifies the complexity of background suppression. Second, we employ the PSE module consisting multiscale dilated convolution and adaptive weight fusion to extract local semantic information. Third, by segmenting the infrared image into smaller patches and resampling them, we create a more balanced dataset for adversarial training. Experimental results demonstrate that the proposed algorithm significantly improves the signal-to-noise ratio of dim and small targets, reduces the missing detection rate, and achieves a precision of almost 91%. In conclusion, this approach effectively uses GANs for background suppression in complex environments.
引用
收藏
页码:9615 / 9627
页数:13
相关论文
共 38 条
[1]   Analysis of new top-hat transformation and the application for infrared dim small target detection [J].
Bai, Xiangzhi ;
Zhou, Fugen .
PATTERN RECOGNITION, 2010, 43 (06) :2145-2156
[2]   A full data augmentation pipeline for small object detection based on generative adversarial networks [J].
Bosquet, Brais ;
Cores, Daniel ;
Seidenari, Lorenzo ;
Brea, Victor M. ;
Mucientes, Manuel ;
Del Bimbo, Alberto .
PATTERN RECOGNITION, 2023, 133
[3]   A Local Contrast Method for Small Infrared Target Detection [J].
Chen, C. L. Philip ;
Li, Hong ;
Wei, Yantao ;
Xia, Tian ;
Tang, Yuan Yan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (01) :574-581
[4]   Attentional Local Contrast Networks for Infrared Small Target Detection [J].
Dai, Yimian ;
Wu, Yiquan ;
Zhou, Fei ;
Barnard, Kobus .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (11) :9813-9824
[5]   Asymmetric Contextual Modulation for Infrared Small Target Detection [J].
Dai, Yimian ;
Wu, Yiquan ;
Zhou, Fei ;
Barnard, Kobus .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, :949-958
[6]   Reweighted Infrared Patch-Tensor Model With Both Nonlocal and Local Priors for Single-Frame Small Target Detection [J].
Dai, Yimian ;
Wu, Yiquan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (08) :3752-3767
[7]   Non-negative infrared patch-image model: Robust target-background separation via partial sum minimization of singular values [J].
Dai, Yimian ;
Wu, Yiquan ;
Song, Yu ;
Guo, Jun .
INFRARED PHYSICS & TECHNOLOGY, 2017, 81 :182-194
[8]   Small Infrared Target Detection Based on Weighted Local Difference Measure [J].
Deng, He ;
Sun, Xianping ;
Liu, Maili ;
Ye, Chaohui ;
Zhou, Xin .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (07) :4204-4214
[9]   Max-Mean and Max-Median filters for detection of small-targets [J].
Deshpande, SD ;
Er, MH ;
Ronda, V ;
Chan, P .
SIGNAL AND DATA PROCESSING OF SMALL TARGETS 1999, 1999, 3809 :74-83
[10]   Infrared Patch-Image Model for Small Target Detection in a Single Image [J].
Gao, Chenqiang ;
Meng, Deyu ;
Yang, Yi ;
Wang, Yongtao ;
Zhou, Xiaofang ;
Hauptmann, Alexander G. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (12) :4996-5009