Patch-Based Semantically Enhanced Network for IR Dim and Small Targets Background Suppression

被引:1
作者
Tong, Yunfei [1 ,2 ]
Leng, Yue [1 ,2 ]
Yang, Hai [1 ,2 ]
Wang, Zhe [1 ,2 ]
Niu, Saisai [3 ,4 ]
Long, Huabao [3 ,4 ]
机构
[1] East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
[2] East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
[3] Shanghai Aerosp Control Technol Inst, Shanghai 201109, Peoples R China
[4] China Aerosp Sci & Technol Corp, Res & Dev Ctr Infrared Detect Technol, Shanghai 201109, Peoples R China
关键词
Signal to noise ratio; Generative adversarial networks; Clutter; Task analysis; Semantics; Object detection; Image segmentation; Background suppression; data imbalance; generative adversarial networks (GANs); multiscale feature fusion; low Signal-to-Noise Ratio (SNR) infrared (IR) scenes; MODEL;
D O I
10.1109/JSTARS.2024.3394953
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The task of background suppression in infrared small-target scenarios aims to eliminate irregular noisy backgrounds while preserving targets with high-frequency features. In infrared small-target scenes at long distances, the backgrounds become complex and the target features are degraded, highlighting a significant disparity between the detailed and realistic background and the limited features of the targets. To address these challenges, we propose a patch-based semantically enhanced generative adversarial network (GAN) named PSEnet for background suppression in infrared small-target scenarios. First, we introduce a patch-scale GAN that allows the model to concentrate on local background suppression. This shift from a global to local perspective simplifies the complexity of background suppression. Second, we employ the PSE module consisting multiscale dilated convolution and adaptive weight fusion to extract local semantic information. Third, by segmenting the infrared image into smaller patches and resampling them, we create a more balanced dataset for adversarial training. Experimental results demonstrate that the proposed algorithm significantly improves the signal-to-noise ratio of dim and small targets, reduces the missing detection rate, and achieves a precision of almost 91%. In conclusion, this approach effectively uses GANs for background suppression in complex environments.
引用
收藏
页码:9615 / 9627
页数:13
相关论文
共 38 条
[11]  
[回丙伟 Hui Bingwei], 2020, [中国科学数据, China Scientific Data], V5, P1
[12]  
Kong X., 2021, IEEE T GEOSCI ELECT, V60, P1, DOI [DOI 10.1109/TGRS.2021.3068465, 10.1109/TGRS.2021.3068465]
[13]   Single infrared image enhancement using a deep convolutional neural network [J].
Kuang, Xiaodong ;
Sui, Xiubao ;
Liu, Yuan ;
Chen, Qian ;
Gu, Guohua .
NEUROCOMPUTING, 2019, 332 :119-128
[14]   Dense Nested Attention Network for Infrared Small Target Detection [J].
Li, Boyang ;
Xiao, Chao ;
Wang, Longguang ;
Wang, Yingqian ;
Lin, Zaiping ;
Li, Miao ;
An, Wei ;
Guo, Yulan .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :1745-1758
[15]   A novel spatio-temporal saliency approach for robust dim moving target detection from airborne infrared image sequences [J].
Li, Yansheng ;
Zhang, Yongjun ;
Yu, Jin-Gang ;
Tan, Yihua ;
Tian, Jinwen ;
Ma, Jiayi .
INFORMATION SCIENCES, 2016, 369 :548-563
[16]   Infrared maritime dim small target detection based on spatiotemporal cues and directional morphological filtering [J].
Li, Yongsong ;
Li, Zhengzhou ;
Zhang, Chao ;
Luo, Zefeng ;
Zhu, Yong ;
Ding, Zhiquan ;
Qin, Tianqi .
INFRARED PHYSICS & TECHNOLOGY, 2021, 115
[17]   Tiny and Dim Infrared Target Detection Based on Weighted Local Contrast [J].
Liu, Jie ;
He, Ziqing ;
Chen, Zuolong ;
Shao, Lei .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (11) :1780-1784
[18]   Nonconvex Tensor Low-Rank Approximation for Infrared Small Target Detection [J].
Liu, Ting ;
Yang, Jungang ;
Li, Boyang ;
Xiao, Chao ;
Sun, Yang ;
Wang, Yingqian ;
An, Wei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[19]   Machine Learning with Oversampling and Undersampling Techniques: Overview Study and Experimental Results [J].
Mohammed, Roweida ;
Rawashdeh, Jumanah ;
Abdullah, Malak .
2020 11TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2020, :243-248
[20]   Facet Derivative-Based Multidirectional Edge Awareness and Spatial-Temporal Tensor Model for Infrared Small Target Detection [J].
Pang, Dongdong ;
Shan, Tao ;
Li, Wei ;
Ma, Pengge ;
Tao, Ran ;
Ma, Yueran .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60