Salient Object Detection Based on Progressively Supervised Learning for Remote Sensing Images

被引:98
作者
Zhang, Libao [1 ]
Ma, Jie [2 ]
机构
[1] Beijing Normal Univ, Sch Artificiial Intelligence, Beijing 100875, Peoples R China
[2] Beijing Foreign Studies Univ, Sch Informat Sci & Technol, Beijing 100089, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2021年 / 59卷 / 11期
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Annotations; Training; Supervised learning; Remote sensing; Object detection; Image segmentation; Feature extraction; Convolutional neural network (CNN); fully supervised learning; remote sensing image (RSI) processing; salient object detection (SOD); weakly supervised learning (WSL); SEMANTIC SEGMENTATION; VISUAL-ATTENTION; TARGET DETECTION; REGION; DENSE;
D O I
10.1109/TGRS.2020.3045708
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Salient object detection (SOD) is a crucial task in the field of remote sensing image (RSI) processing. Weakly supervised SOD methods, which generate saliency maps by classification convolutional neural networks (CNNs), considerably reduce labor costs. However, due to the complexity of remote sensing scenes, concerns remain about weakly supervised SOD for RSIs: 1) since the pooling operations are applied in the classification CNNs, the boundary maintenance of weakly supervised methods is unsatisfactory and 2) several sophisticated postprocessing procedures are used in previous weakly supervised methods, which are inevitably time-consuming. To solve these problems, we combine the benefits of weakly and fully supervised learning and propose a new SOD method named progressively supervised learning (PSL) for RSIs. The proposed method realizes end-to-end SOD with a lightweight model under imagewise annotations. First, to reduce the demands on large-scale pixelwise annotations, we propose a pseudo-label generation method based on a classification network and gradient-weighted class activation mapping (Grad-CAM) to compute pseudo saliency maps (PSMs) for training samples and auxiliary images in a weakly supervised manner. Then, to improve the computational efficiency, we construct a feedback saliency analysis network (FSAN), where the generated PSMs are regarded as pixelwise labels. Finally, inspired by curriculum learning, we design a new denoising loss function to further reduce the effect brought by missing judgment in PSMs and enhance the detection accuracy. Comprehensive evaluations with two remote sensing data sets and a comparison with 11 methods validate the superiority of the proposed PSL model.
引用
收藏
页码:9682 / 9696
页数:15
相关论文
共 80 条
[1]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[2]  
[Anonymous], 2016, P 2016 ACM MULT C, DOI 10.1145/2964284.2967250
[3]  
[Anonymous], 2009, P 12 INT C ART INT S
[4]  
Bengio Y., 2009, International Conference on Machine Learning, V382, P41
[5]   Salient object detection: A survey [J].
Borji, Ali ;
Cheng, Ming-Ming ;
Hou, Qibin ;
Jiang, Huaizu ;
Li, Jia .
COMPUTATIONAL VISUAL MEDIA, 2019, 5 (02) :117-150
[6]  
Boykov YY, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL I, PROCEEDINGS, P105, DOI 10.1109/ICCV.2001.937505
[7]   Self-Adaptively Weighted Co-Saliency Detection via Rank Constraint [J].
Cao, Xiaochun ;
Tao, Zhiqiang ;
Zhang, Bao ;
Fu, Huazhu ;
Feng, Wei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) :4175-4186
[8]  
Chattopadhay A., 2018, P IEEE WINT C APPL C
[9]   Symmetrical Dense-Shortcut Deep Fully Convolutional Networks for Semantic Segmentation of Very-High-Resolution Remote Sensing Images [J].
Chen, Guanzhou ;
Zhang, Xiaodong ;
Wang, Qing ;
Dai, Fan ;
Gong, Yuanfu ;
Zhu, Kun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (05) :1633-1644
[10]   High-Quality Proposals for Weakly Supervised Object Detection [J].
Cheng, Gong ;
Yang, Junyu ;
Gao, Decheng ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :5794-5804