Salient Object Detection Based on Progressively Supervised Learning for Remote Sensing Images

被引:98
作者
Zhang, Libao [1 ]
Ma, Jie [2 ]
机构
[1] Beijing Normal Univ, Sch Artificiial Intelligence, Beijing 100875, Peoples R China
[2] Beijing Foreign Studies Univ, Sch Informat Sci & Technol, Beijing 100089, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2021年 / 59卷 / 11期
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Annotations; Training; Supervised learning; Remote sensing; Object detection; Image segmentation; Feature extraction; Convolutional neural network (CNN); fully supervised learning; remote sensing image (RSI) processing; salient object detection (SOD); weakly supervised learning (WSL); SEMANTIC SEGMENTATION; VISUAL-ATTENTION; TARGET DETECTION; REGION; DENSE;
D O I
10.1109/TGRS.2020.3045708
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Salient object detection (SOD) is a crucial task in the field of remote sensing image (RSI) processing. Weakly supervised SOD methods, which generate saliency maps by classification convolutional neural networks (CNNs), considerably reduce labor costs. However, due to the complexity of remote sensing scenes, concerns remain about weakly supervised SOD for RSIs: 1) since the pooling operations are applied in the classification CNNs, the boundary maintenance of weakly supervised methods is unsatisfactory and 2) several sophisticated postprocessing procedures are used in previous weakly supervised methods, which are inevitably time-consuming. To solve these problems, we combine the benefits of weakly and fully supervised learning and propose a new SOD method named progressively supervised learning (PSL) for RSIs. The proposed method realizes end-to-end SOD with a lightweight model under imagewise annotations. First, to reduce the demands on large-scale pixelwise annotations, we propose a pseudo-label generation method based on a classification network and gradient-weighted class activation mapping (Grad-CAM) to compute pseudo saliency maps (PSMs) for training samples and auxiliary images in a weakly supervised manner. Then, to improve the computational efficiency, we construct a feedback saliency analysis network (FSAN), where the generated PSMs are regarded as pixelwise labels. Finally, inspired by curriculum learning, we design a new denoising loss function to further reduce the effect brought by missing judgment in PSMs and enhance the detection accuracy. Comprehensive evaluations with two remote sensing data sets and a comparison with 11 methods validate the superiority of the proposed PSL model.
引用
收藏
页码:9682 / 9696
页数:15
相关论文
共 80 条
[61]  
Szegedy C, 2015, PROC CVPR IEEE, P1, DOI 10.1109/CVPR.2015.7298594
[62]   Salient Object Detection Using Cascaded Convolutional Neural Networks and Adversarial Learning [J].
Tang, Youbao ;
Wu, Xiangqian .
IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (09) :2237-2247
[63]   Saliency Detection via Combining Region-Level and Pixel-Level Predictions with CNNs [J].
Tang, Youbao ;
Wu, Xiangqian .
COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 :809-825
[64]   Learning to Detect Salient Objects with Image-level Supervision [J].
Wang, Lijun ;
Lu, Huchuan ;
Wang, Yifan ;
Feng, Mengyang ;
Wang, Dong ;
Yin, Baocai ;
Ruan, Xiang .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3796-3805
[65]  
Wang LJ, 2015, PROC CVPR IEEE, P3183, DOI 10.1109/CVPR.2015.7298938
[66]  
Xu L, 2019, INT CONF ACOUST SPEE, P1897, DOI [10.1109/ICASSP.2019.8682788, 10.1109/icassp.2019.8682788]
[67]   Automatic Weakly Supervised Object Detection From High Spatial Resolution Remote Sensing Images via Dynamic Curriculum Learning [J].
Yao, Xiwen ;
Feng, Xiaoxu ;
Han, Junwei ;
Cheng, Gong ;
Guo, Lei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (01) :675-685
[68]   Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning [J].
Yao, Xiwen ;
Han, Junwei ;
Cheng, Gong ;
Qian, Xueming ;
Guo, Lei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (06) :3660-3671
[69]   Weakly Supervised Learning Based on Coupled Convolutional Neural Networks for Aircraft Detection [J].
Zhang, Fan ;
Du, Bo ;
Zhang, Liangpei ;
Xu, Miaozhong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (09) :5553-5563
[70]   Weakly-Supervised Salient Object Detection via Scribble Annotations [J].
Zhang, Jing ;
Yu, Xin ;
Li, Aixuan ;
Song, Peipei ;
Liu, Bowen ;
Dai, Yuchao .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :12543-12552