A parallel down-up fusion network for salient object detection in optical remote sensing images

被引:80
作者
Li, Chongyi [1 ]
Cong, Runmin [2 ,3 ]
Guo, Chunle [4 ]
Li, Hua [5 ,6 ]
Zhang, Chunjie [2 ,3 ]
Zheng, Feng [7 ]
Zhao, Yao [2 ,3 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[3] Beijing Key Lab Adv Informat Sci & Network Techno, Beijing 100044, Peoples R China
[4] Nankai Univ, Coll Comp Sci, Tianjin 300350, Peoples R China
[5] Huazhong Univ Sci & Technol, Sch Software Engn, Wuhan 430074, Peoples R China
[6] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong 999077, Peoples R China
[7] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen 518055, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Optical remote sensing images; Salient object detection; Deep learning; OPTIMIZATION;
D O I
10.1016/j.neucom.2020.05.108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The diverse spatial resolutions, various object types, scales and orientations, and cluttered backgrounds in optical remote sensing images (RSIs) challenge the current salient object detection (SOD) approaches. It is commonly unsatisfactory to directly employ the SOD approaches designed for nature scene images (NSIs) to RSIs. In this paper, we propose a novel Parallel Down-up Fusion network (PDF-Net) for SOD in optical RSIs, which takes full advantage of the in-path low- and high-level features and cross-path multi-resolution features to distinguish diversely scaled salient objects and suppress the cluttered backgrounds. To be specific, keeping a key observation that the salient objects still are salient no matter the resolutions of images are in mind, the PDF-Net takes successive down-sampling to form five parallel paths and perceive scaled salient objects that are commonly existed in optical RSIs. Meanwhile, we adopt the dense connections to take advantage of both low- and high-level information in the same path and build up the relations of cross paths, which explicitly yield strong feature representations. At last, we fuse the multiple-resolution features in parallel paths to combine the benefits of the features with different resolutions, i.e., the high-resolution feature consisting of complete structure and clear details while the low-resolution features highlighting the scaled salient objects. Extensive experiments on the ORSSD dataset demonstrate that the proposed network is superior to the state-of-the-art approaches both qualitatively and quantitatively. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:411 / 420
页数:10
相关论文
共 71 条
[1]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[2]   Saliency-Aware Nonparametric Foreground Annotation Based on Weakly Labeled Data [J].
Cao, Xiaochun ;
Zhang, Changqing ;
Fu, Huazhu ;
Guo, Xiaojie ;
Tian, Qi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (06) :1253-1265
[3]   Three-Stream Attention-Aware Network for RGB-D Salient Object Detection [J].
Chen, Hao ;
Li, Youfu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (06) :2825-2835
[4]   Multi-modal fusion network with multi-scale multi-path and cross-modal interactions for RGB-D salient object detection [J].
Chen, Hao ;
Li, Youfu ;
Su, Dan .
PATTERN RECOGNITION, 2019, 86 :376-385
[5]  
Chen ZY, 2020, AAAI CONF ARTIF INTE, V34, P10599
[6]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416
[7]   Saliency Detection for Stereoscopic Images Based on Depth Confidence Analysis and Multiple Cues Fusion [J].
Cong, Runmin ;
Lei, Jianjun ;
Zhang, Changqing ;
Huang, Qingming ;
Cao, Xiaochun ;
Hou, Chunping .
IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (06) :819-823
[8]   Going From RGB to RGBD Saliency: A Depth-Guided Transformation Model [J].
Cong, Runmin ;
Lei, Jianjun ;
Fu, Huazhu ;
Hou, Junhui ;
Huang, Qingming ;
Kwong, Sam .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (08) :3627-3639
[9]   HSCS: Hierarchical Sparsity Based Co-saliency Detection for RGBD Images [J].
Cong, Runmin ;
Lei, Jianjun ;
Fu, Huazhu ;
Huang, Qingming ;
Cao, Xiaochun ;
Ling, Nam .
IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (07) :1660-1671
[10]   Video Saliency Detection via Sparsity-Based Reconstruction and Propagation [J].
Cong, Runmin ;
Lei, Jianjun ;
Fu, Huazhu ;
Porikli, Fatih ;
Huang, Qingming ;
Hou, Chunping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (10) :4819-4831