Boundary-Aware Network With Two-Stage Partial Decoders for Salient Object Detection in Remote Sensing Images

被引:10
作者
Zheng, Qingping [1 ]
Zheng, Ling [2 ]
Bai, Yunpeng [3 ]
Liu, Hang [1 ]
Deng, Jiankang [4 ]
Li, Ying [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Xian 710072, Peoples R China
[2] Fuzhou Inst Data Technol, Fuzhou 350200, Peoples R China
[3] Aberystwyth Univ, Dept Comp Sci, Xian 710072, Peoples R China
[4] Imperial Coll London, Dept Comp, London SW7 2AZ, England
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Optical sensors; Optical imaging; Decoding; Object detection; Remote sensing; Image edge detection; Optical fiber networks; Boundary-aware network (BANet) with two-stage partial decoder; optical remote sensing image (RSI); salient object detection (SOD);
D O I
10.1109/TGRS.2023.3260825
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Salient object detection (SOD) is a binary pixelwise classification to distinguish objects in an image and also has attracted many research interests in the optical remote sensing images (RSIs). The existing state-of-the-art method exploits the full encoder-decoder architecture to predict salient objects in the optical RSIs, suffering from the problem of unsmooth edges and incomplete structures. To address these problems, in this article, we propose a boundary-aware network (BANet) with two-stage partial decoders sharing the same encoders for SOD in RSIs. Specifically, a boundary-aware partial decoder (BAD) is introduced at the first stage to focus on learning clear edges of salient objects. To solve the pixel-imbalance problem between boundary and background, an edge-aware loss is proposed to guide learning the BAD network. The resulting features are then used in turn to enhance high-level features. Afterward, the structure-aware partial decoder (SAD) is further introduced at the second stage to improve the structure integrity of salient objects. To alleviate the problem of incomplete structures, the structural-similarity loss is further proposed to supervise learning the SAD network. In a consequence, our proposed BANet can predict salient objects with clear edges and complete structure, while reducing model parameters due to the discardment of low-level features. Besides, training a deep neural network requires a large amount of images, and the current benchmark datasets for optical RSIs are not large enough. Therefore, we also create a large-scale challenging dataset for SOD in RSIs. Extensive experiments demonstrate that our proposed BANet outperforms previous RSI SOD models on all the existing benchmark datasets and our new presented dataset available at https://github.com/QingpingZheng/RSISOD.
引用
收藏
页数:13
相关论文
共 43 条
  • [1] Context-aware saliency detection for image retargeting using convolutional neural networks
    Ahmadi, Mahdi
    Karimi, Nader
    Samavi, Shadrokh
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (08) : 11917 - 11941
  • [2] Remote Sensing Image Scene Classification: Benchmark and State of the Art
    Cheng, Gong
    Han, Junwei
    Lu, Xiaoqiang
    [J]. PROCEEDINGS OF THE IEEE, 2017, 105 (10) : 1865 - 1883
  • [3] Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images
    Cheng, Gong
    Zhou, Peicheng
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12): : 7405 - 7415
  • [4] RRNet: Relational Reasoning Network With Parallel Multiscale Attention for Salient Object Detection in Optical Remote Sensing Images
    Cong, Runmin
    Zhang, Yumo
    Fang, Leyuan
    Li, Jun
    Zhao, Yao
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Review of Visual Saliency Detection With Comprehensive Information
    Cong, Runmin
    Lei, Jianjun
    Fu, Huazhu
    Cheng, Ming-Ming
    Lin, Weisi
    Huang, Qingming
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (10) : 2941 - 2959
  • [6] A tutorial on the cross-entropy method
    De Boer, PT
    Kroese, DP
    Mannor, S
    Rubinstein, RY
    [J]. ANNALS OF OPERATIONS RESEARCH, 2005, 134 (01) : 19 - 67
  • [7] Structure-measure: A New Way to Evaluate Foreground Maps
    Fan, Deng-Ping
    Cheng, Ming-Ming
    Liu, Yun
    Li, Tao
    Borji, Ali
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 4558 - 4567
  • [8] Salient Remote Sensing Image Segmentation Based on Rate-Distortion Measure
    Faur, Daniela
    Gavat, Inge
    Datcu, Mihai
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) : 855 - 859
  • [9] Heo Y., 2021, P IEEECVF C COMPUTER, P7322
  • [10] Hong D., 2021, IEEE T GEOSCI REMOTE, V60, p1 15, DOI [DOI 10.1109/TGRS.2021.3130716, 10.1109/TGRS.2021.3130716, 10.1109/tgrs.2021.3130716]