Attention Mask R-CNN for Ship Detection and Segmentation From Remote Sensing Images

被引:134
作者
Nie, Xuan [1 ]
Duan, Mengyang [1 ]
Ding, Haoxuan [2 ]
Hu, Bingliang [3 ]
Wong, Edward K. [4 ]
机构
[1] Northwestern Polytech Univ, Sch Software, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Power & Energy, Xian 710072, Peoples R China
[3] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Peoples R China
[4] NYU Tandon Sch Engn, Brooklyn, NY 11201 USA
关键词
Computer vision; object detection; object segmentation; remote sensing;
D O I
10.1109/ACCESS.2020.2964540
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, ship detection in satellite remote sensing images has become an important research topic. Most existing methods detect ships by using a rectangular bounding box but do not perform segmentation down to the pixel level. This paper proposes a ship detection and segmentation method based on an improved Mask R-CNN model. Our proposed method can accurately detect and segment ships at the pixel level. By adding a bottom-up structure to the FPN structure of Mask R-CNN, the path between the lower layers and the topmost layer is shortened, allowing the lower layer features to be more effectively utilized at the top layer. In the bottom-up structure, we use channel-wise attention to assign weights in each channel and use the spatial attention mechanism to assign a corresponding weight at each pixel in the feature maps. This allows the feature maps to respond better to the target's features. Using our method, the detection and segmentation mAPs increased from 70.6% and 62.0% to 76.1% and 65.8%, respectively.
引用
收藏
页码:9325 / 9334
页数:10
相关论文
共 45 条
  • [1] [Anonymous], P 2 INT C LEARN REPR
  • [2] [Anonymous], AIRB SHIP DET CHALL
  • [3] [Anonymous], J RADARS
  • [4] [Anonymous], 2018, SUSTAINABILITY-BASEL
  • [5] [Anonymous], P 4 INT WORKSH EARTH
  • [6] [Anonymous], P IEEE 13 INT C SIGN
  • [7] Ship Detection Based on YOLOv2 for SAR Imagery
    Chang, Yang-Lang
    Anagaw, Amare
    Chang, Lena
    Wang, Yi Chun
    Hsiao, Chih-Yu
    Lee, Wei-Hong
    [J]. REMOTE SENSING, 2019, 11 (07)
  • [8] SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning
    Chen, Long
    Zhang, Hanwang
    Xiao, Jun
    Nie, Liqiang
    Shao, Jian
    Liu, Wei
    Chua, Tat-Seng
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6298 - 6306
  • [9] FusionNet: Edge Aware Deep Convolutional Networks for Semantic Segmentation of Remote Sensing Harbor Images
    Cheng, Dongcai
    Meng, Gaofeng
    Xiang, Shiming
    Pan, Chunhong
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (12) : 5769 - 5783
  • [10] Multi-Context Attention for Human Pose Estimation
    Chu, Xiao
    Yang, Wei
    Ouyang, Wanli
    Ma, Cheng
    Yuille, Alan L.
    Wang, Xiaogang
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5669 - 5678