Oriented Ship Detector for Remote Sensing Imagery Based on Pairwise Branch Detection Head and SAR Feature Enhancement

被引:11
作者
He, Bokun [1 ]
Zhang, Qingyi [1 ]
Tong, Ming [1 ]
He, Chu [1 ]
机构
[1] Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
ship detection; deep learning; remote sensing imagery; SAR feature enhancement; pairwise head; EDGES;
D O I
10.3390/rs14092177
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Recently, object detection in natural images has made a breakthrough, but it is still challenging in oriented ship detection for remote sensing imagery. Considering some limitations in this task, such as uncertain ship orientation, unspecific features for locating and classification in the complex optical environment, and multiplicative speckle interference of synthetic aperture radar (SAR), we propose an oriented ship detector based on the pairwise branch detection head and adaptive SAR feature enhancement. The details are as follows: (1) Firstly, the ships with arbitrary directions are described with a rotated ground truth, and an oriented region proposal network (ORPN) is designed to study the transformation from the horizontal region of interest to the rotated region of interest. The ORPN effectively improved the quality of the candidate area while only introducing a few parameters. (2) In view of the existing algorithms that tend to perform classification and regression prediction on the same output feature, this paper proposes a pairwise detection head (PBH) to design parallel branches to decouple classification and locating tasks, so that each branch can learn more task-specific features. (3) Inspired by the ratio-of-average detector in traditional SAR image processing, the SAR edge enhancement (SEE) module is proposed, which adaptively enhances edge pixels, and the threshold of the edge is learned by the channel-shared adaptive thresholds block. Experiments were carried out on both optical and SAR datasets. In the optical dataset, PBH combined with ORPN improved recall by 5.03%, and in the SAR dataset, the overall method achieved a maximum F1 score improvement of 6.07%; these results imply the validity of our method.
引用
收藏
页数:21
相关论文
共 46 条
[21]   Ship Rotated Bounding Box Space for Ship Extraction From High-Resolution Optical Satellite Images With Complex Backgrounds [J].
Liu, Zikun ;
Wang, Hongzhen ;
Weng, Lubin ;
Yang, Yiping .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (08) :1074-1078
[22]  
Long J., 2015, Fully convolutional networks for semantic segmentation, P3431, DOI 10.1109/CVPR.2015.7298965
[23]   Distinctive image features from scale-invariant keypoints [J].
Lowe, DG .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :91-110
[24]   Arbitrary-Oriented Scene Text Detection via Rotation Proposals [J].
Ma, Jianqi ;
Shao, Weiyuan ;
Ye, Hao ;
Wang, Li ;
Wang, Hong ;
Zheng, Yingbin ;
Xue, Xiangyang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (11) :3111-3122
[25]  
NguyenNguyen T, 2019, IEEE I CONF COMP VIS
[26]   Unsupervised Ship Detection Based on Saliency and S-HOG Descriptor From Optical Satellite Images [J].
Qi, Shengxiang ;
Ma, Jie ;
Lin, Jin ;
Li, Yansheng ;
Tian, Jinwen .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (07) :1451-1455
[27]  
Redmon J, 2018, Arxiv, DOI arXiv:1804.02767
[28]  
Ren S, 2015, PROC ADVNEURAL INF P
[29]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[30]  
Setiawan Budi Darma, 2017, 2017 International Symposium on Geoinformatics (ISyG), P72, DOI 10.1109/ISYG.2017.8280676