Boosting Ship Detection in SAR Images With Complementary Pretraining Techniques

被引:44
作者
Bao, Wei [1 ,2 ]
Huang, Meiyu [1 ]
Zhang, Yaqin [1 ,3 ]
Xu, Yao [1 ]
Liu, Xuejiao [1 ]
Xiang, Xueshuang [1 ]
机构
[1] China Acad Space Technol, Qian Xuesen Lab Space Technol, Beijing 100094, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect Engn, Beijing 100811, Peoples R China
[3] Xiangtan Univ, Sch Math & Computat Sci, Xiangtan 411105, Peoples R China
基金
中国国家自然科学基金;
关键词
Marine vehicles; Detectors; Optical imaging; Radar polarimetry; Synthetic aperture radar; Feature extraction; Optical detectors; Common representation learning; optical ship detector (OSD) pretraining; optical-SAR matching (OSM) pretraining; ship detection; weighted boxes fusion (WBF);
D O I
10.1109/JSTARS.2021.3109002
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep learning methods have made significant progress in ship detection in synthetic aperture radar (SAR) images. The pretraining technique is usually adopted to support deep neural networks-based SAR ship detectors due to the scarce labeled SAR images. However, directly leveraging ImageNet pretraining is hard to obtain a good ship detector because of different imaging perspectives and geometry. In this article, to resolve the problem of inconsistent imaging perspectives between ImageNet and earth observations, we propose an optical ship detector (OSD) pretraining technique to transfer the characteristics of ships in earth observations to SAR images from a large-scale aerial image dataset. On the other hand, to handle the problem of different imaging geometry between optical and SAR images, we propose an optical-SAR matching (OSM) pretraining technique, which transfers plentiful texture features from optical images to SAR images by common representation learning on the OSM task. Finally, observing that the OSD pretraining-based SSD has a better recall on sea area while the OSM pretraining-based SSD can reduce false alarms on land area, we combine the predictions of the two detectors through weighted boxes fusion to further improve detection results. Extensive experiments on four SAR ship detection datasets and three representative convolutional neural network-based detection benchmarks are conducted to show the effectiveness and complementarity of the two proposed detectors, and the state-of-the-art performance of the combination of the two detectors. The proposed method won the sixth place of ship detection in SAR images in the 2020 Gaofen challenge.
引用
收藏
页码:8941 / 8954
页数:14
相关论文
共 45 条
[1]   DRBox-v2: An Improved Detector With Rotatable Boxes for Target Detection in SAR Images [J].
An, Quanzhi ;
Pan, Zongxu ;
Liu, Lei ;
You, Hongjian .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (11) :8333-8349
[2]  
Bochkovskiy A., 2020, Technical Report
[3]   Soft-NMS - Improving Object Detection With One Line of Code [J].
Bodla, Navaneeth ;
Singh, Bharat ;
Chellappa, Rama ;
Davis, Larry S. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5562-5570
[4]   Ship Surveillance With TerraSAR-X [J].
Brusch, Stephan ;
Lehner, Susanne ;
Fritz, Thomas ;
Soccorsi, Matteo ;
Soloviev, Alexander ;
van Schie, Bart .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (03) :1092-1103
[5]   Cascade R-CNN: Delving into High Quality Object Detection [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6154-6162
[6]   Wide-Area Traffic Monitoring With the SAR/GMTI System PAMIR [J].
Cerutti-Maori, Delphine ;
Klare, Jens ;
Brenner, Andreas R. ;
Ender, Joachim H. G. .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2008, 46 (10) :3019-3030
[7]   R2FA-Det: Delving into High-Quality Rotatable Boxes for Ship Detection in SAR Images [J].
Chen, Shiqi ;
Zhang, Jun ;
Zhan, Ronghui .
REMOTE SENSING, 2020, 12 (12)
[8]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415
[9]   Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images [J].
Cui, Zongyong ;
Li, Qi ;
Cao, Zongjie ;
Liu, Nengyuan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (11) :8983-8997
[10]   Learning RoI Transformer for Oriented Object Detection in Aerial Images [J].
Ding, Jian ;
Xue, Nan ;
Long, Yang ;
Xia, Gui-Song ;
Lu, Qikai .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2844-2853