Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3

被引:76
作者
Hong, Zhonghua [1 ,2 ]
Yang, Ting [1 ,2 ]
Tong, Xiaohua [4 ]
Zhang, Yun [1 ,2 ]
Jiang, Shenlu [3 ]
Zhou, Ruyan [1 ,2 ]
Han, Yanling [1 ,2 ]
Wang, Jing [1 ,2 ]
Yang, Shuhu [1 ,2 ]
Liu, Sichong [4 ]
机构
[1] Shanghai Ocean Univ, Coll Informat Technol, Shanghai 201306, Peoples R China
[2] Shanghai Ocean Univ, Key Lab Fisheries Informat, Minist Agr, Shanghai 201306, Peoples R China
[3] Chinese Univ Hong Kong, Space & Earth Informat Sci, Hong Kong, Peoples R China
[4] Tongji Univ, Coll Surveying & Geoinformat, Shanghai 200092, Peoples R China
基金
国家重点研发计划;
关键词
Marine vehicles; Optical imaging; Synthetic aperture radar; Optical sensors; Optical reflection; Adaptive optics; Object detection; Deep learning-based object detection; synthetic aperture radar (SAR) and optical imagery; ship detection; you only look once"version 3 (YOLOv3);
D O I
10.1109/JSTARS.2021.3087555
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep learning detection methods use in ship detection remains a challenge, owing to the small scale of the objects and interference from complex sea surfaces. In addition, existing ship detection methods rarely verify the robustness of their algorithms on multisensor images. Thus, we propose a new improvement on the "you only look once" version 3 (YOLOv3) framework for ship detection in marine surveillance, based on synthetic aperture radar (SAR) and optical imagery. First, improved choices are obtained for the anchor boxes by using linear scaling based on the k-means++ algorithm. This addresses the difficulty in reflecting the advantages of YOLOv3's multiscale detection, as the anchor boxes of a single detection target type between different detection scales have small differences. Second, we add uncertainty estimators for the positioning of the bounding boxes by introducing a Gaussian parameter for ship detection into the YOLOv3 framework. Finally, four anchor boxes are allocated to each detection scale in the Gaussian-YOLO layer instead of three as in the default YOLOv3 settings, as there are wide disparities in an object's size and direction in remote sensing images with different resolutions. Applying the proposed strategy to ``YOLOv3-spp" and ``YOLOv3-tiny," the results are enhanced by 2%-3%. Compared with other models, the improved-YOLOv3 has the highest average precision on both the optical (93.56%) and SAR (95.52%) datasets. The improved-YOLOv3 is robust, even in the context of a mixed dataset of SAR and optical images comprising images from different satellites and with different scales.
引用
收藏
页码:6083 / 6101
页数:19
相关论文
共 37 条
  • [1] Rapid Ship Detection in SAR Images Based on YOLOv3
    Zhu, Mingming
    Hu, Guoping
    Zhou, Hao
    Lu, Chunguang
    2020 5TH INTERNATIONAL CONFERENCE ON COMMUNICATION, IMAGE AND SIGNAL PROCESSING (CCISP 2020), 2020, : 214 - 218
  • [2] Ship detection in SAR image based on improved YOLOv3
    Chen D.
    Ju Y.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2021, 43 (04): : 937 - 943
  • [3] Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images
    Cui, Zongyong
    Li, Qi
    Cao, Zongjie
    Liu, Nengyuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (11): : 8983 - 8997
  • [4] HIGH-SPEED SHIP DETECTION IN SAR IMAGES BY IMPROVED YOLOV3
    Zhang, Tianwen
    Zhang, Xiaoling
    Shi, Jun
    Wei, Shunjun
    2019 16TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICWAMTIP), 2019, : 149 - 152
  • [5] Multi-scale ship target detection using SAR images based on improved Yolov5
    Yasir, Muhammad
    Shanwei, Liu
    Mingming, Xu
    Hui, Sheng
    Hossain, Md Sakaouth
    Colak, Arife Tugsan Isiacik
    Wang, Dawei
    Jianhua, Wan
    Dang, Kinh Bac
    FRONTIERS IN MARINE SCIENCE, 2023, 9
  • [6] Supervised Multi-Scale Attention-Guided Ship Detection in Optical Remote Sensing Images
    Hu, Jianming
    Zhi, Xiyang
    Jiang, Shikai
    Tang, Hao
    Zhang, Wei
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] An Improved YOLOv3 Model for Arbitrary-oriented Ship Detection in SAR Image
    Xu Y.
    Gu Y.
    Peng D.
    Liu J.
    Chen H.
    Binggong Xuebao/Acta Armamentarii, 2021, 42 (08): : 1698 - 1707
  • [8] Improved YOLOv3 Based on Attention Mechanism for Fast and Accurate Ship Detection in Optical Remote Sensing Images
    Chen, Liqiong
    Shi, Wenxuan
    Deng, Dexiang
    REMOTE SENSING, 2021, 13 (04) : 1 - 18
  • [9] Multi-Scale Proposal Generation for Ship Detection in SAR Images
    Liu, Nengyuan
    Cao, Zongjie
    Cui, Zongyong
    Pi, Yiming
    Dang, Sihang
    REMOTE SENSING, 2019, 11 (05)
  • [10] Vehicle Detection and Tracking in UAV Imagery via YOLOv3 and Kalman Filter
    Ali, Shuja
    Jalal, Ahmad
    Alatiyyah, Mohammed Hamad
    Alnowaiser, Khaled
    Park, Jeongmin
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (01): : 1249 - 1265