Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3

被引:76
作者
Hong, Zhonghua [1 ,2 ]
Yang, Ting [1 ,2 ]
Tong, Xiaohua [4 ]
Zhang, Yun [1 ,2 ]
Jiang, Shenlu [3 ]
Zhou, Ruyan [1 ,2 ]
Han, Yanling [1 ,2 ]
Wang, Jing [1 ,2 ]
Yang, Shuhu [1 ,2 ]
Liu, Sichong [4 ]
机构
[1] Shanghai Ocean Univ, Coll Informat Technol, Shanghai 201306, Peoples R China
[2] Shanghai Ocean Univ, Key Lab Fisheries Informat, Minist Agr, Shanghai 201306, Peoples R China
[3] Chinese Univ Hong Kong, Space & Earth Informat Sci, Hong Kong, Peoples R China
[4] Tongji Univ, Coll Surveying & Geoinformat, Shanghai 200092, Peoples R China
基金
国家重点研发计划;
关键词
Marine vehicles; Optical imaging; Synthetic aperture radar; Optical sensors; Optical reflection; Adaptive optics; Object detection; Deep learning-based object detection; synthetic aperture radar (SAR) and optical imagery; ship detection; you only look once"version 3 (YOLOv3);
D O I
10.1109/JSTARS.2021.3087555
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep learning detection methods use in ship detection remains a challenge, owing to the small scale of the objects and interference from complex sea surfaces. In addition, existing ship detection methods rarely verify the robustness of their algorithms on multisensor images. Thus, we propose a new improvement on the "you only look once" version 3 (YOLOv3) framework for ship detection in marine surveillance, based on synthetic aperture radar (SAR) and optical imagery. First, improved choices are obtained for the anchor boxes by using linear scaling based on the k-means++ algorithm. This addresses the difficulty in reflecting the advantages of YOLOv3's multiscale detection, as the anchor boxes of a single detection target type between different detection scales have small differences. Second, we add uncertainty estimators for the positioning of the bounding boxes by introducing a Gaussian parameter for ship detection into the YOLOv3 framework. Finally, four anchor boxes are allocated to each detection scale in the Gaussian-YOLO layer instead of three as in the default YOLOv3 settings, as there are wide disparities in an object's size and direction in remote sensing images with different resolutions. Applying the proposed strategy to ``YOLOv3-spp" and ``YOLOv3-tiny," the results are enhanced by 2%-3%. Compared with other models, the improved-YOLOv3 has the highest average precision on both the optical (93.56%) and SAR (95.52%) datasets. The improved-YOLOv3 is robust, even in the context of a mixed dataset of SAR and optical images comprising images from different satellites and with different scales.
引用
收藏
页码:6083 / 6101
页数:19
相关论文
共 37 条
  • [21] Lightweight algorithm for multi-scale ship detection based on high-resolution SAR images
    Kong, Weimin
    Liu, Shanwei
    Xu, Mingming
    Yasir, Muhammad
    Wang, Dawei
    Liu, Wantao
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (04) : 1390 - 1415
  • [22] Ship detection based on fused features and rebuilt YOLOv3 networks in optical remote-sensing images
    Wang, Qin
    Shen, Fengyi
    Cheng, Lifu
    Jiang, Jianfei
    He, Guanghui
    Sheng, Weiguang
    Jing, Naifeng
    Mao, Zhigang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (02) : 520 - 536
  • [23] MSFA-YOLO: A Multi-Scale SAR Ship Detection Algorithm Based on Fused Attention
    Zhao, Liangjun
    Ning, Feng
    Xi, Yubin
    Liang, Gang
    He, Zhongliang
    Zhang, Yuanyang
    IEEE ACCESS, 2024, 12 : 24554 - 24568
  • [24] Multi-Scale Safety Helmet Detection Based on RSSE-YOLOv3
    Song, Hongru
    SENSORS, 2022, 22 (16)
  • [25] PPA-Net: Pyramid Pooling Attention Network for Multi-Scale Ship Detection in SAR Images
    Tang, Gang
    Zhao, Hongren
    Claramunt, Christophe
    Zhu, Weidong
    Wang, Shiming
    Wang, Yide
    Ding, Yuehua
    REMOTE SENSING, 2023, 15 (11)
  • [26] NAS-YOLOX: a SAR ship detection using neural architecture search and multi-scale attention
    Wang, Hao
    Han, Dezhi
    Cui, Mingming
    Chen, Chongqing
    CONNECTION SCIENCE, 2023, 35 (01) : 1 - 32
  • [27] Multi-Scale Rotation-Invariant Haar-Like Feature Integrated CNN-Based Ship Detection Algorithm of Multiple-Target Environment in SAR Imagery
    Ai, Jiaqiu
    Tian, Ruitian
    Luo, Qiwu
    Jin, Jing
    Tang, Bo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12): : 10070 - 10087
  • [28] Multi-Scale Safety Helmet Detection Based on SAS-YOLOv3-Tiny
    Cheng, Rao
    He, Xiaowei
    Zheng, Zhonglong
    Wang, Zhentao
    APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [29] MSSDet: Multi-Scale Ship-Detection Framework in Optical Remote-Sensing Images and New Benchmark
    Chen, Weiming
    Han, Bing
    Yang, Zheng
    Gao, Xinbo
    REMOTE SENSING, 2022, 14 (21)
  • [30] SFRT-DETR:A SAR ship detection algorithm based on feature selection and multi-scale feature focus
    Cao, Jie
    Han, Penghui
    Liang, Haopeng
    Niu, Yu
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)