A Degraded Reconstruction Enhancement-Based Method for Tiny Ship Detection in Remote Sensing Images With a New Large-Scale Dataset

被引:47
作者
Chen, Jianqi [1 ,2 ,3 ]
Chen, Keyan [1 ,2 ,3 ]
Chen, Hao [1 ,2 ,3 ]
Zou, Zhengxia [4 ]
Shi, Zhenwei [1 ,2 ,3 ]
机构
[1] Beihang Univ, Sch Astronaut, Image Proc Ctr, Beijing 100191, Peoples R China
[2] Beihang Univ, Beijing Key Lab Digital Media, Beijing 100191, Peoples R China
[3] Beihang Univ, Sch Astronaut, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[4] Beihang Univ, Dept Guidance Nav & Control, Sch Astronaut, Beijing 100191, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Marine vehicles; Feature extraction; Detectors; Image reconstruction; Training; Remote sensing; Spatial resolution; Convolutional neural network (CNN); deep learning (DL); optical image; remote sensing (RS); ship detection; OBJECT DETECTION; CLASSIFICATION; SHAPE;
D O I
10.1109/TGRS.2022.3180894
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The rapid detection of ships within the wide sea area is essential for intelligence acquisition. Most modern deep learning-based ship detection methods focus on locating ships in high-resolution (HR) remote sensing (RS) images. Seldom efforts have been made on ship detection in medium-resolution (MR) RS images. An MR image covers a much wider area than an HR one of the same size, thus facilitating quick ship detection. To this end, we propose a tiny ship detection method, namely, the degraded reconstruction enhancement network (DRENet), for MR RS images. Different from previous methods that mainly focus on feature fusion strategies to improve the expression ability of the detector, we design an additional network branch, i.e., degraded reconstruction enhancer, to learn to regress an object-aware blurred version of the input image in the training phase. Our intuition is that the proposed reconstruction branch may guide the backbone to focus more on tiny ship targets instead of the vast background. Moreover, we incorporate a CRoss-stage Multi-head Attention module in the detector to further improve the feature discrimination by leveraging the self-attention mechanism. To fill the gap of lacking a large-scale MR ship detection dataset, we introduce LEVIR-Ship, which contains 3896 GF-1/GF-6 multispectral images and over 3k tiny ship instances. Experiments on LEVIR-Ship validate the effectiveness and efficiency of the proposed method. Our method achieves 82.4 AP with 85 FPS, which outperforms many state-of-the-art ship detection methods. Our code and dataset are available at https://github.com/WindVChen/DRENet.
引用
收藏
页数:14
相关论文
共 69 条
[1]  
Bochkovskiy A., 2020, PREPRINT
[2]   PCANet: A Simple Deep Learning Baseline for Image Classification? [J].
Chan, Tsung-Han ;
Jia, Kui ;
Gao, Shenghua ;
Lu, Jiwen ;
Zeng, Zinan ;
Ma, Yi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :5017-5032
[3]   Building Extraction from Remote Sensing Images with Sparse Token Transformers [J].
Chen, Keyan ;
Zou, Zhengxia ;
Shi, Zhenwei .
REMOTE SENSING, 2021, 13 (21)
[4]   Improved YOLOv3 Based on Attention Mechanism for Fast and Accurate Ship Detection in Optical Remote Sensing Images [J].
Chen, Liqiong ;
Shi, Wenxuan ;
Deng, Dexiang .
REMOTE SENSING, 2021, 13 (04) :1-18
[5]   A Novel Coarse-to-Fine Method of Ship Detection in Optical Remote Sensing Images Based on a Deep Residual Dense Network [J].
Chen, Liqiong ;
Shi, Wenxuan ;
Fan, Cien ;
Zou, Lian ;
Deng, Dexiang .
REMOTE SENSING, 2020, 12 (19)
[6]   Multi-class geospatial object detection and geographic image classification based on collection of part detectors [J].
Cheng, Gong ;
Han, Junwei ;
Zhou, Peicheng ;
Guo, Lei .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 98 :119-132
[7]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[8]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[9]   Effective Fusion Factor in FPN for Tiny Object Detection [J].
Gong, Yuqi ;
Yu, Xuehui ;
Ding, Yao ;
Peng, Xiaoke ;
Zhao, Jian ;
Han, Zhenjun .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, :1159-1167
[10]   A Multilayer Fusion Light-Head Detector for SAR Ship Detection [J].
Gui, Yunchuan ;
Li, Xiuhe ;
Xue, Lei .
SENSORS, 2019, 19 (05)