ADCG: A Cross-Modality Domain Transfer Learning Method for Synthetic Aperture Radar in Ship Automatic Target Recognition

被引:31
作者
Gao, Gui [1 ]
Dai, Yuxi [1 ]
Zhang, Xi [2 ]
Duan, Dingfeng [1 ]
Guo, Fei [3 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu 611756, Peoples R China
[2] Minist Nat Resources, Inst Oceanog 1, Lab Marine Phys & Remote Sensing, Qingdao 266061, Peoples R China
[3] Shanghai Inst Satellite Engn, Shanghai 200240, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Marine vehicles; Optical sensors; Optical imaging; Task analysis; Radar polarimetry; Target recognition; Transfer learning; Generative adversarial networks (GANs); image-to-image translation (I2IT); optical to SAR (OPT2SAR); ship classification; synthetic aperture radar (SAR);
D O I
10.1109/TGRS.2023.3313204
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Due to the powerful feature extraction and expression ability of convolutional neural networks (CNNs), exceptional success has been achieved in the field of ship automatic target recognition (ATR) of synthetic aperture radar (SAR). However, the CNNs cannot work effectively with sparse labeled samples and imbalanced categories. This study proposes a new attention-dense-CycleGAN (ADCG) method that is suitable for the ship transfer learning task from optical to SAR (OPT2SAR). The key improvement of the ADCG lies in the construction of a dense connection module (DCM) and a lightweight convolutional block attention module (CBAM). The DCM is able to overcome the problems of generator feature redundancy, large network model parameters, and severe training time in the original CycleGAN network. The lightweight CBAM can solve the problem of not being able to locate the main features of ships with a minimal increase in network parameters. Compared with the performance of other popular generative adversarial networks, the superior performance of the ADCG in the OPT2SAR transfer learning is demonstrated with the Frechet inception distance (FID) minimum of 76.04 and the Kernel inception distance (KID) minimum of 0.0403. Finally, the ability of pseudo-SAR domain images was tested to improve the recognition accuracy of popular ship classification networks, and this achieved an average improvement of 6% in recognition accuracy. Therefore, the results of this study verify the rationality, validity, and application value of pseudo-SAR domain in solving the problems of sparse marker samples and class imbalance in ship ATR network model.
引用
收藏
页数:14
相关论文
共 45 条
[1]  
Binkowski M., 2018, P IEEE C COMP VIS PA, P1
[2]   Integrating structured biological data by Kernel Maximum Mean Discrepancy [J].
Borgwardt, Karsten M. ;
Gretton, Arthur ;
Rasch, Malte J. ;
Kriegel, Hans-Peter ;
Schoelkopf, Bernhard ;
Smola, Alex J. .
BIOINFORMATICS, 2006, 22 (14) :E49-E57
[3]   Ship Surveillance With TerraSAR-X [J].
Brusch, Stephan ;
Lehner, Susanne ;
Fritz, Thomas ;
Soccorsi, Matteo ;
Soloviev, Alexander ;
van Schie, Bart .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (03) :1092-1103
[4]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415
[5]   Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images [J].
Cui, Zongyong ;
Li, Qi ;
Cao, Zongjie ;
Liu, Nengyuan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (11) :8983-8997
[6]   A Public Dataset for Fine-Grained Ship Classification in Optical Remote Sensing Images [J].
Di, Yanghua ;
Jiang, Zhiguo ;
Zhang, Haopeng .
REMOTE SENSING, 2021, 13 (04) :1-12
[7]   THE FRECHET DISTANCE BETWEEN MULTIVARIATE NORMAL-DISTRIBUTIONS [J].
DOWSON, DC ;
LANDAU, BV .
JOURNAL OF MULTIVARIATE ANALYSIS, 1982, 12 (03) :450-455
[8]  
Duan LX, 2009, PROC CVPR IEEE, P1375, DOI [10.1109/CVPRW.2009.5206747, 10.1109/CVPR.2009.5206747]
[9]   DAML: Domain Adaptation Metric Learning [J].
Geng, Bo ;
Tao, Dacheng ;
Xu, Chao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (10) :2980-2989
[10]  
Goodfellow I. J., 2014, P IEEE C COMP VIS PA, P18