Synthetic aperture radar image ship classification based on ViT-CNN hybrid network

被引：0

作者：

Shao, Ran ^{[1
,2
]}

Bi, Xiaojun ^{[3
,4
]}

机构：

[1] College of Information and Communication Engineering, Harbin Engineering University, Harbin

[2] College of Electronic and Information Engineering, Harbin Vocational & Technical College, Harbin

[3] Key Laboratory of Ethnic Language Intelligent Analysis and Security Governance of MOE, Minzu University of China, Beijing

[4] School of Information Engineering, Minzu University of China, Beijing

来源：

Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University | 2024年 / 45卷 / 08期

关键词：

convolutional neural network; deep learning; global feature; local feature; parameters sharing; ship image; synthetic aperture radar image; vision transformer;

D O I：

10.11990/jheu.202312026

中图分类号：

学科分类号：

摘要：

In recent years, vision transformer (ViT) has made significant breakthroughs in the field of image classification. However, it is difficult to adapt to the task of synthetic aperture radar image ship classification due to its lack of multiscale and local feature capture capability. For this reason, this paper proposes a hybrid network model for synthetic aperture radar image ship classification. A staged downsampling network structure is designed to solve the problem that ViT is unable to capture multi-scale features. By incorporating the convolutional structure into three core modules of the ViT model, three modules, namely, convolutional token embedding, convolutional parameters sharing attention, and local feed-forward network, are designed, which enable the network to capture both global and local features of the ship images, and further enhance the network's inductive biasing and feature extraction ability. Experimental results show that the proposed model in this paper improves the classification accuracy by 2. 96% and 4. 18% compared with the existing optimal method on two generalized SAR ship image datasets, OpenSARShip and FUSAR-Ship, respectively, which effectively improves the performance of SAR image ship classification. © 2024 Editorial Board of Journal of Harbin Engineering. All rights reserved.

引用

页码：1616 / 1623

页数：7

共 26 条

[1] ALEISSAEE A A, KUMAR A, ANWER R M, Et al., Transformers in remote sensing: a survey, Remote sensing, 15, 7, (2023)
[2] SNAPIR B, WAINE T, BIERMANN L., Maritime vessel classification to monitor fisheries with SAR: demonstration in the north sea, Remote sensing, pp. 353-367, (2019)
[3] XU Yongjie, LANG Haitao, NIU Lihui, Et al., Discriminative adaptation regularization framework-based transfer learning for ship classification in SAR images[ J], IEEE geoscience and remote sensing letters, 16, 11, pp. 1786-1790, (2019)
[4] TIENIN B W, CUI Guolong, UKWUOMA C C, Et al., MS3Net: a deep ensemble learning approach for ship classification in heterogeneous remote sensing data, International journal of remote sensing, 45, 3, pp. 748-771, (2024)
[5] JIANG Xinqiao, XIE Hongtu, LU Zheng, Et al., Energy-efficient and high-performance ship classification strategy based on Siamese spiking neural network in dual-polarized SAR images, Remote Sens, 15, (2023)
[6] WANG Yuanyuan, WANG Chao, ZHANG Hong, Ship classification in high-resolution SAR images using deep learning of small datasets [ J ], Sensors, 18, 9, (2018)
[7] HOU Xiyue, AO Wei, SONG Qian, Et al., FUSAR-Ship: building a high-resolution SAR-AIS matchup dataset of Gaofen-3 for ship detection and recognition, Science China information sciences, 63, 4, (2020)
[8] ZHANG Tianwen, ZHANG Xiaoling, KE Xiao, Et al., HOG-ShipCLSNet: a novel deep learning network with HOG feature fusion for SAR ship classification, IEEE transactions on geoscience and remote sensing, 60, (2022)
[9] ZHU Hairui, GUO Shanhong, SHENG Weixing, Et al., SBNN: a searched binary neural network for SAR ship classification [ J ], Applied sciences, 12, 14, (2022)
[10] ZHENG Hao, HU Zhigang, YANG Liu, Et al., Multifeature collaborative fusion network with deep supervision for SAR ship classification, IEEE transactions on geoscience and remote sensing, 61, (2023)

← 1 2 3 →