Remote Sensing Image Classification Based on a Cross-Attention Mechanism and Graph Convolution

被引:168
作者
Cai, Weiwei [1 ]
Wei, Zhanguo [1 ]
机构
[1] Cent South Univ Forestry, Sch Logist & Transportat, Changsha 410004, Peoples R China
关键词
Convolution; Hyperspectral imaging; Training; Feature extraction; Principal component analysis; Cross-attention mechanism (CAM); deep learning; graph convolution; DEEP NEURAL-NETWORK;
D O I
10.1109/LGRS.2020.3026587
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
An attention mechanism assigns different weights to different features to help a model select the features most valuable for accurate classification. However, the traditional attention mechanism algorithm often allocates weights in a one-way fashion, which can result in a loss of feature information. To obtain better hyperspectral data classification results, a novel cross-attention mechanism and graph convolution integration algorithm are proposed in this letter. First, principal component analysis is used to reduce the dimensionality of hyperspectral images to obtain low-dimensional features that are more expressive. Second, the model uses a cross (horizontal and vertical directions) attention algorithm to allocate weights jointly based on its two strategies; then, it adopts a graph convolution algorithm to generate the directional relationships between the features. Finally, the generated deep features and the relationship between the deep features are used to complete the prediction of hyperspectral data. Experiments on three well-known hyperspectral data setsx2014;Indian Pines, the University of Pavia, and Salinasx2014;show that the proposed algorithm achieves better performances than do other well-known algorithms using different methods of training set division.
引用
收藏
页数:5
相关论文
共 16 条
[1]   Siamese graph convolutional network for content based remote sensing image retrieval [J].
Chaudhuri, Ushasi ;
Banerjee, Biplab ;
Bhattacharya, Avik .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 184 :22-30
[2]   Deep Neural Network Based Hyperspectral Pixel Classification With Factorized Spectral-Spatial Feature Representation [J].
Chen, Jingzhou ;
Chen, Siyu ;
Zhou, Peilin ;
Qian, Yuntao .
IEEE ACCESS, 2019, 7 :81407-81418
[3]   Hyperspectral Image Classification With Pre-Activation Residual Attention Network [J].
Gao, Hongmin ;
Yang, Yao ;
Yao, Dan ;
Li, Chenming .
IEEE ACCESS, 2019, 7 :176587-176599
[4]  
Ibrahim MFI, 2016, CAIRO INT BIOM ENG, P68, DOI 10.1109/CIBEC.2016.7836122
[5]   Combining Multilevel Features for Remote Sensing Image Scene Classification With Attention Model [J].
Ji, Jinsheng ;
Zhang, Tao ;
Jiang, Linfeng ;
Zhong, Weilin ;
Xiong, Huilin .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (09) :1647-1651
[6]   Hyperspectral Image Classification Based on 3-D Separable ResNet and Transfer Learning [J].
Jiang, Yenan ;
Li, Ying ;
Zhang, Haokui .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (12) :1949-1953
[7]   Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network [J].
Li, Ying ;
Zhang, Haokui ;
Shen, Qiang .
REMOTE SENSING, 2017, 9 (01)
[8]   Deep Multilayer Fusion Dense Network for Hyperspectral Image Classification [J].
Li, Zhaokui ;
Wang, Tianning ;
Li, Wei ;
Du, Qian ;
Wang, Chuanyun ;
Liu, Cuiwei ;
Shi, Xiangbin .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :1258-1270
[9]   Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest [J].
Maretto, Raian, V ;
Fonseca, Leila M. G. ;
Jacobs, Nathan ;
Koerting, Thales S. ;
Bendini, Hugo N. ;
Parente, Leandro L. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) :771-775
[10]   Semisupervised Change Detection Using Graph Convolutional Network [J].
Saha, Sudipan ;
Mou, Lichao ;
Zhu, Xiao Xiang ;
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (04) :607-611