Multi-scale receptive fields: Graph attention neural network for hyperspectral image classification

被引:101
作者
Ding, Yao [1 ]
Zhang, Zhili [1 ]
Zhao, Xiaofeng [1 ]
Hong, Danfeng [2 ]
Cai, Wei [1 ]
Yang, Nengjun [1 ]
Wang, Bei [1 ]
机构
[1] Xian Res Inst High Technol, Key Lab Opt Engn, Xian 710025, Peoples R China
[2] Chinese Acad Sci, Beijing 100094, Peoples R China
关键词
Hyperspectral image classification; Graph neural network; Graph attention neural network; Multi -scale receptive fields; Edges; -features; KERNEL; CNN; SAMPLE; SVM;
D O I
10.1016/j.eswa.2023.119858
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image (HSI) classification has attracted wide attention in many fields. Applying Graph Neural Network (GNN) to HSI classification is one of the research frontiers, which has improved the HSI classification accuracy greatly. However, GNN-based methods have not been widely applied due to their time-consuming, inefficient information description as well as poor anti-noise robustness. To overcome the deficiencies, a novel multi-scale receptive fields graph attention neural network (MRGAT) is proposed for HSI classification in this paper. In this network, a superpixel segment method is adopted to abstract the original HSI local spatial features. A two-layer one-dimensional convolution neural network (1D CNN) spectral transformer mechanism, is designed to extract the spectral features of superpixels, with which the spectral features can be acquired automatically. Furthermore, graph edges are introduced into Graph Attention Network (GAT) to acquire the local semantic feature of the graph. Moreover, inspired by the transformer network, we design a novel multi-scale receptive field GAT to extract the local-global adjacent node-features and edges-features. Finally, a graph attention network and a softMax function are utilized for multi-receptive feature fusion and pixel-label predicting. On Pavia University, Salinas, and Houston 2013 datasets, the overall accuracies (OAs) of our MRGAT are 71.76%, 82.61%, and 63.82%, respectively. Moreover, the performances with limited labeled samples indicates that the MRGAT contains superior adaptability. Compared with the competitive classifiers, MRGAT achieves high clas-sification efficiency verified by training time comparison experiment.
引用
收藏
页数:15
相关论文
共 65 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Graph Regularized Residual Subspace Clustering Network for hyperspectral image clustering [J].
Cai, Yaoming ;
Zeng, Meng ;
Cai, Zhihua ;
Liu, Xiaobo ;
Zhang, Zijia .
INFORMATION SCIENCES, 2021, 578 :85-101
[3]   BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image [J].
Cai, Yaoming ;
Liu, Xiaobo ;
Cai, Zhihua .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03) :1969-1984
[4]   Semi-supervised graph-based hyperspectral image classification [J].
Camps-Valls, Gustavo ;
Bandos, Tatyana V. ;
Zhou, Dengyong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (10) :3044-3054
[5]   Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine [J].
Chen, Chen ;
Li, Wei ;
Su, Hongjun ;
Liu, Kui .
REMOTE SENSING, 2014, 6 (06) :5795-5814
[6]   Deep Learning-Based Classification of Hyperspectral Data [J].
Chen, Yushi ;
Lin, Zhouhan ;
Zhao, Xing ;
Wang, Gang ;
Gu, Yanfeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) :2094-2107
[7]  
Dalal A.-A., 2022, EXPERT SYST APPL
[8]  
Ding Y., 2022, Neuro computing
[9]   Unsupervised Self-Correlated Learning Smoothy Enhanced Locality Preserving Graph Convolution Embedding Clustering for Hyperspectral Images [J].
Ding, Yao ;
Zhang, Zhili ;
Zhao, Xiaofeng ;
Cai, Wei ;
Yang, Nengjun ;
Hu, Haojie ;
Huang, Xianxiang ;
Cao, Yuan ;
Cai, Weiwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[10]   Self-Supervised Locality Preserving Low-Pass Graph Convolutional Embedding for Large-Scale Hyperspectral Image Clustering [J].
Ding, Yao ;
Zhang, Zhili ;
Zhao, Xiaofeng ;
Cai, Yaoming ;
Li, Siye ;
Deng, Biao ;
Cai, Weiwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60