Multi-scale receptive fields: Graph attention neural network for hyperspectral image classification

被引:85
作者
Ding, Yao [1 ]
Zhang, Zhili [1 ]
Zhao, Xiaofeng [1 ]
Hong, Danfeng [2 ]
Cai, Wei [1 ]
Yang, Nengjun [1 ]
Wang, Bei [1 ]
机构
[1] Xian Res Inst High Technol, Key Lab Opt Engn, Xian 710025, Peoples R China
[2] Chinese Acad Sci, Beijing 100094, Peoples R China
关键词
Hyperspectral image classification; Graph neural network; Graph attention neural network; Multi -scale receptive fields; Edges; -features; KERNEL; CNN; SAMPLE; SVM;
D O I
10.1016/j.eswa.2023.119858
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image (HSI) classification has attracted wide attention in many fields. Applying Graph Neural Network (GNN) to HSI classification is one of the research frontiers, which has improved the HSI classification accuracy greatly. However, GNN-based methods have not been widely applied due to their time-consuming, inefficient information description as well as poor anti-noise robustness. To overcome the deficiencies, a novel multi-scale receptive fields graph attention neural network (MRGAT) is proposed for HSI classification in this paper. In this network, a superpixel segment method is adopted to abstract the original HSI local spatial features. A two-layer one-dimensional convolution neural network (1D CNN) spectral transformer mechanism, is designed to extract the spectral features of superpixels, with which the spectral features can be acquired automatically. Furthermore, graph edges are introduced into Graph Attention Network (GAT) to acquire the local semantic feature of the graph. Moreover, inspired by the transformer network, we design a novel multi-scale receptive field GAT to extract the local-global adjacent node-features and edges-features. Finally, a graph attention network and a softMax function are utilized for multi-receptive feature fusion and pixel-label predicting. On Pavia University, Salinas, and Houston 2013 datasets, the overall accuracies (OAs) of our MRGAT are 71.76%, 82.61%, and 63.82%, respectively. Moreover, the performances with limited labeled samples indicates that the MRGAT contains superior adaptability. Compared with the competitive classifiers, MRGAT achieves high clas-sification efficiency verified by training time comparison experiment.
引用
收藏
页数:15
相关论文
共 65 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Graph Regularized Residual Subspace Clustering Network for hyperspectral image clustering
    Cai, Yaoming
    Zeng, Meng
    Cai, Zhihua
    Liu, Xiaobo
    Zhang, Zijia
    [J]. INFORMATION SCIENCES, 2021, 578 : 85 - 101
  • [3] BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image
    Cai, Yaoming
    Liu, Xiaobo
    Cai, Zhihua
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03): : 1969 - 1984
  • [4] Semi-supervised graph-based hyperspectral image classification
    Camps-Valls, Gustavo
    Bandos, Tatyana V.
    Zhou, Dengyong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (10): : 3044 - 3054
  • [5] Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine
    Chen, Chen
    Li, Wei
    Su, Hongjun
    Liu, Kui
    [J]. REMOTE SENSING, 2014, 6 (06) : 5795 - 5814
  • [6] Deep Learning-Based Classification of Hyperspectral Data
    Chen, Yushi
    Lin, Zhouhan
    Zhao, Xing
    Wang, Gang
    Gu, Yanfeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) : 2094 - 2107
  • [7] Dalal A.-A., 2022, EXPERT SYST APPL
  • [8] Ding Y., 2022, Neurocomputing
  • [9] Unsupervised Self-Correlated Learning Smoothy Enhanced Locality Preserving Graph Convolution Embedding Clustering for Hyperspectral Images
    Ding, Yao
    Zhang, Zhili
    Zhao, Xiaofeng
    Cai, Wei
    Yang, Nengjun
    Hu, Haojie
    Huang, Xianxiang
    Cao, Yuan
    Cai, Weiwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Self-Supervised Locality Preserving Low-Pass Graph Convolutional Embedding for Large-Scale Hyperspectral Image Clustering
    Ding, Yao
    Zhang, Zhili
    Zhao, Xiaofeng
    Cai, Yaoming
    Li, Siye
    Deng, Biao
    Cai, Weiwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60