Local aggregation and global attention network for hyperspectral image classification with spectral-induced aligned superpixel segmentation

被引:42
作者
Chen, Zhonghao [1 ]
Wu, Guoyong [1 ]
Gao, Hongmin [1 ]
Ding, Yao [2 ]
Hong, Danfeng [3 ]
Zhang, Bing [4 ,5 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Peoples R China
[2] Xian Res Inst High Technol, Xian 710025, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[4] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[5] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Hyperspectral (HS) image; Graph neural networks; Classification; Superpixel segmentation; Transformer; FRAMEWORK; CNN;
D O I
10.1016/j.eswa.2023.120828
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, graph neural networks (GNNs) have been demonstrated to be a promising framework in investigating non-Euclidean dependency in hyperspectral (HS) images. Since the extraction of inter-pixel relationships using GNNs is computationally intensive, the mainstream GNN-based HS image classification (HSIC) methods often segment original images into superpixels as nodes for further graph propagation. Nevertheless, the low representation of raw spectral signatures limits the segmentation accuracy. Moreover, the preexisting GNN-based approaches have failed to consider the importance between long-range nodes. In this article, we firstly propose a novel superpixel generate strategy, called spectral-induced aligned superpixel segmentation, which can utilize the segmentation results of HS image with raw and deep abstract spectral feature simultaneously. More specifically, the deep spectral feature is excavated by a deep autoencoder. Intuitively, two fusion strategies: minimum and maximum fusion are further explored to integrate above segmentation results. Furthermore, we propose a local aggregation and global attention block (LAGAB) by incorporating graph sample and aggregate strategy and graph transformer to hierarchically explore local and global spatial features. Note that due to the aggregation of node information in the local neighborhood, the further used graph transformer can adaptively model intra-neighbor information. Consequently, a network formed by LAGABs is developed for HSIC. Comprehensive experiments conducted on four highly regarded HS data sets reveal that the proposed method exhibits promising classification performance.
引用
收藏
页数:15
相关论文
共 55 条
  • [1] A Fast and Compact 3-D CNN for Hyperspectral Image Classification
    Ahmad, Muhammad
    Khan, Adil Mehmood
    Mazzara, Manuel
    Distefano, Salvatore
    Ali, Mohsin
    Sarfraz, Muhammad Shahzad
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [2] Hyperspectral Image Classification Based on Deep Attention Graph Convolutional Network
    Bai, Jing
    Ding, Bixiu
    Xiao, Zhu
    Jiao, Licheng
    Chen, Hongyang
    Regan, Amelia C.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Classification of hyperspectral data from urban areas based on extended morphological profiles
    Benediktsson, JA
    Palmason, JA
    Sveinsson, JR
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2005, 43 (03): : 480 - 491
  • [4] Hyperspectral Image Classification With Markov Random Fields and a Convolutional Neural Network
    Cao, Xiangyong
    Zhou, Feng
    Xu, Lin
    Meng, Deyu
    Xu, Zongben
    Paisley, John
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (05) : 2354 - 2367
  • [5] A pairwise decision tree framework for hyperspectral classification
    Chen, J.
    Wang, R.
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2007, 28 (12) : 2821 - 2830
  • [6] Chen Ming, 2020, P MACHINE LEARNING R, V119
  • [7] Hyperspectral Image Classification Using Dictionary-Based Sparse Representation
    Chen, Yi
    Nasrabadi, Nasser M.
    Tran, Trac D.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (10): : 3973 - 3985
  • [8] Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks
    Chen, Yushi
    Jiang, Hanlu
    Li, Chunyang
    Jia, Xiuping
    Ghamisi, Pedram
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10): : 6232 - 6251
  • [9] Global to Local: A Hierarchical Detection Algorithm for Hyperspectral Image Target Detection
    Chen, Zhonghao
    Lu, Zhengtao
    Gao, Hongmin
    Zhang, Yiyan
    Zhao, Jia
    Hong, Danfeng
    Zhang, Bing
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Center Weighted Convolution and GraphSAGE Cooperative Network for Hyperspectral Image Classification
    Cui, Ying
    Shao, Chao
    Luo, Li
    Wang, Liguo
    Gao, Shan
    Chen, Liwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61