Local aggregation and global attention network for hyperspectral image classification with spectral-induced aligned superpixel segmentation

被引:50
作者
Chen, Zhonghao [1 ]
Wu, Guoyong [1 ]
Gao, Hongmin [1 ]
Ding, Yao [2 ]
Hong, Danfeng [3 ]
Zhang, Bing [4 ,5 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Peoples R China
[2] Xian Res Inst High Technol, Xian 710025, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[4] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[5] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Hyperspectral (HS) image; Graph neural networks; Classification; Superpixel segmentation; Transformer; FRAMEWORK; CNN;
D O I
10.1016/j.eswa.2023.120828
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, graph neural networks (GNNs) have been demonstrated to be a promising framework in investigating non-Euclidean dependency in hyperspectral (HS) images. Since the extraction of inter-pixel relationships using GNNs is computationally intensive, the mainstream GNN-based HS image classification (HSIC) methods often segment original images into superpixels as nodes for further graph propagation. Nevertheless, the low representation of raw spectral signatures limits the segmentation accuracy. Moreover, the preexisting GNN-based approaches have failed to consider the importance between long-range nodes. In this article, we firstly propose a novel superpixel generate strategy, called spectral-induced aligned superpixel segmentation, which can utilize the segmentation results of HS image with raw and deep abstract spectral feature simultaneously. More specifically, the deep spectral feature is excavated by a deep autoencoder. Intuitively, two fusion strategies: minimum and maximum fusion are further explored to integrate above segmentation results. Furthermore, we propose a local aggregation and global attention block (LAGAB) by incorporating graph sample and aggregate strategy and graph transformer to hierarchically explore local and global spatial features. Note that due to the aggregation of node information in the local neighborhood, the further used graph transformer can adaptively model intra-neighbor information. Consequently, a network formed by LAGABs is developed for HSIC. Comprehensive experiments conducted on four highly regarded HS data sets reveal that the proposed method exhibits promising classification performance.
引用
收藏
页数:15
相关论文
共 55 条
[31]   Multilevel Superpixel Structured Graph U-Nets for Hyperspectral Image Classification [J].
Liu, Qichao ;
Xiao, Liang ;
Yang, Jingxiang ;
Wei, Zhihui .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[32]   Dense Dilated Convolutions Merging Network for Land Cover Classification [J].
Liu, Qinghui ;
Kampffmeyer, Michael ;
Jenssen, Robert ;
Salberg, Arnt-Borre .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (09) :6309-6320
[33]   PSASL: Pixel-Level and Superpixel-Level Aware Subspace Learning for Hyperspectral Image Classification [J].
Mei, Jie ;
Wang, Yuebin ;
Zhang, Liqiang ;
Zhang, Bing ;
Liu, Suhong ;
Zhu, Panpan ;
Ren, Yingchao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (07) :4278-4293
[34]   Classification of hyperspectral remote sensing images with support vector machines [J].
Melgani, F ;
Bruzzone, L .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2004, 42 (08) :1778-1790
[35]   Deep Pyramidal Residual Networks for Spectral-Spatial Hyperspectral Image Classification [J].
Paoletti, Mercedes E. ;
Mario Haut, Juan ;
Fernandez-Beltran, Ruben ;
Plaza, Javier ;
Plaza, Antonio J. ;
Pla, Filiberto .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (02) :740-754
[36]   Spectral-Spatial Graph Convolutional Networks for Semisupervised Hyperspectral Image Classification [J].
Qin, Anyong ;
Shang, Zhaowei ;
Tian, Jinyu ;
Wang, Yulong ;
Zhang, Taiping ;
Tang, Yuan Yan .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (02) :241-245
[37]   HybridSN: Exploring 3-D-2-D CNN Feature Hierarchy for Hyperspectral Image Classification [J].
Roy, Swalpa Kumar ;
Krishna, Gopal ;
Dubey, Shiv Ram ;
Chaudhuri, Bidyut B. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (02) :277-281
[38]   Classification of VHR Multispectral Images Using ExtraTrees and Maximally Stable Extremal Region-Guided Morphological Profile [J].
Samat, Alim ;
Persello, Claudio ;
Liu, Sicong ;
Li, Erzhu ;
Miao, Zelang ;
Abuduwaili, Jilili .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (09) :3179-3195
[39]  
Shahraki FF, 2018, IEEE GLOB CONF SIG, P968, DOI 10.1109/GlobalSIP.2018.8645969
[40]  
Shi YS, 2021, Arxiv, DOI arXiv:2009.03509