Separable Deep Graph Convolutional Network Integrated With CNN and Prototype Learning for Hyperspectral Image Classification

被引:15
作者
Lu, Yingjie [1 ]
Mei, Shaohui [1 ]
Xu, Fulin [1 ]
Ma, Mingyang [2 ]
Wang, Xiaofei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Informat & Commun Engn, Xian 710049, Shaanxi, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolutional neural networks; Prototypes; Hyperspectral imaging; Convolution; Data mining; Kernel; Attention mechanism; convolutional neural network (CNN); graph convolutional network (GCN); hyperspectral image (HSI) classification; prototype learning; NEURAL-NETWORKS;
D O I
10.1109/TGRS.2024.3390575
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Graph convolutional networks (GCNs) have garnered extensive attention in the realm of hyperspectral image (HSI) classification. However, due to the problem of oversmoothing caused by deep GCN, most of the existing GCN-based methods are limited to constructing shallow networks, thus only able to extract superficial features. Moreover, when existing shallow GCNs extend to a more deeper structure, the number of learnable parameters increases linearly, thus leading to poor generalization performance under limited training samples. To address the aforementioned issues, a separable deep GCN integrated with convolutional neural network and prototype learning (SDGCP) is proposed for HSI classification, which can extract effective global structural information of HSI without increasing the number of trainable parameters. Specifically, the spectral and spatial features, adaptively selected by the attention module, are encoded into the structure of a graph by the graph encoder with the assistance of the pixel-to-region mapping obtained from the simple linear iterative clustering (SLIC). Then, a separable deep graph convolution module, composed of feature extraction and deep feature propagation, is adopted to capture the long-range contextual relationships from HSI encoded as graph data, which is combined with locally complementary information extracted by CNN after decoding. Finally, to further boost the performance of classification under limited labeled samples, prototype learning with regularization terms is utilized to enhance the intraclass compactness and interclass separability of feature representations. Extensive experiments on three standard HSI datasets demonstrate the superiority of the proposed SDGCP over the state-of-the-art (SOTA) methods.
引用
收藏
页数:16
相关论文
共 50 条
[31]   Dilated Deep MPFormer Network for Hyperspectral Image Classification [J].
Wu, Qinggang ;
He, Mengkun ;
Huang, Wei ;
Zhu, Fubao .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 :1-5
[32]   Heterogeneous Transfer Learning for Hyperspectral Image Classification Based on Convolutional Neural Network [J].
He, Xin ;
Chen, Yushi ;
Ghamisi, Pedram .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05) :3246-3263
[33]   Multibranch Fusion: A Multibranch Attention Framework by Combining Graph Convolutional Network and CNN for Hyperspectral Image Classification [J].
Liu, Xun ;
Ng, Alex Hay-Man ;
Ge, Linlin ;
Lei, Fangyuan ;
Liao, Xuejiao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
[34]   CNN-Enhanced Hypergraph Attention Network for Hyperspectral Image Classification [J].
Cui, Ying ;
Luo, Li ;
Wang, Liguo ;
Gao, Shan ;
Zhao, Chunhui .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
[35]   Sandwich Convolutional Neural Network for Hyperspectral Image Classification Using Spectral Feature Enhancement [J].
Gao, Hongmin ;
Chen, Zhonghao ;
Li, Chenming .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :3006-3015
[36]   Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network [J].
Wan, Sheng ;
Gong, Chen ;
Zhong, Ping ;
Pan, Shirui ;
Li, Guangyu ;
Yang, Jian .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (01) :597-612
[37]   Broad Graph Convolutional Neural Network and Its Application in Hyperspectral Image Classification [J].
Wang, Haoyu ;
Cheng, Yuhu ;
Chen, C. L. Philip ;
Wang, Xuesong .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (02) :610-616
[38]   Content-Guided Convolutional Neural Network for Hyperspectral Image Classification [J].
Liu, Qichao ;
Xiao, Liang ;
Yang, Jingxiang ;
Chan, Jonathan Cheung-Wai .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (09) :6124-6137
[39]   Deep Ensemble CNN Method Based on Sample Expansion for Hyperspectral Image Classification [J].
Dong, Shuxian ;
Feng, Wei ;
Quan, Yinghui ;
Dauphin, Gabriel ;
Gao, Lianru ;
Xing, Mengdao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[40]   A Novel Method for Hyperspectral Image Classification: Deep Network With Adaptive Graph Structure Integration [J].
Yang, Bing ;
Cao, Feilong ;
Ye, Hailiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60