Advances in graph neural network-based hyperspectral remote sensing image classification

被引:0
作者
Li, Jun [1 ]
Yu, Long [2 ]
Duan, Yilin [1 ]
Zhuo, Li [2 ]
机构
[1] Hubei Key Laboratory of Intelligent Geo-Information Processing, School of Computer Science, University of Geosciences, Wuhan
[2] School of Geography and Planning, Sun Yat-sen University, Guangzhou
关键词
classification; deep learning; graph convolutional networks; graph neural network; hyperspectral remote sensing;
D O I
10.11834/jrs.20254290
中图分类号
学科分类号
摘要
The rapid development of remote sensing technology has brought a variety of remote sensing data. Hyperspectral images, with the highest spectral resolution among these data, are always a crucial source for various Earth observation applications. In the field of computer vision, pattern recognition algorithms represented by deep learning also constantly developing and breaking through the limitations, providing more effective technologies for hyperspectral remote sensing applications. In recent years, Graph Neural Networks (GNNs) have been widely utilized in hyperspectral remote sensing image interpretation tasks, which can leverage the underlying relationships between samples to extract both local and global contextual information, producing high-precision classification results even with a limited number of labeled samples. This paper summarizes the most commonly used GNN frameworks from existing studies, analyzing the characteristics of these methods by decomposing their structures and categorizing them. We first extract the commonalities of existing GNN architectures and propose a basic module of GNN, which consists of an information aggregation function and a feature updating function. Building upon this module, we reinterpret various popular GNN architectures, including spectral-based Graph Convolutional Networks (GCNs), spatial-based GCNs, and Graph Autoencoders (GAEs). In the context of GAEs, current approaches are analyzed from three perspectives: loss functions, decoders, and graph reconstruction methods. These methods formulate loss functions to incorporate various graph-based constraints, thereby embodying the implicit assumptions and specific characteristics inherent to each method. Then, the analyses of GNN methods in the remote sensing field are conducted from three perspectives: graph connections, graph nodes, and network models. The existing research outcomes are classified based on the spatial range of connections, the information hierarchy of nodes, and the uncertainty of models. These GNN-based algorithms extract either local information or non-local information (e.g., global or local-global interactions) by using graph connections across different spatial ranges. The concept of non-local modeling has been extensively explored in GNNs over the past four years. Among GNNs with different node information hierarchies, approaches of using superpixels as graph node representations are the most prevalent. This is because superpixels can serve as a generalized form of node representation for other hierarchies, and their construction is relatively straightforward. Additionally, this paper introduces the application of GNNs in hyperspectral remote sensing image classification under varying modal and label quantities. For single-modal applications, we summarize the characteristics of several representative algorithms and provide their corresponding code implementations. For a limited number of multi-modal applications, we categorize and introduce methods based on the role of GNNs in multi-modal feature fusion. We conduct detailed analyses of the performance of GNN-based classification models in relevant literature, evaluating the applicability of these methods by considering the number of labeled samples and their corresponding classification accuracies. Furthermore, we elaborate on the theoretical foundations and integrated techniques of these models in the fields of supervised, semi-supervised, and unsupervised classification. Finally, the paper summarizes and looks forward to the frontier technologies of GNNs from three aspects: deep graph networks, GNN integrated with other deep learning techniques, and GNN-based foundation models, providing directions and insights for future research in the remote sensing field. © 2025 Science Press. All rights reserved.
引用
收藏
页码:1681 / 1704
页数:23
相关论文
共 134 条
[51]  
Khlifi M K, Boulila W, Farah I R., Graph-based deep learning techniques for remote sensing applications: techniques, taxonomy, and applications—A comprehensive review, Computer Science Review, 50, (2023)
[52]  
Kipf T N, Welling M., Variational graph auto-encoders, Proceedings of the 30th Annual Conference on Neural Information Processing Systems, (2016)
[53]  
Kipf T N, Welling M., Semi-supervised classification with graph convolutional networks, Proceedings of the 5th International Conference on Learning Representations, pp. 1-14, (2017)
[54]  
Li C Y, Chen C Y, Carlson D, Carin L., Preconditioned stochastic gradient Langevin dynamics for deep neural networks, Proceedings of the 30th AAAI Conference on Artificial Intelligence, pp. 1788-1794, (2016)
[55]  
Li R Y, Wang S, Zhu F Y, Huang J Z., Adaptive graph convolutional neural networks, Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 3546-3553, (2018)
[56]  
Li S T, Li C Y, Kang X D., Development status and future prospects of multi-source remote sensing image fusion, National Remote Sensing Bulletin, 25, 1, pp. 148-166, (2021)
[57]  
Li W, Wang J J, Gao Y H, Zhang M M, Tao R, Zhang B., Graph-feature-enhanced selective assignment network for hyperspectral and multispectral data classification, IEEE Transactions on Geoscience and Remote Sensing, 60, (2022)
[58]  
Li W Z, Ahn S, Welling M., Scalable MCMC for mixed membership stochastic blockmodels, Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, pp. 723-731, (2016)
[59]  
Li X, Lv C Q, Wang W H, Li G, Yang L F, Yang J., Generalized focal loss: towards efficient representation learning for dense object detection, IEEE Transactions on Pattern Analysis and Machine Intelligence, 45, 3, pp. 3139-3153, (2023)
[60]  
Liu Q C, Xiao L, Yang J X, Wei Z H., CNN-enhanced graph convolutional network with pixel- and superpixel-level feature fusion for hyperspectral image classification, IEEE Transactions on Geoscience and Remote Sensing, 59, 10, pp. 8657-8671, (2021)