Advances in graph neural network-based hyperspectral remote sensing image classification

被引:0
作者
Li, Jun [1 ]
Yu, Long [2 ]
Duan, Yilin [1 ]
Zhuo, Li [2 ]
机构
[1] Hubei Key Laboratory of Intelligent Geo-Information Processing, School of Computer Science, University of Geosciences, Wuhan
[2] School of Geography and Planning, Sun Yat-sen University, Guangzhou
关键词
classification; deep learning; graph convolutional networks; graph neural network; hyperspectral remote sensing;
D O I
10.11834/jrs.20254290
中图分类号
学科分类号
摘要
The rapid development of remote sensing technology has brought a variety of remote sensing data. Hyperspectral images, with the highest spectral resolution among these data, are always a crucial source for various Earth observation applications. In the field of computer vision, pattern recognition algorithms represented by deep learning also constantly developing and breaking through the limitations, providing more effective technologies for hyperspectral remote sensing applications. In recent years, Graph Neural Networks (GNNs) have been widely utilized in hyperspectral remote sensing image interpretation tasks, which can leverage the underlying relationships between samples to extract both local and global contextual information, producing high-precision classification results even with a limited number of labeled samples. This paper summarizes the most commonly used GNN frameworks from existing studies, analyzing the characteristics of these methods by decomposing their structures and categorizing them. We first extract the commonalities of existing GNN architectures and propose a basic module of GNN, which consists of an information aggregation function and a feature updating function. Building upon this module, we reinterpret various popular GNN architectures, including spectral-based Graph Convolutional Networks (GCNs), spatial-based GCNs, and Graph Autoencoders (GAEs). In the context of GAEs, current approaches are analyzed from three perspectives: loss functions, decoders, and graph reconstruction methods. These methods formulate loss functions to incorporate various graph-based constraints, thereby embodying the implicit assumptions and specific characteristics inherent to each method. Then, the analyses of GNN methods in the remote sensing field are conducted from three perspectives: graph connections, graph nodes, and network models. The existing research outcomes are classified based on the spatial range of connections, the information hierarchy of nodes, and the uncertainty of models. These GNN-based algorithms extract either local information or non-local information (e.g., global or local-global interactions) by using graph connections across different spatial ranges. The concept of non-local modeling has been extensively explored in GNNs over the past four years. Among GNNs with different node information hierarchies, approaches of using superpixels as graph node representations are the most prevalent. This is because superpixels can serve as a generalized form of node representation for other hierarchies, and their construction is relatively straightforward. Additionally, this paper introduces the application of GNNs in hyperspectral remote sensing image classification under varying modal and label quantities. For single-modal applications, we summarize the characteristics of several representative algorithms and provide their corresponding code implementations. For a limited number of multi-modal applications, we categorize and introduce methods based on the role of GNNs in multi-modal feature fusion. We conduct detailed analyses of the performance of GNN-based classification models in relevant literature, evaluating the applicability of these methods by considering the number of labeled samples and their corresponding classification accuracies. Furthermore, we elaborate on the theoretical foundations and integrated techniques of these models in the fields of supervised, semi-supervised, and unsupervised classification. Finally, the paper summarizes and looks forward to the frontier technologies of GNNs from three aspects: deep graph networks, GNN integrated with other deep learning techniques, and GNN-based foundation models, providing directions and insights for future research in the remote sensing field. © 2025 Science Press. All rights reserved.
引用
收藏
页码:1681 / 1704
页数:23
相关论文
共 134 条
[1]  
Abu-El-Haija S, Kapoor A, Perozzi B, Lee J., N-GCN: multiscale graph convolution for semi-supervised node classification, Proceedings of the 35th Uncertainty in Artificial Intelligence Conference, pp. 841-851, (2020)
[2]  
Ahmad M, Shabbir S, Roy S K, Hong D F, Wu X, Yao J, Khan A M, Mazzara M, Distefano S, Chanussot J., Hyperspectral image classification—Traditional to deep models: a survey for future prospects, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, pp. 968-999, (2022)
[3]  
Ahmedt-Aristizabal D, Armin M A, Denman S, Fookes C, Peters-son L., Graph-based deep learning for medical diagnosis and analysis: past, present and future, Sensors, 21, 14, (2021)
[4]  
Arun P V, Sadeh R, Avneri A, Tubul Y, Camino C, Buddhiraju K M, Porwal A, Lati R N, Zarco-Tejada P J, Peleg Z, Herrmann I., Multimodal Earth observation data fusion: graph-based approach in shared latent space, Information Fusion, 78, pp. 20-39, (2022)
[5]  
Atwood J, Towsley D., Diffusion-convolutional neural networks, Proceedings of the 30th International Conference on Neural Information Processing Systems, pp. 2001-2009, (2016)
[6]  
Baatz M, Schape A., Multiresolution segmentation: an optimization approach for high quality multi-scale image segmentation, Proceedings of Angewandte Geographische Informations-Verarbeitung, XII, 58, pp. 12-23, (2000)
[7]  
Bai J, Ding B X, Xiao Z, Jiao L C, Chen H Y, Regan A C., Hyperspectral image classification based on deep attention graph convolutional network, IEEE Transactions on Geoscience and Remote Sensing, 60, (2022)
[8]  
Belkin M, Niyogi P, Sindhwani V., Manifold Regularization: a geometric framework for learning from labeled and unlabeled examples, Journal of Machine Learning Research, 7, pp. 2399-2434, (2006)
[9]  
Bhatti U A, Huang M X, Neira-Molina H, Marjan S, Baryalai M, Tang H, Wu G L, Bazai S U., MFFCG-Multi feature fusion for hyperspectral image classification using graph attention network, Expert Systems with Applications, 229, (2023)
[10]  
Bhatti U A, Tang H, Wu G L, Marjan S, Hussain A., Deep learning with graph convolutional networks: an overview and latest applications in computational intelligence, International Journal of Intelligent Systems, 2023, 1, (2023)