Remote Sensing LiDAR and Hyperspectral Classification with Multi-Scale Graph Encoder-Decoder Network

被引:3
作者
Wang, Fang [1 ]
Du, Xingqian [2 ]
Zhang, Weiguang [1 ]
Nie, Liang [1 ]
Wang, Hu [1 ,3 ,4 ,5 ]
Zhou, Shun [1 ]
Ma, Jun [6 ]
机构
[1] Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China
[2] China Acad Space Technol Xian, Xian 710100, Peoples R China
[3] Xian Inst Opt & Precis Mech CAS, Xian 710119, Peoples R China
[4] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[5] Xian Space Sensor Opt Technol Engn Res Ctr, Xian 710119, Peoples R China
[6] Xian Technol Univ, Inst Interdisciplinary & Innovat Res, Xian 710021, Peoples R China
关键词
LiDAR; hyperspectral image; multi-modal data fusion; graph model; deep learning;
D O I
10.3390/rs16203912
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The rapid development of sensor technology has made multi-modal remote sensing data valuable for land cover classification due to its diverse and complementary information. Many feature extraction methods for multi-modal data, combining light detection and ranging (LiDAR) and hyperspectral imaging (HSI), have recognized the importance of incorporating multiple spatial scales. However, effectively capturing both long-range global correlations and short-range local features simultaneously on different scales remains a challenge, particularly in large-scale, complex ground scenes. To address this limitation, we propose a multi-scale graph encoder-decoder network (MGEN) for multi-modal data classification. The MGEN adopts a graph model that maintains global sample correlations to fuse multi-scale features, enabling simultaneous extraction of local and global information. The graph encoder maps multi-modal data from different scales to the graph space and completes feature extraction in the graph space. The graph decoder maps the features of multiple scales back to the original data space and completes multi-scale feature fusion and classification. Experimental results on three HSI-LiDAR datasets demonstrate that the proposed MGEN achieves considerable classification accuracies and outperforms state-of-the-art methods.
引用
收藏
页数:22
相关论文
共 50 条
[31]   GRAPH REASONED MULTI-SCALE ROAD SEGMENTATION IN REMOTE SENSING IMAGERY [J].
Vekinis, Andrew Alexander .
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, :6890-6893
[32]   A Dual-attention Capsule Encoder-Decoder Network for Building Extraction from High Resolution Remote Sensing Imagery [J].
Xu Z. ;
Guan H. ;
Peng D. ;
Yu Y. ;
Lei X. ;
Zhao H. .
National Remote Sensing Bulletin, 2022, 26 (08) :1639-1649
[33]   Hyperspectral image classification based on multi-scale hybrid convolutional network [J].
Yang, Yun ;
Zhou, Yao ;
Chen, Jia-ning .
CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (03) :368-377
[34]   Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder [J].
Zhang, Zhao ;
Lin, Bor-Shyh ;
Peng, Chih-Wei ;
Lin, Bor-Shing .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 :2096-2105
[35]   Advances in graph neural network-based hyperspectral remote sensing image classification [J].
Li, Jun ;
Yu, Long ;
Duan, Yilin ;
Zhuo, Li .
National Remote Sensing Bulletin, 2025, 29 (06) :1681-1704
[36]   Hyperspectral Remote Sensing Image Classification Based on Auto-Encoder [J].
Dong Anguo ;
Liu Hongchao ;
Zhang Qian ;
Liang Miaomiao .
LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (19)
[37]   Automated segmentation of textured dust storms on mars remote sensing images using an encoder-decoder type convolutional neural network [J].
Ogohara, Kazunori ;
Gichu, Ryusei .
COMPUTERS & GEOSCIENCES, 2022, 160
[38]   Land cover classification from remote sensing images based on multi-scale fully convolutional network [J].
Li, Rui ;
Zheng, Shunyi ;
Duan, Chenxi ;
Wang, Libo ;
Zhang, Ce .
GEO-SPATIAL INFORMATION SCIENCE, 2022, 25 (02) :278-294
[39]   Multi-scale detail enhancement network for remote sensing road extraction [J].
Geng, Tingting ;
Cao, Yuan ;
Wang, Changqing .
EARTH SCIENCE INFORMATICS, 2025, 18 (03)
[40]   Multi-Scale Feature Interaction Network for Remote Sensing Change Detection [J].
Zhang, Chong ;
Zhang, Yonghong ;
Lin, Haifeng .
REMOTE SENSING, 2023, 15 (11)