Hyperspectral Image Classification Based on Double-Hop Graph Attention Multiview Fusion Network

被引:0
作者
Cui, Ying [1 ,2 ]
Luo, Li [1 ,2 ]
Wang, Lu [1 ,2 ]
Chen, Liwei [1 ,2 ]
Gao, Shan [1 ,2 ]
Zhao, Chunhui [1 ,2 ]
Tang, Cheng [3 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Minist Ind & Informat Technol, Key Lab Adv Marine Commun & Informat Technol, Harbin 150001, Peoples R China
[3] Kyushu Univ, Fac Informat Sci & Elect Engn, Fukuoka 8190395, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolutional neural networks; Computational modeling; Attention mechanisms; Data mining; Accuracy; Convolution; Hyperspectral imaging; Decoding; Residual neural networks; Attention mechanism; convolutional neural network (CNN); graph attention network (GAN); graph attention network (GAT); hyperspectral image (HSI) classification; multiview fusion;
D O I
10.1109/JSTARS.2024.3486283
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral image (HSI) is pivotal in ground object classification, owing to its rich spatial and spectral information. Recently, convolutional neural networks and graph neural networks have become hotspots in HSI classification. Although various methods have been developed, the problem of detail loss may still exist when extracting complex features within homogenous regions. To solve this issue, in this article, we proposed a double-hop graph attention multiview fusion network. This model is adept at pinpointing precise attention features by integrating a double-hop graph with the graph attention network, thereby enhancing the aggregation of multilevel node information and surmounting the limitations of a restricted receptive field. Furthermore, the spectral-coordinate attention module (SCAM) is presented to seize more nuanced spectral and spatial attention features. SCAM harnesses the coordinate attention mechanism for in-depth pixel-level global spectral-spatial view. Coupled with the multiscale Gabor texture view, we forge a multiview fusion network that meticulously highlights edge details across varying scales and captures beneficial features. Our experimental validation across four renowned benchmark HSI datasets showcases our model's superiority, outstripping comparative methods in classification accuracy with limited labeled samples.
引用
收藏
页码:20080 / 20097
页数:18
相关论文
共 50 条
[31]   Unsupervised Multiview Graph Contrastive Feature Learning for Hyperspectral Image Classification [J].
Chang, Yuan ;
Liu, Quanwei ;
Zhang, Yuxiang ;
Dong, Yanni .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
[32]   Multilevel Feature Gated Fusion Based Spatial and Frequency Domain Attention Network for Joint Classification of Hyperspectral and LiDAR Data [J].
Shi, Cuiping ;
Zhong, Zhipeng ;
Ding, Shihang ;
Lei, Yeqi ;
Wang, Liguo ;
Jin, Zhan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 :5960-5974
[33]   Hyperspectral Image Classification Based on Fusion of Convolutional Neural Network and Graph Network [J].
Gao, Luyao ;
Xiao, Shulin ;
Hu, Changhong ;
Yan, Yang .
APPLIED SCIENCES-BASEL, 2023, 13 (12)
[34]   Spectral-Spatial Score Fusion Attention Network for Hyperspectral Image Classification With Limited Samples [J].
Cheng, Shun ;
Xue, Zhaohui ;
Li, Ziyu ;
Xu, Aijun ;
Su, Hongjun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :14521-14542
[35]   A Fast Dynamic Graph Convolutional Network and CNN Parallel Network for Hyperspectral Image Classification [J].
Liu, Quanwei ;
Dong, Yanni ;
Zhang, Yuxiang ;
Luo, Hui .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[36]   Multibranch Fusion: A Multibranch Attention Framework by Combining Graph Convolutional Network and CNN for Hyperspectral Image Classification [J].
Liu, Xun ;
Ng, Alex Hay-Man ;
Ge, Linlin ;
Lei, Fangyuan ;
Liao, Xuejiao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
[37]   Adaptive Sampling Toward a Dynamic Graph Convolutional Network for Hyperspectral Image Classification [J].
Ding, Yun ;
Feng, Jinpeng ;
Chong, Yanwen ;
Pan, Shaoming ;
Sun, Xiaohui .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[38]   Multiscale Short and Long Range Graph Convolutional Network for Hyperspectral Image Classification [J].
Zhu, Wenxiang ;
Zhao, Chunhui ;
Feng, Shou ;
Qin, Boao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[39]   Spatial Pooling Graph Convolutional Network for Hyperspectral Image Classification [J].
Zhang, Xiangrong ;
Chen, Shutong ;
Zhu, Peng ;
Tang, Xu ;
Feng, Jie ;
Jiao, Licheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[40]   Dual-Branch Spectral–Spatial Attention Network for Hyperspectral Image Classification [J].
Zhao, Jinling ;
Wang, Jiajie ;
Ruan, Chao ;
Dong, Yingying ;
Huang, Linsheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-18