Multiscale Graph Sample and Aggregate Network With Context-Aware Learning for Hyperspectral Image Classification

被引:102
作者
Ding, Yao [1 ]
Zhao, Xiaofeng [1 ]
Zhang, Zhili [1 ]
Cai, Wei [1 ]
Yang, Nengjun [1 ]
机构
[1] Xian Res Inst Of High Technol, Xian 710000, Peoples R China
基金
中国国家自然科学基金;
关键词
Hyperspectral imaging; Feature extraction; Deep learning; Image classification; Training; Image reconstruction; Classification algorithms; Deep contextual; graph convolutional network (GCN); hyperspectral image classification; multiscale graph; SPECTRAL-SPATIAL CLASSIFICATION; NEURAL-NETWORKS; LAND-COVER; FRAMEWORK; CNN;
D O I
10.1109/JSTARS.2021.3074469
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, graph convolutional network (GCN) has achieved promising results in hyperspectral image (HSI) classification. However, GCN is a transductive learning method, which is difficult to aggregate the new node. Besides, the existing GCN-based methods divide graph construction and graph classification into two stages ignoring the influence of constructed graph error on classification results. Moreover, the available GCN-based methods fail to understand the global and contextual information of the graph. In this article, we propose a novel multiscale graph sample and aggregate network with a context-aware learning method for HSI classification. The proposed network adopts a multiscale graph sample and aggregate network (graphSAGE) to learn the multiscale features from the local regions graph, which improves the diversity of network input information and effectively solves the impact of original input graph errors on classification. By employing a context-aware mechanism to characterize the importance among spatially neighboring regions, deep contextual and global information of the graph can be learned automatically by focusing on important spatial targets. Meanwhile, the graph structure is reconstructed automatically based on the classified objects as network training, which is able to effectively reduce the influence of the initial graph error on the classification result. Extensive experiments are conducted on three real HSI datasets, which are demonstrated to outperform the compared state-of-the-art methods.
引用
收藏
页码:4561 / 4572
页数:12
相关论文
共 53 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Hyperspectral Region Classification Using a Three-Dimensional Gabor Filterbank [J].
Bau, Tien C. ;
Sarkar, Subhadip ;
Healey, Glenn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2010, 48 (09) :3457-3464
[3]   Hyperspectral Image Classification via JCR and SVM Models With Decision Fusion [J].
Bo, Chunjuan ;
Lu, Huchuan ;
Wang, Dong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (02) :177-181
[4]  
Bruna J., 2014, P INT C LEARN REPR
[5]   Spectral-Spatial Classification of Hyperspectral Data Based on Deep Belief Network [J].
Chen, Yushi ;
Zhao, Xing ;
Jia, Xiuping .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (06) :2381-2392
[6]   Deep Learning-Based Classification of Hyperspectral Data [J].
Chen, Yushi ;
Lin, Zhouhan ;
Zhao, Xing ;
Wang, Gang ;
Gu, Yanfeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) :2094-2107
[7]   Graph Sample and Aggregate-Attention Network for Hyperspectral Image Classification [J].
Ding, Yao ;
Zhao, Xiaofeng ;
Zhang, Zhili ;
Cai, Wei ;
Yang, Nengjun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[8]  
Dozat T, Incorporating Nesterov Momentum Into Adam
[9]   Learning Spatiotemporal Features with 3D Convolutional Networks [J].
Du Tran ;
Bourdev, Lubomir ;
Fergus, Rob ;
Torresani, Lorenzo ;
Paluri, Manohar .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4489-4497
[10]   Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search [J].
Feng, Jie ;
Wu, Xiande ;
Shang, Ronghua ;
Sui, Chenhong ;
Li, Jie ;
Jiao, Licheng ;
Zhang, Xiangrong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06) :5054-5070