AF2GNN: Graph convolution with adaptive filters and aggregator fusion for hyperspectral image classification

被引:96
作者
Ding, Yao [1 ]
Zhang, Zhili [1 ]
Zhao, Xiaofeng [1 ]
Hong, Danfeng [2 ]
Li, Wei [3 ]
Cai, Wei [1 ]
Zhan, Ying [1 ]
机构
[1] Xian Res Inst High Technol, Natl Key Lab Opt Engn, Xi'an 710025, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[3] Beijing Inst Technol, Sch Informat & Elect, Beijing 100010, Peoples R China
基金
中国国家自然科学基金;
关键词
Hyperspectral image classification; Graph neural network; Adaptive filters; Aggregators fusion; FEATURE-EXTRACTION; NETWORKS;
D O I
10.1016/j.ins.2022.04.006
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hyperspectral image classification (HSIC) is essential in remote sensing image analysis. Applying a graph neural network (GNN) to hyperspectral image (HSI) classification has attracted increasing attention. However, the available GNNs for HSIC only adopt a kind of graph filter and an aggregator, which cannot well deal with the problems of land cover discrimination, noise impaction, and spatial feature learning. To overcome these problems, a graph convolution with adaptive filters and aggregator fusion (AF2GNN) is developed for HSIC. To reduce the number of graph nodes, a superpixel segment algorithm is employed to refine the local spatial features of the HSI. A two-layer 1D CNN is proposed to transform the spectral features of superpixels. In addition, a linear function is designed to combine the different graph filters, with which the graph filter can be adaptively determined by training different weight matrices. Moreover, degree-scalers are defined to combine the multiple filters and present the graph structure. Finally, the AF2GNN is proposed to realize the adaptive filters and aggregator fusion mechanism within a single network. In the proposed network, a softMax function is utilized for graph feature interpretation and pixel-label prediction. Compared with state-of-the-art methods, the proposed method achieves superior experimental results. (c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:201 / 219
页数:19
相关论文
共 45 条
[31]   HybridSN: Exploring 3-D-2-D CNN Feature Hierarchy for Hyperspectral Image Classification [J].
Roy, Swalpa Kumar ;
Krishna, Gopal ;
Dubey, Shiv Ram ;
Chaudhuri, Bidyut B. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (02) :277-281
[32]   Three-Dimensional Gabor Wavelets for Pixel-Based Hyperspectral Imagery Classification [J].
Shen, Linlin ;
Jia, Sen .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (12) :5039-5046
[33]   Mastering the game of Go without human knowledge [J].
Silver, David ;
Schrittwieser, Julian ;
Simonyan, Karen ;
Antonoglou, Ioannis ;
Huang, Aja ;
Guez, Arthur ;
Hubert, Thomas ;
Baker, Lucas ;
Lai, Matthew ;
Bolton, Adrian ;
Chen, Yutian ;
Lillicrap, Timothy ;
Hui, Fan ;
Sifre, Laurent ;
van den Driessche, George ;
Graepel, Thore ;
Hassabis, Demis .
NATURE, 2017, 550 (7676) :354-+
[34]   Hyperspectral Imagery Classification Based on Rotation-Invariant Spectral-Spatial Feature [J].
Tao, Chao ;
Tang, Yuqi ;
Fan, Chong ;
Zou, Zhengron .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2014, 11 (05) :980-984
[35]   A new approach for classifying coronavirus COVID-19 based on its manifestation on chest X-rays using texture features and neural networks [J].
Varela-Santos, Sergio ;
Melin, Patricia .
INFORMATION SCIENCES, 2021, 545 :403-414
[36]   Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification [J].
Wan, Sheng ;
Gong, Chen ;
Zhong, Ping ;
Du, Bo ;
Zhang, Lefei ;
Yang, Jian .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05) :3162-3177
[37]   Random Forest Ensembles and Extended Multiextinction Profiles for Hyperspectral Image Classification [J].
Xia, Junshi ;
Ghamisi, Pedram ;
Yokoya, Naoto ;
Iwasaki, Akira .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (01) :202-216
[38]   Design and Analysis of Dual-Magnet BLDCM for Momentum Wheel [J].
Xiao, Yunfeng ;
Xu, Kang ;
Liu, Qiang .
IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2021, 16 (02) :332-334
[39]   Learning and Transferring Deep Joint Spectral-Spatial Features for Hyperspectral Classification [J].
Yang, Jingxiang ;
Zhao, Yong-Qiang ;
Chan, Jonathan Cheung-Wai .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (08) :4729-4742
[40]   Deep hybrid: Multi-graph neural network collaboration for hyperspectral image classification [J].
Yao, Ding ;
Zhang, Zhi-li ;
Zhao, Xiao-feng ;
Wei, Cai ;
Fang, He ;
Cai, Yao-ming ;
Cai, Wei-Wei .
DEFENCE TECHNOLOGY, 2023, 23 :164-176