AF2GNN: Graph convolution with adaptive filters and aggregator fusion for hyperspectral image classification

被引:96
作者
Ding, Yao [1 ]
Zhang, Zhili [1 ]
Zhao, Xiaofeng [1 ]
Hong, Danfeng [2 ]
Li, Wei [3 ]
Cai, Wei [1 ]
Zhan, Ying [1 ]
机构
[1] Xian Res Inst High Technol, Natl Key Lab Opt Engn, Xi'an 710025, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[3] Beijing Inst Technol, Sch Informat & Elect, Beijing 100010, Peoples R China
基金
中国国家自然科学基金;
关键词
Hyperspectral image classification; Graph neural network; Adaptive filters; Aggregators fusion; FEATURE-EXTRACTION; NETWORKS;
D O I
10.1016/j.ins.2022.04.006
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hyperspectral image classification (HSIC) is essential in remote sensing image analysis. Applying a graph neural network (GNN) to hyperspectral image (HSI) classification has attracted increasing attention. However, the available GNNs for HSIC only adopt a kind of graph filter and an aggregator, which cannot well deal with the problems of land cover discrimination, noise impaction, and spatial feature learning. To overcome these problems, a graph convolution with adaptive filters and aggregator fusion (AF2GNN) is developed for HSIC. To reduce the number of graph nodes, a superpixel segment algorithm is employed to refine the local spatial features of the HSI. A two-layer 1D CNN is proposed to transform the spectral features of superpixels. In addition, a linear function is designed to combine the different graph filters, with which the graph filter can be adaptively determined by training different weight matrices. Moreover, degree-scalers are defined to combine the multiple filters and present the graph structure. Finally, the AF2GNN is proposed to realize the adaptive filters and aggregator fusion mechanism within a single network. In the proposed network, a softMax function is utilized for graph feature interpretation and pixel-label prediction. Compared with state-of-the-art methods, the proposed method achieves superior experimental results. (c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:201 / 219
页数:19
相关论文
共 45 条
[1]  
Cai Y., 2021, INFORM SCIENCES, V578, P1790
[2]   BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image [J].
Cai, Yaoming ;
Liu, Xiaobo ;
Cai, Zhihua .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03) :1969-1984
[3]   Deep Learning-Based Classification of Hyperspectral Data [J].
Chen, Yushi ;
Lin, Zhouhan ;
Zhao, Xing ;
Wang, Gang ;
Gu, Yanfeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) :2094-2107
[4]   Extended profiles with morphological attribute filters for the analysis of hyperspectral data [J].
Dalla Mura, Mauro ;
Benediktsson, Jon Atli ;
Waske, Bjoern ;
Bruzzone, Lorenzo .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2010, 31 (22) :5975-5991
[5]   Multiscale Graph Sample and Aggregate Network With Context-Aware Learning for Hyperspectral Image Classification [J].
Ding, Yao ;
Zhao, Xiaofeng ;
Zhang, Zhili ;
Cai, Wei ;
Yang, Nengjun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :4561-4572
[6]  
Djerriri K, 2019, INT GEOSCI REMOTE SE, P465, DOI [10.1109/IGARSS.2019.8900211, 10.1109/igarss.2019.8900211]
[7]   Crowd counting by using multi-level density-based spatial information: A Multi-scale CNN framework [J].
Dong, Li ;
Zhang, Haijun ;
Ji, Yuzhu ;
Ding, Yuxin .
INFORMATION SCIENCES, 2020, 528 :79-91
[8]   Spectral-Spatial Classification of Hyperspectral Images With a Superpixel-Based Discriminative Sparse Model [J].
Fang, Leyuan ;
Li, Shutao ;
Kang, Xudong ;
Benediktsson, Jon Atli .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (08) :4186-4201
[9]   Automatic Framework for Spectral-Spatial Classification Based on Supervised Feature Extraction and Morphological Attribute Profiles [J].
Ghamisi, Pedram ;
Benediktsson, Jon Atli ;
Cavallaro, Gabriele ;
Plaza, Antonio .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) :2147-2160
[10]  
Gilmer J, 2017, PR MACH LEARN RES, V70