Aggregative and Contrastive Dual-View Graph Attention Network for Hyperspectral Image Classification

被引:0
作者
Jing, Haoyu [1 ]
Wu, Sensen [1 ]
Zhang, Laifu [1 ]
Meng, Fanen [1 ]
Feng, Tian [2 ]
Yan, Yiming [1 ]
Wang, Yuanyuan [3 ]
Du, Zhenhong [1 ]
机构
[1] Zhejiang Univ, Sch Earth Sci, Zhejiang Prov Key Lab Geog Informat Syst GIS, Hangzhou 310058, Peoples R China
[2] Zhejiang Univ, Sch Software Technol, Hangzhou 310027, Peoples R China
[3] Zhejiang Univ, Ocean Acad, Zhoushan 316021, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Convolutional neural networks; Contrastive learning; Phase change materials; Transformers; Earth; dual view; graph convolutional network (GCN); hyperspectral image (HSI) classification; progressive aggregation module (PAM); CONVOLUTIONAL NETWORKS;
D O I
10.1109/TGRS.2024.3443953
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Graph convolutional networks (GCNs) have recently gained prominence in hyperspectral images (HSIs) classification tasks given their superior performance on non-Euclidean data. However, GCN-based methods are heavily reliant on complete graph structural information, which can cause the aggregation and transmission of information across nodes from differing classes, thereby compromising the classification performance. Furthermore, the scarcity of labeled pixels in HSIs often limits the representational capability of such methods. To address these issues, we propose an aggregative and contrastive dual-view graph attention network (ACoD-GAT) for HSI classification. Specifically, we present a progressive aggregation module, including a pixel clustering submodule and a node aggregation submodule to exploit semantic information at various levels. Besides, we integrate multiscale manipulation with a diffusion matrix to construct the dual view to further extract semantic information from both local and global perspectives. Moreover, we design an unsupervised contrastive loss function and a supervised contrastive loss function to facilitate contrastive learning on the dual view, improving the representational capabilities of ACoD-GAT with very few labeled samples. The extensive experimental results on four benchmark datasets demonstrate the superiority of the proposed ACoD-GAT compared with other state-of-the-art methods.
引用
收藏
页数:17
相关论文
共 81 条
[1]   Deep Learning for Classification of Hyperspectral Data [J].
Audebert, Nicolas ;
Le Saux, Bertrand ;
Lefevre, Sebastien .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2019, 7 (02) :159-173
[2]   HYPERSPECTRAL IMAGE CLASSIFICATION BASED ON ITERATIVE SUPPORT VECTOR MACHINE BY INTEGRATING SPATIAL-SPECTRAL INFORMATION [J].
Belkacem, Baassou ;
He, Mingyi ;
Imran, Farid Muhammad ;
Mei, Shaohui .
2013 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2013, :1023-1026
[3]  
Bruna J., 2014, INT C LEARN REPR MAY
[4]   Composite kernels for hyperspectral image classification [J].
Camps-Valls, G ;
Gomez-Chova, L ;
Muñoz-Marí, J ;
Vila-Francés, J ;
Calpe-Maravilla, J .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2006, 3 (01) :93-97
[5]   Hyperspectral Image Classification With Markov Random Fields and a Convolutional Neural Network [J].
Cao, Xiangyong ;
Zhou, Feng ;
Xu, Lin ;
Meng, Deyu ;
Xu, Zongben ;
Paisley, John .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (05) :2354-2367
[6]  
Chapelle O., 2005, INT C ART INT STAT
[7]  
Chen T, 2020, PR MACH LEARN RES, V119
[8]   Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks [J].
Chen, Yushi ;
Jiang, Hanlu ;
Li, Chunyang ;
Jia, Xiuping ;
Ghamisi, Pedram .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10) :6232-6251
[9]   Spectral-Spatial Classification of Hyperspectral Data Based on Deep Belief Network [J].
Chen, Yushi ;
Zhao, Xing ;
Jia, Xiuping .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (06) :2381-2392
[10]   Deep Learning-Based Classification of Hyperspectral Data [J].
Chen, Yushi ;
Lin, Zhouhan ;
Zhao, Xing ;
Wang, Gang ;
Gu, Yanfeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) :2094-2107