Local Information-Enhanced Graph-Transformer for Hyperspectral Image Change Detection With Limited Training Samples

被引:60
作者
Dong, Wenqian [1 ]
Yang, Yufei [1 ]
Qu, Jiahui [1 ]
Xiao, Song [2 ,3 ]
Li, Yunsong [1 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Network, Xian 710071, Peoples R China
[2] Beijing Elect Sci & Technol Inst, Dept Elect & Commun Engn, Beijing 100070, Peoples R China
[3] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Transformers; Feature extraction; Task analysis; Training; Convolution; Convolutional neural networks; Hyperspectral imaging; Change detection (CD); graph-transformer; hyperspectral image (HSI); limited training samples;
D O I
10.1109/TGRS.2023.3269892
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral image change detection (HSI-CD) is a challenging task that focuses on identifying the differences between multitemporal HSIs. The recent advancement of convolutional neural network (CNN) has made great progress on HSIs-CD. However, due to the limited receptive field, most CNN-based CD models trained with sufficient labeled samples cannot flexibly model the global information that is essential for distinguishing complex objects, thereby achieving relatively low performance. In this article, we propose a dual-branch local information-enhanced graph-transformer (D-LIEG) CD network to fully exploit the local-global spectral-spatial features of the multitemporal HSIs with limited training samples for change recognition. Specifically, the proposed network is composed of a cascaded of LIEG blocks, which jointly extracts local-global features by learning local information representation to enhance the information of graph-transformer. A novel graph-transformer is developed to model global spectral-spatial correlation between graph nodes, enabling the spectral information preservation of HSIs and accurate CD of areas with various sizes. Extensive experiments have proved that our method achieves significant performance improvement than other state-of-the-art methods on four commonly used HSI datasets.
引用
收藏
页数:14
相关论文
共 48 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Change detection techniques for remote sensing applications: a survey
    Asokan, Anju
    Anitha, J.
    [J]. EARTH SCIENCE INFORMATICS, 2019, 12 (02) : 143 - 160
  • [3] Baatz M., 2000, XII Angewandte Geographische Informationsverarbeitung
  • [4] A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images
    Bovolo, Francesca
    Marchesi, Silvia
    Bruzzone, Lorenzo
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (06): : 2196 - 2212
  • [5] A Novel Framework for the Design of Change-Detection Systems for Very-High-Resolution Remote Sensing Images
    Bruzzone, Lorenzo
    Bovolo, Francesca
    [J]. PROCEEDINGS OF THE IEEE, 2013, 101 (03) : 609 - 630
  • [6] Carion N., 2020, P EUR C COMP VIS
  • [7] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data
    Deng, J. S.
    Wang, K.
    Deng, Y. H.
    Qi, G. J.
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2008, 29 (16) : 4823 - 4838
  • [9] ROBUST PATCH TENSOR-BASED MULTIGRAPH EMBEDDING FOR DIMENSIONALITY REDUCTION OF HYPERSPECTRAL IMAGES
    Deng, Yang-Jun
    Zhou, Yi
    Wang, Wei-Ye
    Zhu, Xing-Hui
    Li, Heng-Chao
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1149 - 1152
  • [10] Patch Tensor-Based Multigraph Embedding Framework for Dimensionality Reduction of Hyperspectral Images
    Deng, Yang-Jun
    Li, Heng-Chao
    Song, Xin
    Sun, Yong-Jinn
    Zhang, Xiang-Rong
    Du, Qian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03): : 1630 - 1643