Local Information-Enhanced Graph-Transformer for Hyperspectral Image Change Detection With Limited Training Samples

被引:60
作者
Dong, Wenqian [1 ]
Yang, Yufei [1 ]
Qu, Jiahui [1 ]
Xiao, Song [2 ,3 ]
Li, Yunsong [1 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Network, Xian 710071, Peoples R China
[2] Beijing Elect Sci & Technol Inst, Dept Elect & Commun Engn, Beijing 100070, Peoples R China
[3] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Transformers; Feature extraction; Task analysis; Training; Convolution; Convolutional neural networks; Hyperspectral imaging; Change detection (CD); graph-transformer; hyperspectral image (HSI); limited training samples;
D O I
10.1109/TGRS.2023.3269892
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral image change detection (HSI-CD) is a challenging task that focuses on identifying the differences between multitemporal HSIs. The recent advancement of convolutional neural network (CNN) has made great progress on HSIs-CD. However, due to the limited receptive field, most CNN-based CD models trained with sufficient labeled samples cannot flexibly model the global information that is essential for distinguishing complex objects, thereby achieving relatively low performance. In this article, we propose a dual-branch local information-enhanced graph-transformer (D-LIEG) CD network to fully exploit the local-global spectral-spatial features of the multitemporal HSIs with limited training samples for change recognition. Specifically, the proposed network is composed of a cascaded of LIEG blocks, which jointly extracts local-global features by learning local information representation to enhance the information of graph-transformer. A novel graph-transformer is developed to model global spectral-spatial correlation between graph nodes, enabling the spectral information preservation of HSIs and accurate CD of areas with various sizes. Extensive experiments have proved that our method achieves significant performance improvement than other state-of-the-art methods on four commonly used HSI datasets.
引用
收藏
页数:14
相关论文
共 48 条
  • [21] Graph Convolutional Networks for Hyperspectral Image Classification
    Hong, Danfeng
    Gao, Lianru
    Yao, Jing
    Zhang, Bing
    Plaza, Antonio
    Chanussot, Jocelyn
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07): : 5966 - 5978
  • [22] Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
    Hong, Danfeng
    Wu, Xin
    Ghamisi, Pedram
    Chanussot, Jocelyn
    Yokoya, Naoto
    Zhu, Xiao Xiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (06): : 3791 - 3808
  • [23] Jiang Y., 2021, Annu. Conf. Neural Inf. Process. Syst, P14745, DOI 10.48550/arXiv.2102.07074
  • [24] Modern Trends in Hyperspectral Image Analysis: A Review
    Khan, Muhammad Jaleed
    Khan, Hamid Saeed
    Yousaf, Adeel
    Khurshid, Khurram
    Abbas, Asad
    [J]. IEEE ACCESS, 2018, 6 : 14118 - 14129
  • [25] Multispectral Change Detection With Bilinear Convolutional Neural Networks
    Lin, Yun
    Li, Shutao
    Fang, Leyuan
    Ghamisi, Pedram
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (10) : 1757 - 1761
  • [26] Oil Spill Detection via Multitemporal Optical Remote Sensing Images: A Change Detection Perspective
    Liu, Sicong
    Chi, Mingmin
    Zou, Yangxiu
    Samat, Alim
    Benediktsson, Jon Atli
    Plaza, Antonio
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (03) : 324 - 328
  • [27] Sequential Spectral Change Vector Analysis for Iteratively Discovering and Detecting Multiple Changes in Hyperspectral Images
    Liu, Sicong
    Bruzzone, Lorenzo
    Bovolo, Francesca
    Zanetti, Massimo
    Du, Peijun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (08): : 4363 - 4378
  • [28] Unsupervised Change Detection Based on Hybrid Conditional Random Field Model for High Spatial Resolution Remote Sensing Imagery
    Lv, Pengyuan
    Zhong, Yanfei
    Zhao, Ji
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07): : 4002 - 4015
  • [29] Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection
    Lyu, Haobo
    Lu, Hui
    Mou, Lichao
    [J]. REMOTE SENSING, 2016, 8 (06)
  • [30] Malila W. A., 1980, Sixth Annual Symposium on Machine Processing of Remotely Sensed Data and Soil Information Systems and Remote Sensing and Soil Survey, P326