Parallel Compared-and-Stacked Pyramid Transformer Network for Unsupervised Hyperspectral Change Detection

被引:4
作者
Xu, Yunshuang [1 ]
Xiao, Song [2 ,3 ]
Qu, Jiahui [1 ]
Dong, Wenqian [1 ]
Li, Yunsong [1 ]
Xia, Haoming [4 ,5 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xidian 710071, Peoples R China
[2] Beijing Elect Sci & Technol Inst, Beijing 100070, Peoples R China
[3] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
[4] Henan Univ, Coll Geog & Environm Sci, Minist Educ, Zhengzhou 450046, Peoples R China
[5] Henan Univ, Key Lab Geospatial Technol Middle & Lower Yellow, Minist Educ, Zhengzhou 450046, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Feature extraction; Transformers; Correlation; Training; Task analysis; Deep learning; Context modeling; Hyperspectral image change detection (HSI-CD); joint decision; pyramid; transformer; unsupervised; IMAGE CLASSIFICATION;
D O I
10.1109/TGRS.2023.3343554
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Convolutional neural networks (CNNs) with good feature learning capabilities are widely used in hyperspectral image change detection (HSI-CD) tasks. However, most existing CNN-based HSI-CD methods face two inherent challenges: 1) the lack of available labeled datasets and 2) the limited receptive field that cannot capture the long-distance dependence between the spectral sequences of HSIs. In this article, we propose a parallel compared-and-stacked pyramid transformer network (PCPTNet) for unsupervised HSI-CD, which can model the context information of spectral sequences in the input multi-temporal HSI patch without real labeled data. Specifically, a superpixel-level joint decision-based training samples selection strategy is presented that fully considers the correlation between pixels to improve the reliability of training samples. Then, taking advantage of transformer in context information modeling, PCPTNet is proposed to capture sufficient difference features and stacked features with different scales for CD, which can effectively reduce missed and false detection. The multiscale features containing sufficient low-level detail information and high-level semantic features are fused hierarchically to classify changed and unchanged pixels. Extensive experiments on three real HSI datasets demonstrate that the PCPTNet outperforms other state-of-the-art HSI-CD methods in both visual and quantitative results.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 46 条
[1]  
Baevski Alexei, 2018, arXiv
[2]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[3]   Spectrally-Spatially Regularized Low-Rank and Sparse Decomposition: A Novel Method for Change Detection in Multitemporal Hyperspectral Images [J].
Chen, Zhao ;
Wang, Bin .
REMOTE SENSING, 2017, 9 (10)
[4]   A review on change detection method and accuracy assessment for land use land cover [J].
Chughtai, Ali Hassan ;
Abbasi, Habibullah ;
Karas, Ismail Rakip .
REMOTE SENSING APPLICATIONS-SOCIETY AND ENVIRONMENT, 2021, 22
[5]   PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data [J].
Deng, J. S. ;
Wang, K. ;
Deng, Y. H. ;
Qi, G. J. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2008, 29 (16) :4823-4838
[6]   CDFormer: A Hyperspectral Image Change Detection Method Based on Transformer Encoders [J].
Ding, Jigang ;
Li, Xiaorun ;
Zhao, Liaoying .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[7]   Local Information-Enhanced Graph-Transformer for Hyperspectral Image Change Detection With Limited Training Samples [J].
Dong, Wenqian ;
Yang, Yufei ;
Qu, Jiahui ;
Xiao, Song ;
Li, Yunsong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[8]   Abundance Matrix Correlation Analysis Network Based on Hierarchical Multihead Self-Cross-Hybrid Attention for Hyperspectral Change Detection [J].
Dong, Wenqian ;
Zhao, Jingyu ;
Qu, Jiahui ;
Xiao, Song ;
Li, Nan ;
Hou, Shaoxiong ;
Li, Yunsong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[9]   Asymmetric Weighted Logistic Metric Learning for Hyperspectral Target Detection [J].
Dong, Yanni ;
Shi, Wenzhong ;
Du, Bo ;
Hu, Xiangyun ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) :11093-11106
[10]  
Du Q, 2005, 2005 International Workshop on the Analysis on Multi-Temporal Remote Sensing Images, P136