Temporal difference-guided network for hyperspectral image change detection

被引:39
作者
Chen, Zhonghao [1 ]
Wang, Yuyang [1 ]
Gao, Hongmin [1 ]
Ding, Yao [2 ]
Zhong, Qiqiang [3 ]
Hong, Danfeng [4 ]
Zhang, Bing [5 ,6 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing, Peoples R China
[2] Xian Res Inst High Technol, Key Lab Opt Engn, Xian, Peoples R China
[3] First Mil Representat Off Mil Representat Bur Army, Armament Dept PLAA, Nanjing Mil Representat Bur, Nanjing, Peoples R China
[4] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Comp Opt Imaging Technol, Beijing, Peoples R China
[5] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing, Peoples R China
[6] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing, Peoples R China
关键词
Hyperspectral (HS) image; change detection (CD); convolutional neural networks (CNNs); convolutional gated recurrent unit; temporal difference-guided; UNSUPERVISED CHANGE DETECTION; CHANGE VECTOR ANALYSIS; MAD;
D O I
10.1080/01431161.2023.2258563
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Recently, the research area of hyperspectral (HS) image change detection (CD) is popular with convolutional neural networks (CNNs) based methods. However, conventional CNNs-based CD algorithms commonly achieve detection by comparing the deep features extracted from the bi-temporal images at decision level, which often fails to take full advantage of the features extracted by the network at different levels. Moreover, there are inevitably substantial redundant features located in non-varying regions in bi-temporal images, which considerably impedes the training efficiency of CNNs-based methods. To solve these two problems, we propose a temporal difference-guided HS image CD network, called TDGN Specifically, the rich spectral features will be extracted from the bi-temporal images hierarchically, and then the differences between the two images at different levels of the network will be yielded by the elaborated convolutional gated recurrent unit block in the spatial dimension. Furthermore, the differences from these different levels will be fused for the final detection. More significantly, to boost the efficiency of the backbone network for feature extraction, the obtained difference at each level is also leveraged to generate variation weights to guide the feature extraction at the next stage. Finally, the proposed TDGN can make full use of the temporal difference obtained by the network at different levels while this information is further employed to facilitate the attention and extraction of change features by the network. Extensive experiments, implemented on four well-known HS data sets, demonstrate that the proposed TDGN yields an average overall accuracy of 98.67%, 96.74%, 99.36%, and 96.81% on these data sets, respectively, acquiring promising detection performance compared to state-of-the-art methods. The codes of this work will be available at https://github.com/zhonghaochen/TDGN_Master for the sake of reproducibility.
引用
收藏
页码:6033 / 6059
页数:27
相关论文
共 60 条
[1]   Automatic change detection of buildings in urban environment from very high spatial resolution images using existing geodatabase and prior knowledge [J].
Bouziani, Mourad ;
Goita, Kalifa ;
He, Dong-Chen .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2010, 65 (01) :143-153
[2]   A split-based approach to unsupervised change detection in large-size multitemporal images: Application to tsunami-damage assessment [J].
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (06) :1658-1670
[3]   A theoretical framework for unsupervised change detection based on change vector analysis in the polar domain [J].
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (01) :218-236
[4]   Graph Regularized Residual Subspace Clustering Network for hyperspectral image clustering [J].
Cai, Yaoming ;
Zeng, Meng ;
Cai, Zhihua ;
Liu, Xiaobo ;
Zhang, Zijia .
INFORMATION SCIENCES, 2021, 578 :85-101
[5]   Graph Convolutional Subspace Clustering: A Robust Subspace Clustering Framework for Hyperspectral Image [J].
Cai, Yaoming ;
Zhang, Zijia ;
Cai, Zhihua ;
Liu, Xiaobo ;
Jiang, Xinwei ;
Yan, Qin .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (05) :4191-4202
[6]   Change Detection in Multisource VHR Images via Deep Siamese Convolutional Multiple-Layers Recurrent Neural Network [J].
Chen, Hongruixuan ;
Wu, Chen ;
Du, Bo ;
Zhang, Liangpei ;
Wang, Le .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (04) :2848-2864
[7]   Change Vector Analysis in Posterior Probability Space: A New Method for Land Cover Change Detection [J].
Chen, Jin ;
Chen, Xuehong ;
Cui, Xihong ;
Chen, Jun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2011, 8 (02) :317-321
[8]   Grid Network: Feature Extraction in Anisotropic Perspective for Hyperspectral Image Classification [J].
Chen, Zhonghao ;
Hong, Danfeng ;
Gao, Hongmin .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
[9]   Local aggregation and global attention network for hyperspectral image classification with spectral-induced aligned superpixel segmentation [J].
Chen, Zhonghao ;
Wu, Guoyong ;
Gao, Hongmin ;
Ding, Yao ;
Hong, Danfeng ;
Zhang, Bing .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 232
[10]   Global to Local: A Hierarchical Detection Algorithm for Hyperspectral Image Target Detection [J].
Chen, Zhonghao ;
Lu, Zhengtao ;
Gao, Hongmin ;
Zhang, Yiyan ;
Zhao, Jia ;
Hong, Danfeng ;
Zhang, Bing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60