Remote sensing image change detection based on multilevel cross-temporal fusion network

被引:0
作者
Luo, Shujiang [1 ]
Shi, Aiye [1 ]
机构
[1] Hohai Univ, Coll Informat Sci & Engn, Changzhou, Peoples R China
关键词
remote sensing image; change detection; attention mechanism; feature fusion;
D O I
10.1117/1.JRS.19.016510
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In recent years, with the rapid development of deep learning, attention modules based on fused scale features have been widely successful in remote sensing image change detection. However, the popular Softmax attention mechanism has high computational overhead and is susceptible to changes in viewing angle during imaging. To address these issues, we propose a multilevel cross-temporal fusion network that effectively balances the training efficiency and detection capability of the model while considering the reduction in computational complexity. Specifically, we propose a JointAgent attention module that unifies Softmax attention and linear attention in the deeper feature analysis of bitemporal cross-temporal images, thus achieving efficient information interaction in bitemporal images and facilitating information coupling between representations at the same level. Furthermore, we created a three-branch multilevel feature fusion structure based on difference extraction to accomplish deeper feature information interaction. The pixelwise sum branch was primarily used to improve edge information, whereas the pixelwise subtraction and channelwise concatenation branches were primarily used to acquire various features. Our models were trained on three public datasets with significantly improved efficiency and outperformed other existing models in terms of performance (such as the F1-score (F1) was improved by 1.52% and 1.93% on the Deeply Supervised Image Fusion Network dataset and Cropland Change Detection dataset, respectively).
引用
收藏
页数:18
相关论文
共 45 条
[1]   Street-view change detection with deconvolutional networks [J].
Alcantarilla, Pablo F. ;
Stent, Simon ;
Ros, German ;
Arroyo, Roberto ;
Gherardi, Riccardo .
AUTONOMOUS ROBOTS, 2018, 42 (07) :1301-1322
[2]  
Bai B., 2022, IEEE Trans. Geosci. Remote Sens, V60, P1
[3]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[4]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[5]  
Daudt RC, 2018, INT GEOSCI REMOTE SE, P2115, DOI 10.1109/IGARSS.2018.8518015
[6]   Continuous monitoring of forest change dynamics with satellite time series [J].
Decuyper, Mathieu ;
Chavez, Roberto O. ;
Lohbeck, Madelon ;
Lastra, Jose A. ;
Tsendbazar, Nandika ;
Hacklander, Julia ;
Herold, Martin ;
Vagen, Tor-G .
REMOTE SENSING OF ENVIRONMENT, 2022, 269
[7]   Efficient Saliency-Based Object Detection in Remote Sensing Images Using Deep Belief Networks [J].
Diao, Wenhui ;
Sun, Xian ;
Zheng, Xinwei ;
Dou, Fangzheng ;
Wang, Hongqi ;
Fu, Kun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (02) :137-141
[8]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[9]   Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images [J].
Du, Bo ;
Ru, Lixiang ;
Wu, Chen ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12) :9976-9992
[10]   SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images [J].
Fang, Sheng ;
Li, Kaiyu ;
Shao, Jinyuan ;
Li, Zhe .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19