High-resolution optical remote sensing image change detection based on dense connection and attention feature fusion network

被引:8
作者
Peng, Daifeng [1 ,2 ,4 ]
Zhai, Chenchen [1 ]
Zhang, Yongjun [3 ]
Guan, Haiyan [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Remote Sensing & Geomat Engn, Nanjing, Peoples R China
[2] Minist Nat Resources, Key Lab Natl Geog Census & Monitoring, Wuhan, Peoples R China
[3] Wuhan Univ, Sch Remote Sensing Informat Engn, Wuhan, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Sch Remote Sensing & Geomat Engn, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
attention mechanism; change detection; dense connection; encoder-decoder; feature fusion; Siamese network; SET;
D O I
10.1111/phor.12462
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
The detection of ground object changes from bi-temporal images is of great significance for urban planning, land-use/land-cover monitoring and natural disaster assessment. To solve the limitation of incomplete change detection (CD) entities and inaccurate edges caused by the loss of detailed information, this paper proposes a network based on dense connections and attention feature fusion, namely Siamese NestedUNet with Attention Feature Fusion (SNAFF). First, multi-level bi-temporal features are extracted through a Siamese network. The dense connections between the sub-nodes of the decoder are used to compensate for the missing location information as well as weakening the semantic differences between features. Then, the attention mechanism is introduced to combine global and local information to achieve feature fusion. Finally, a deep supervision strategy is used to suppress the problem of gradient vanishing and slow convergence speed. During the testing phase, the test time augmentation (TTA) strategy is adopted to further improve the CD performance. In order to verify the effectiveness of the proposed method, two datasets with different change types are used. The experimental results indicate that, compared with the comparison methods, the proposed SNAFF achieves the best quantitative results on both datasets, in which F1, IoU and OA in the LEVIR-CD dataset are 91.47%, 84.28% and 99.13%, respectively, and the values in the CDD dataset are 96.91%, 94.01% and 99.27%, respectively. In addition, the qualitative results show that SNAFF can effectively retain the global and edge information of the detected entity, thus achieving the best visual performance. This paper proposes a novel change detection (CD) method based on dense connections and attention feature fusion, which is capable of recovering detailed information as well as capturing global and local information. A deep supervision module is introduced to further improve the CD performance. Extensive experimental results on two publicly available datasets verify the effectiveness of the proposed method.image
引用
收藏
页码:498 / 519
页数:22
相关论文
共 51 条
[11]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[12]   DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images [J].
Chen, Jie ;
Yuan, Ziyang ;
Peng, Jian ;
Chen, Li ;
Huang, Haozhe ;
Zhu, Jiawei ;
Liu, Yu ;
Li, Haifeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :1194-1206
[13]   DBFGAN: Dual Branch Feature Guided Aggregation Network for remote sensing image [J].
Chu, Shengguang ;
Li, Peng ;
Xia, Min ;
Lin, Haifeng ;
Qian, Ming ;
Zhang, Yonghong .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 116
[14]   Multitask learning for large-scale semantic change detection [J].
Daudt, Rodrigo Caye ;
Le Saux, Bertrand ;
Boulch, Alexandre ;
Gousseau, Yann .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 187
[15]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[16]   Updating Land-Cover Maps by Classification of Image Time Series: A Novel Change-Detection-Driven Transfer Learning Approach [J].
Demir, Beguem ;
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2013, 51 (01) :300-312
[17]   PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data [J].
Deng, J. S. ;
Wang, K. ;
Deng, Y. H. ;
Qi, G. J. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2008, 29 (16) :4823-4838
[18]  
El Amin AM, 2017, 2017 2ND INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC 2017), P812, DOI 10.1109/ICIVC.2017.7984667
[19]   SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images [J].
Fang, Sheng ;
Li, Kaiyu ;
Shao, Jinyuan ;
Li, Zhe .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[20]  
Fang Y, 2021, ADV NEURAL INF PROCE, V34, DOI [10.48550/arXiv.2106.00666, DOI 10.48550/ARXIV.2106.00666]