High-resolution optical remote sensing image change detection based on dense connection and attention feature fusion network

被引:8
作者
Peng, Daifeng [1 ,2 ,4 ]
Zhai, Chenchen [1 ]
Zhang, Yongjun [3 ]
Guan, Haiyan [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Remote Sensing & Geomat Engn, Nanjing, Peoples R China
[2] Minist Nat Resources, Key Lab Natl Geog Census & Monitoring, Wuhan, Peoples R China
[3] Wuhan Univ, Sch Remote Sensing Informat Engn, Wuhan, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Sch Remote Sensing & Geomat Engn, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
attention mechanism; change detection; dense connection; encoder-decoder; feature fusion; Siamese network; SET;
D O I
10.1111/phor.12462
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
The detection of ground object changes from bi-temporal images is of great significance for urban planning, land-use/land-cover monitoring and natural disaster assessment. To solve the limitation of incomplete change detection (CD) entities and inaccurate edges caused by the loss of detailed information, this paper proposes a network based on dense connections and attention feature fusion, namely Siamese NestedUNet with Attention Feature Fusion (SNAFF). First, multi-level bi-temporal features are extracted through a Siamese network. The dense connections between the sub-nodes of the decoder are used to compensate for the missing location information as well as weakening the semantic differences between features. Then, the attention mechanism is introduced to combine global and local information to achieve feature fusion. Finally, a deep supervision strategy is used to suppress the problem of gradient vanishing and slow convergence speed. During the testing phase, the test time augmentation (TTA) strategy is adopted to further improve the CD performance. In order to verify the effectiveness of the proposed method, two datasets with different change types are used. The experimental results indicate that, compared with the comparison methods, the proposed SNAFF achieves the best quantitative results on both datasets, in which F1, IoU and OA in the LEVIR-CD dataset are 91.47%, 84.28% and 99.13%, respectively, and the values in the CDD dataset are 96.91%, 94.01% and 99.27%, respectively. In addition, the qualitative results show that SNAFF can effectively retain the global and edge information of the detected entity, thus achieving the best visual performance. This paper proposes a novel change detection (CD) method based on dense connections and attention feature fusion, which is capable of recovering detailed information as well as capturing global and local information. A deep supervision module is introduced to further improve the CD performance. Extensive experimental results on two publicly available datasets verify the effectiveness of the proposed method.image
引用
收藏
页码:498 / 519
页数:22
相关论文
共 51 条
[31]   Swin Transformer: Hierarchical Vision Transformer using Shifted Windows [J].
Liu, Ze ;
Lin, Yutong ;
Cao, Yue ;
Hu, Han ;
Wei, Yixuan ;
Zhang, Zheng ;
Lin, Stephen ;
Guo, Baining .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9992-10002
[32]   Unsupervised Change Detection Based on Hybrid Conditional Random Field Model for High Spatial Resolution Remote Sensing Imagery [J].
Lv, Pengyuan ;
Zhong, Yanfei ;
Zhao, Ji ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07) :4002-4015
[33]   DCFF-Net: A Densely Connected Feature Fusion Network for Change Detection in High-Resolution Remote Sensing Images [J].
Pan, Fei ;
Wu, Zebin ;
Liu, Qian ;
Xu, Yang ;
Wei, Zhihui .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :11974-11985
[34]   End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet plus [J].
Peng, Daifeng ;
Zhang, Yongjun ;
Guan, Haiyan .
REMOTE SENSING, 2019, 11 (11)
[35]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[36]   A Divided Spatial and Temporal Context Network for Remote Sensing Change Detection [J].
Shi, Nian ;
Chen, Keming ;
Zhou, Guangyao .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :4897-4908
[37]   A Deeply Supervised Attention Metric-Based Network and an Open Aerial Image Dataset for Remote Sensing Change Detection [J].
Shi, Qian ;
Liu, Mengxi ;
Li, Shengchen ;
Liu, Xiaoping ;
Wang, Fei ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[38]   Axial Cross Attention Meets CNN: Bibranch Fusion Network for Change Detection [J].
Song, Lei ;
Xia, Min ;
Weng, Liguo ;
Lin, Haifeng ;
Qian, Ming ;
Chen, Binyu .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 :32-43
[39]   A critical synthesis of remotely sensed optical image change detection techniques [J].
Tewkesbury, Andrew P. ;
Comber, Alexis J. ;
Tate, Nicholas J. ;
Lamb, Alistair ;
Fisher, Peter F. .
REMOTE SENSING OF ENVIRONMENT, 2015, 160 :1-14
[40]  
Vaswani A., 2017, Advances in Neural Information Processing Systems, V30, P5998