FDFF-Net: A Full-Scale Difference Feature Fusion Network for Change Detection in High-Resolution Remote Sensing Images

被引:9
作者
Gu, Feng [1 ]
Xiao, Pengfeng [1 ]
Zhang, Xueliang [1 ]
Li, Zhenshi [1 ]
Muhtar, Dilxat [1 ]
机构
[1] Nanjing Univ, Jiangsu Prov Key Lab Geog Informat Sci & Technol, Key Lab Land Satellite Remote Sensing Applicat, Sch Geog & Ocean Sci,Minist Nat Resources, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention mechanism; change detection; deep learning; difference feature fusion;
D O I
10.1109/JSTARS.2023.3335287
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep-learning techniques have made significant advances in remote sensing change detection task. However, it remains a great challenge to detect the details of changed areas from high-resolution remote sensing images. In this study, we propose a full-scale difference feature fusion network (FDFF-Net) for change detection, which can alleviate pseudochanges and reduce the loss of change details during detection. In the encoding stage, a dense difference fusion module is proposed to effectively mine and fuse the multiple differences for each feature level between bitemporal images, leading to a substantial reduction in missed detection of change areas. Additionally, the different levels of difference features are aggregated through a full-scale skip connection, allowing the network to detect multiple changed objects with various sizes. In the decoding stage, a strip spatial attention module is designed to enhance the perception of the change areas, which improves the ability to detect detailed changes. The experiments on three change detection datasets, CDD, LEVIR-CD, and S2Looking, demonstrate that FDFF-Net outperforms the compared state-of-the-art methods and can detect more complete changes of small objects and clear contours of changed areas.
引用
收藏
页码:2161 / 2172
页数:12
相关论文
共 58 条
[41]   Change Detection Based on Artificial Intelligence: State-of-the-Art and Challenges [J].
Shi, Wenzhong ;
Zhang, Min ;
Zhang, Rui ;
Chen, Shanxiong ;
Zhan, Zhao .
REMOTE SENSING, 2020, 12 (10)
[42]  
Song W. Ni, 2022, IEEE Geosci. Remote Sens. Lett., V19
[43]   Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations [J].
Sudre, Carole H. ;
Li, Wenqi ;
Vercauteren, Tom ;
Ourselin, Sebastien ;
Cardoso, M. Jorge .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 :240-248
[44]   ChangeNet: A Deep Learning Architecture for Visual Change Detection [J].
Varghese, Ashley ;
Gubbi, Jayavardhana ;
Ramaswamy, Akshaya ;
Balamuralidhar, P. .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT II, 2019, 11130 :129-145
[45]   ADS-Net:An Attention-Based deeply supervised network for remote sensing image change detection [J].
Wang, Decheng ;
Chen, Xiangning ;
Jiang, Mingyong ;
Du, Shuhan ;
Xu, Bijie ;
Wang, Junda .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 101
[46]   UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery [J].
Wang, Libo ;
Li, Rui ;
Zhang, Ce ;
Fang, Shenghui ;
Duan, Chenxi ;
Meng, Xiaoliang ;
Atkinson, Peter M. .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 190 :196-214
[47]   A Novel Automatic Change Detection Method for Urban High-Resolution Remotely Sensed Imagery Based on Multiindex Scene Representation [J].
Wen, Dawei ;
Huang, Xin ;
Zhang, Liangpei ;
Benediktsson, Jon Atli .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (01) :609-625
[48]   CBAM: Convolutional Block Attention Module [J].
Woo, Sanghyun ;
Park, Jongchan ;
Lee, Joon-Young ;
Kweon, In So .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :3-19
[49]  
Xu Z. Yang, 2023, IEEETrans. Geosci. Remote Sens., V61
[50]   MRA-SNet: Siamese Networks of Multiscale Residual and Attention for Change Detection in High-Resolution Remote Sensing Images [J].
Yang, Xin ;
Hu, Lei ;
Zhang, Yongmei ;
Li, Yunqing .
REMOTE SENSING, 2021, 13 (22)