Multi-Scale Feature Interaction Network for Remote Sensing Change Detection

被引:7
作者
Zhang, Chong [1 ]
Zhang, Yonghong [1 ]
Lin, Haifeng [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equipm, Nanjing 210044, Peoples R China
[2] Nanjing Forestry Univ, Coll Informat Sci & Technol, Nanjing 210044, Peoples R China
关键词
remote sensing; change detection; convolution; multi-scale feature interaction; deep learning;
D O I
10.3390/rs15112880
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection (CD) is an important remote sensing (RS) data analysis technology. Existing remote sensing change detection (RS-CD) technologies cannot fully consider situations where pixels between bitemporal images do not correspond well on a one-to-one basis due to factors such as seasonal changes and lighting conditions. Existing networks construct two identical feature extraction branches through convolution, which share weights. The two branches work independently and do not merge until the feature mapping is sent to the decoder head. This results in a lack of feature information interaction between the two images. So, directing attention to the change area is of research interest. In complex backgrounds, the loss of edge details is very important. Therefore, this paper proposes a new CD algorithm that extracts multi-scale feature information through the backbone network in the coding stage. According to the task characteristics of CD, two submodules (the Feature Interaction Module and Detail Feature Guidance Module) are designed to make the feature information between the bitemporal RS images fully interact. Thus, the edge details are restored to the greatest extent while fully paying attention to the change areas. Finally, in the decoding stage, the feature information of different levels is fully used for fusion and decoding operations. We build a new CD dataset to further verify and test the model's performance. The generalization and robustness of the model are further verified by using two open datasets. However, due to the relatively simple construction of the model, it cannot handle the task of multi-classification CD well. Therefore, further research on multi-classification CD algorithms is recommended. Moreover, due to the high production cost of CD datasets and the difficulty in obtaining them in practical tasks, future research will look into semi-supervised or unsupervised related CD algorithms.
引用
收藏
页数:15
相关论文
共 40 条
[1]   Principal component analysis [J].
Abdi, Herve ;
Williams, Lynne J. .
WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2010, 2 (04) :433-459
[2]   MANet: a multi-level aggregation network for semantic segmentation of high-resolution remote sensing images [J].
Chen, Bingyu ;
Xia, Min ;
Qian, Ming ;
Huang, Junqing .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (15-16) :5874-5894
[3]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[4]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[5]   MFGAN: multi feature guided aggregation network for remote sensing image [J].
Chu, Shengguang ;
Li, Peng ;
Xia, Min .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (12) :10157-10173
[6]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[7]   A comprehensive review of earthquake-induced building damage detection with remote sensing techniques [J].
Dong, Laigen ;
Shan, Jie .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2013, 84 :85-99
[8]   SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images [J].
Fang, Sheng ;
Li, Kaiyu ;
Shao, Jinyuan ;
Li, Zhe .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[9]   Land Cover classification and change-detection analysis using multi-temporal remote sensed imagery and landscape metrics [J].
Fichera, Carmelo Riccardo ;
Modica, Giuseppe ;
Pollino, Maurizio .
EUROPEAN JOURNAL OF REMOTE SENSING, 2012, 45 (01) :1-18
[10]   MLNet: multichannel feature fusion lozenge network for land segmentation [J].
Gao, Jiahong ;
Weng, Liguo ;
Xia, Min ;
Lin, Haifeng .
JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (01)