MF-SRCDNet: Multi-feature fusion super-resolution building change detection framework for multi-sensor high-resolution remote sensing imagery

被引:43
作者
Li, Shaochun
Wang, Yanjun [1 ]
Cai, Hengfan
Lin, Yunhao
Wang, Mengjie
Teng, Fei
机构
[1] Hunan Univ Sci & Technol, Hunan Prov Key Lab Geoinformat Engn Surveying Mapp, Xiangtan 411201, Peoples R China
关键词
Multi-sensor; Super-resolution; Multi-feature fusion; Building change detection; Deep learning; EXTRACTION;
D O I
10.1016/j.jag.2023.103303
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Building change detection is essential for evaluating land use, land cover change, and sustainable development. However, owing to the mismatched resolutions from multi-sensors and the complexity of the features of high-resolution images, traditional methods of building change detection have problems with accuracy and appli-cability. In this study, we propose a deep-learning-based multi-feature fusion super-resolution building change detection framework (MF-SRCDNet), comprising super-resolution (SR), multi-feature fusion, and change detec-tion (CD) modules. The SR module introduces a Res-UNet network to generate unified SR images with rich se-mantic information. To enhance the performance of MF-SRCDNet for complex building detection, an effective right-angle edge vision feature was designed and fused with a CD module with an improved feature extractor. The proposed method achieved the highest F1 values of 0.881, 0.857, and 0.964 for the three datasets, respectively, compared with different modules. The results also show improved robustness in different bi-temporal image resolution scale-difference experiments. The method proposed in this study can be applied to a variety of complex scenarios for building CD tasks with strong model generalization.
引用
收藏
页数:14
相关论文
共 34 条
[1]   Change detection techniques for remote sensing applications: a survey [J].
Asokan, Anju ;
Anitha, J. .
EARTH SCIENCE INFORMATICS, 2019, 12 (02) :143-160
[2]   An Optimized Faster R-CNN Method Based on DRNet and RoI Align for Building Detection in Remote Sensing Images [J].
Bai, Tong ;
Pang, Yu ;
Wang, Junchao ;
Han, Kaining ;
Luo, Jiasai ;
Wang, Huiqian ;
Lin, Jinzhao ;
Wu, Jun ;
Zhang, Hui .
REMOTE SENSING, 2020, 12 (05)
[3]   An Improved Res-UNet Model for Tree Species Classification Using Airborne High-Resolution Images [J].
Cao, Kaili ;
Zhang, Xiaoli .
REMOTE SENSING, 2020, 12 (07)
[4]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[5]   A hierarchical self-attention augmented Laplacian pyramid expanding network for change detection in high-resolution remote sensing images [J].
Cheng, Hongquan ;
Wu, Huayi ;
Zheng, Jie ;
Qi, Kunlun ;
Liu, Wenxuan .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 182 :52-66
[6]   DSA-Net: A novel deeply supervised attention-guided network for building change detection in high-resolution remote sensing images [J].
Ding, Qing ;
Shao, Zhenfeng ;
Huang, Xiao ;
Altan, Orhan .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 105
[7]   Application of Multiscale Facial Feature Manifold Learning Based on VGG-16 [J].
Ge, Huilin ;
Zhu, Zhiyu ;
Liu, Runbang ;
Wu, Xuedong .
JOURNAL OF SENSORS, 2021, 2021
[8]   Coupled Dictionary Learning for Change Detection From Multisource Data [J].
Gong, Maoguo ;
Zhang, Puzhao ;
Su, Linzhi ;
Liu, Jia .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7077-7091
[9]   Remote sensing image building detection method based on Mask R-CNN [J].
Han, Qinzhe ;
Yin, Qian ;
Zheng, Xin ;
Chen, Ziyi .
COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (03) :1847-1855
[10]   Recognition of basketball players' action detection based on visual image and Harris corner extraction algorithm [J].
Hao, Zongshuai ;
Wang, Xin ;
Zheng, Shoucun .
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 40 (04) :7589-7599