Double U-Net (W-Net): A change detection network with two heads for remote sensing imagery

被引:36
作者
Wang, Xue [1 ,2 ]
Yan, Xulan [1 ,2 ]
Tan, Kun [1 ,2 ]
Pan, Chen [2 ,3 ]
Ding, Jianwei [4 ]
Liu, Zhaoxian [4 ]
Dong, Xinfeng [5 ]
机构
[1] East China Normal Univ, Key Lab Geog Informat Sci, Minist Educ, Shanghai 200241, Peoples R China
[2] East China Normal Univ, Key Lab Spatial Temporal Big Data Anal & Applicat, Minist Nat Resources, Shanghai 200241, Peoples R China
[3] Shanghai Municipal Inst Surveying & Mapping, Shanghai 200063, Peoples R China
[4] Second Surveying & Mapping Inst Hebei, Shijiazhuang 050037, Peoples R China
[5] China Aero Geophys Survey & Remote Sensing Ctr Nat, Beijing 100083, Peoples R China
关键词
Superpixel; Double head; Deep learning; Change detection;
D O I
10.1016/j.jag.2023.103456
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Recently, the deep learning algorithms have been increasingly utilized in remote sensing change detection. However, incomplete buildings and the blurred edges caused by the complex scenes in change detection applications make the detection results fail to describe the real land cover changes. Superpixels can be used to alleviate edge blurring, but the existing superpixel methods cannot be trained jointly with the models in change detection. In this work, we investigated an innovative double-head method using deep learning, called double UNet (W-Net), which consists of a superpixel module and a change detection module. Due to the superpixel module, W-Net can handle building edges very well. In order to solve problem that multiple subtasks fail to achieve the optimal results, a two-branch multi-task coupling framework of change detection and superpixels is designed for W-Net, which enables the model to achieve a globally optimal detection performance. The advancement of the W-Net was demonstrated using three public datasets. The F1score on LEVIR-CD dataset was 0.9031 and kappa coefficient was 0.8969. The F1-score on WHU building dataset was 0.9172 and kappa coefficient was 0.9142. The F1-score on SYSU-CD dataset was 0.8167and and kappa coefficient was 0.7724. The experiments confirmed that the W-Net is capable to detect the edges of changed area better and outperforms the other advanced change detection methods.
引用
收藏
页数:14
相关论文
共 34 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   A split-based approach to unsupervised change detection in large-size multitemporal images: Application to tsunami-damage assessment [J].
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (06) :1658-1670
[3]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[6]   Image superpixel segmentation based on hierarchical multi-level LI-SLIC [J].
Di, Shuanhu ;
Liao, Miao ;
Zhao, Yuqian ;
Li, Yang ;
Zeng, Yezhan .
OPTICS AND LASER TECHNOLOGY, 2021, 135
[7]   Superpixel Convolutional Networks Using Bilateral Inceptions [J].
Gadde, Raghudeep ;
Jampani, Varun ;
Kiefel, Martin ;
Kappler, Daniel ;
Gehler, Peter V. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :597-613
[8]   Superpixel Sampling Networks [J].
Jampani, Varun ;
Sun, Deqing ;
Liu, Ming-Yu ;
Yang, Ming-Hsuan ;
Kautz, Jan .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :363-380
[9]   Spatiotemporal Monitoring of a Grassland Ecosystem and Its Net Primary Production Using Google Earth Engine: A Case Study of Inner Mongolia from 2000 to 2020 [J].
Ji, Renjie ;
Tan, Kun ;
Wang, Xue ;
Pan, Chen ;
Xin, Liang .
REMOTE SENSING, 2021, 13 (21)
[10]   Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set [J].
Ji, Shunping ;
Wei, Shiqing ;
Lu, Meng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (01) :574-586