Change detection for multispectral images using modified semantic segmentation network

被引:3
作者
Su, Linzhi [1 ]
Xie, Qiaoyun [1 ]
Zhao, Fengjun [1 ]
Cao, Xin [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian, Peoples R China
关键词
change detection; multispectral image; semantic segmentation; deep neural networks; UNSUPERVISED CHANGE DETECTION; CHANGE VECTOR ANALYSIS; MODEL;
D O I
10.1117/1.JRS.16.014518
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection is a significant issue for understanding the changes occurring on the land surface. We propose a change detection approach based on a semantic segmentation network from multispectral (MS) images. Different from the traditional approaches that learn deep features from the change index or establish mapping relations from patches, the proposed approach employs the semantic segmentation network UNet++ for end-to-end change detection. Nevertheless, in UNet++, the deep feature is directly upsampled from the node in the lower level and does not involve much information from the nodes in the other levels. To cope with this problem and further enhance its robustness, the zigzag UNet++ (ZUNet++) is developed. In ZUNet++, the zigzag connection between nodes can be found, so the inputs of the node involve not only the upsampled deep feature but also the downsampled shallow feature, i.e., the network fuses multiple feature information. In addition, as few MS training datasets are available, we designed a strategy in which each MS image is transferred into several pseudo-RGB images; thus the network is trained by available RGB training sets and can be applied to the testing MS datasets. In the experiment, three real testing MS datasets that reflect different types of changes in Xi' an City are used. Experimental results show that, upon determining the appropriate parameter, the proposed ZUNet++ outperforms the other state-of-the-art approaches, demonstrating its feasibility and effectiveness. (C) 2022 Society of Photo-Optical Instrumentation Engineers (SPIE)
引用
收藏
页数:20
相关论文
共 61 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images [J].
Bazi, Y ;
Bruzzone, L ;
Melgani, F .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2005, 43 (04) :874-887
[3]   Two-dimensional wavelet algorithm for interferometric synthetic aperture radar phase filtering enhancement [J].
Ben Abdallah, Wajih ;
Abdelfattah, Riadh .
JOURNAL OF APPLIED REMOTE SENSING, 2015, 9
[4]   Learning Deep Architectures for AI [J].
Bengio, Yoshua .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01) :1-127
[5]   Practical approach for synthetic aperture radar change analysis in urban environments [J].
Boldt, Markus ;
Thiele, Antje ;
Schulz, Karsten ;
Meyer, Franz J. ;
Hinz, Stefan .
JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (03)
[6]  
Bousias Alexakis E., 2020, Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci., V43, P1507, DOI DOI 10.5194/ISPRS-ARCHIVES-XLIII-B3-2020-1507-2020
[7]   A theoretical framework for unsupervised change detection based on change vector analysis in the polar domain [J].
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (01) :218-236
[8]   A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images [J].
Bovolo, Francesca ;
Marchesi, Silvia ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (06) :2196-2212
[9]   Multitask learning for large-scale semantic change detection [J].
Daudt, Rodrigo Caye ;
Le Saux, Bertrand ;
Boulch, Alexandre ;
Gousseau, Yann .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 187
[10]   Convolutional Neural Network Features Based Change Detection in Satellite Images [J].
El Amin, Arabi Mohammed ;
Liu, Qingjie ;
Wang, Yunhong .
FIRST INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2016, 0011