CGMNet: Semantic Change Detection via a Change-Aware Guided Multi-Task Network

被引:3
作者
Tan, Li [1 ]
Zuo, Xiaolong [2 ]
Cheng, Xi [1 ]
机构
[1] Chengdu Univ Technol, Coll Geophys, Chengdu 610059, Peoples R China
[2] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
关键词
semantic change detection; deep learning; change-aware mask; multi-task network; BUILDING CHANGE DETECTION; SIAMESE NETWORK; IMAGES; CLASSIFICATION;
D O I
10.3390/rs16132436
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection (CD) is the main task in the remote sensing field. Binary change detection (BCD), which only focuses on the region of change, cannot meet current needs. Semantic change detection (SCD) is pivotal for identifying regions of change in sequential remote sensing imagery, focusing on discerning "from-to" transitions in land cover. The emphasis on features within these regions of change is critical for SCD efficacy. Traditional methodologies, however, often overlook this aspect. In order to address this gap, we introduce a change-aware guided multi-task network (CGMNet). This innovative network integrates a change-aware mask branch, leveraging prior knowledge of regions of change to enhance land cover classification in dual temporal remote sensing images. This strategic focus allows for the more accurate identification of altered regions. Furthermore, to navigate the complexities of remote sensing environments, we develop a global and local attention mechanism (GLAM). This mechanism adeptly captures both overarching and fine-grained spatial details, facilitating more nuanced analysis. Our rigorous testing on two public datasets using state-of-the-art methods yielded impressive results. CGMNet achieved Overall Score metrics of 58.77% on the Landsat-SCD dataset and 37.06% on the SECOND dataset. These outcomes not only demonstrate the exceptional performance of the method but also signify its superiority over other comparative algorithms.
引用
收藏
页数:19
相关论文
共 51 条
[1]   Deep learning for change detection in remote sensing: a review [J].
Bai, Ting ;
Wang, Le ;
Yin, Dameng ;
Sun, Kaimin ;
Chen, Yepei ;
Li, Wenzhuo ;
Li, Deren .
GEO-SPATIAL INFORMATION SCIENCE, 2023, 26 (03) :262-288
[2]   A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION [J].
Bandara, Wele Gedara Chaminda ;
Patel, Vishal M. .
2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, :207-210
[3]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[4]   Multitask learning [J].
Caruana, R .
MACHINE LEARNING, 1997, 28 (01) :41-75
[5]   Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering [J].
Celik, Turgay .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) :772-776
[6]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[7]   MTSCD-Net: A network based on multi-task learning for semantic change detection of bitemporal remote sensing images [J].
Cui, Fengzhi ;
Jiang, Jie .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 118
[8]   Multitask learning for large-scale semantic change detection [J].
Daudt, Rodrigo Caye ;
Le Saux, Bertrand ;
Boulch, Alexandre ;
Gousseau, Yann .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 187
[9]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[10]   Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing Images [J].
Ding, Lei ;
Guo, Haitao ;
Liu, Sicong ;
Mou, Lichao ;
Zhang, Jing ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60