Enhanced Multitask Semantic Change Detection via Semi-Supervised Learning in LULC Segmentation Subtask

被引:0
作者
Wang, Zhewei [1 ,2 ,3 ]
Pan, Zongxu [1 ,2 ,3 ]
Long, Hui [1 ,2 ,3 ]
Hu, Yuxin [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Key Lab Technol Geospatial Informat Proc & Applica, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 101408, Peoples R China
关键词
Multitask learning; remote sensing images; semantic change detection (SCD); semi-supervised learning;
D O I
10.1109/LGRS.2024.3398768
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Change detection (CD) plays a crucial role in remote sensing analysis. Semantic change detection (SCD) further expands CD by incorporating land use and land cover (LULC) segmentation before and after the changes, identifying specific change categories alongside the change area detection. While recent studies combining change area detection and bitemporal LULC segmentation within a multitask framework demonstrate promising performance, they often only utilize pixels in changed areas with change classification labels in LULC segmentation training, overlooking substantial unlabeled LULC data in unchanged areas, which restricts the model's effectiveness. Accordingly, we propose an enhanced multitask SCD method with semi-supervised learning in LULC segmentation, effectively leveraging the extensive unlabeled LULC data and improving the overall performance of the multitask framework. Besides, we introduce a novel loss tailored for this semi-supervised method based on the unique relationship between bitemporal pixel labels in change areas and change classification. Optimization of the semi-supervised loss weighting further refines the training. Experiments on the public dataset validate the effectiveness of these improvements, especially in enhancing change classification performance. Applying our method to the naive model yields improvements in SeK and Fscd, with the increases of up to 2%. The code will be available after the acceptance at https://github.com/ijnokml/scd-enhanced.
引用
收藏
页码:1 / 5
页数:5
相关论文
共 12 条
[1]   MTSCD-Net: A network based on multi-task learning for semantic change detection of bitemporal remote sensing images [J].
Cui, Fengzhi ;
Jiang, Jie .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 118
[2]   Multitask learning for large-scale semantic change detection [J].
Daudt, Rodrigo Caye ;
Le Saux, Bertrand ;
Boulch, Alexandre ;
Gousseau, Yann .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 187
[3]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[4]  
Ding J. Zhang, 2024, IEEE Trans. Geosci. Remote Sens., V62, DOI [10.1109/TGRS.2024.3362795.7L, DOI 10.1109/TGRS.2024.3362795.7L]
[5]   Looking Outside the Window: Wide-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images [J].
Ding, Lei ;
Lin, Dong ;
Lin, Shaofu ;
Zhang, Jing ;
Cui, Xiaojie ;
Wang, Yuebin ;
Tang, Hao ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   Spatiotemporal Enhancement and Interlevel Fusion Network for Remote Sensing Images Change Detection [J].
Huang, Yanyuan ;
Li, Xinghua ;
Du, Zhengshun ;
Shen, Huanfeng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-14
[8]   Change detection techniques [J].
Lu, D ;
Mausel, P ;
Brondízio, E ;
Moran, E .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2004, 25 (12) :2365-2407
[9]   SFGT-CD: Semantic Feature-Guided Building Change Detection From Bitemporal Remote-Sensing Images With Transformers [J].
Pang, Shiyan ;
Lan, Jingjing ;
Zuo, Zhiqi ;
Chen, Jia .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 :1-5
[10]  
Sohn K., 2020, P 34 C NEUR INF PROC, V33, P596