MULTI-TASK LEARNING FOR SEMANTIC CHANGE DETECTION ON VHR REMOTE SENSING IMAGES

被引:4
作者
Zhou, Yuan [1 ,2 ]
Zhu, Jiahang [1 ,2 ]
Huo, Leigang [3 ]
Huo, Chunlei [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[3] Nanning Normal Univ, Nanning, Peoples R China
来源
2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022) | 2022年
基金
中国国家自然科学基金;
关键词
Change detection; Multi-task learning; Semantic segmentation; Deep learning;
D O I
10.1109/IGARSS46834.2022.9883651
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Remote Sensing Images Change Detection (RSICD) aims to locate the changed regions between bitemporal very-high-resolution (VHR) sensing images. However, existing deep learning-based RSICD methods are from the requirements by practical application, mainly due to the low feature discrimination and limited accuracy. We propose a novel multi-task and multi-temporal encoder-decoder changed detection network (MMNet) for VHR images, which accomplished both semantic segmentation and change detection at the same time. The encoder extracts multi-level contextual information, which contains two semantic segmentation branches (SSB) and a change detection branch (CDB). In this way, change representation constrains semantic representation during training, which introduces a novel loss function to ensure the semantic consistency within the unchanged regions. Furthermore, to utilize multi-level feature representation for enhancing the separability of features, a multi-scale feature fusion module (MFFM) is presented.
引用
收藏
页码:3247 / 3250
页数:4
相关论文
共 50 条
[21]   LEVERAGING KNOWLEDGE DISTILLATION FOR PARTIAL MULTI-TASK LEARNING FROM MULTIPLE REMOTE SENSING DATASETS [J].
Hoang-An Le ;
Minh-Tan Pham .
2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2024), 2024, :8019-8023
[22]   SEG-ESRGAN: A Multi-Task Network for Super-Resolution and Semantic Segmentation of Remote Sensing Images [J].
Salgueiro, Luis ;
Marcello, Javier ;
Vilaplana, Veronica .
REMOTE SENSING, 2022, 14 (22)
[23]   ONLINE MULTI-TASK LEARNING FOR SEMANTIC CONCEPT DETECTION IN VIDEO [J].
Markatopoulou, Foteini ;
Mezaris, Vasileios ;
Patras, Ioannis .
2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, :186-190
[24]   Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images [J].
Volpi, Michele ;
Tuia, Devis .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 144 :48-60
[25]   A Dual Neighborhood Hypergraph Neural Network for Change Detection in VHR Remote Sensing Images [J].
Wu, Junzheng ;
Fu, Ruigang ;
Liu, Qiang ;
Ni, Weiping ;
Cheng, Kenan ;
Li, Biao ;
Sun, Yuli .
REMOTE SENSING, 2023, 15 (03)
[26]   Interdependent Multi-task Learning for Simultaneous Segmentation and Detection [J].
Reginthala, Mahesh ;
Iwahori, Yuji ;
Bhuyan, M. K. ;
Hayashi, Yoshitsugu ;
Achariyaviriya, Witsarut ;
Kijsirikul, Boonserm .
ICPRAM: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2020, :167-174
[27]   Aliasing Detection in Rendered Images via a Multi-Task Learning [J].
Fan, Shu-Ho ;
Hsiao, Kai-Wen ;
Tan, Kai Yi ;
Yao, Chih-Yuan ;
Chu, Hung-Kuo .
PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2024, 7 (03)
[28]   Automatic Semantic Segmentation with DeepLab Dilated Learning Network for Change Detection in Remote Sensing Images [J].
N. Venugopal .
Neural Processing Letters, 2020, 51 :2355-2377
[29]   Automatic Semantic Segmentation with DeepLab Dilated Learning Network for Change Detection in Remote Sensing Images [J].
Venugopal, N. .
NEURAL PROCESSING LETTERS, 2020, 51 (03) :2355-2377
[30]   Multi-task, multi-domain learning: Application to semantic segmentation and pose regression [J].
Fourure, Damien ;
Emonet, Remi ;
Fromont, Elisa ;
Muselet, Damien ;
Neverova, Natalia ;
Tremeau, Alain ;
Wolf, Christian .
NEUROCOMPUTING, 2017, 251 :68-80