How to Reduce Change Detection to Semantic Segmentation

被引:19
作者
Wang, Guo-Hua [1 ]
Gao, Bin-Bin [2 ]
Wang, Chengjie [2 ,3 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] Tencent, YouTu Lab, Shenzhen, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
关键词
Change detection; Semantic segmentation; Feature fusion;
D O I
10.1016/j.patcog.2023.109384
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Change detection (CD) aims to identify changes that occur in an image pair taken different times. Prior methods devise specific networks from scratch to predict change masks in pixel-level, and struggle with general segmentation problems. In this paper, we propose a new paradigm that reduces CD to semantic segmentation which means tailoring an existing and powerful semantic segmentation network to solve CD. This new paradigm conveniently enjoys the mainstream semantic segmentation techniques to deal with general segmentation problems in CD. Hence we can concentrate on studying how to detect changes. We propose a novel and importance insight that different change types exist in CD and they should be learned separately. Based on it, we devise a module named MTF to extract the change information and fuse temporal features. MTF enjoys high interpretability and reveals the essential characteristic of CD. And most segmentation networks can be adapted to solve the CD problems with our MTF module. Finally, we propose C-3PO, a network to detect changes at pixel-level. C-3PO achieves state-of-the-art performance without bells and whistles. It is simple but effective and can be considered as a new baseline in this field. Our code for C-3PO is available at https://github.com/DoctorKey/C-3PO .(c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:11
相关论文
共 40 条
[1]   Street-view change detection with deconvolutional networks [J].
Alcantarilla, Pablo F. ;
Stent, Simon ;
Ros, German ;
Arroyo, Roberto ;
Gherardi, Riccardo .
AUTONOMOUS ROBOTS, 2018, 42 (07) :1301-1322
[2]  
[Anonymous], INT C LEARNING REPRE
[3]  
[Anonymous], 2017, C COMP VIS PATT REC
[4]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[5]  
Chen LC, 2017, Arxiv, DOI arXiv:1706.05587
[6]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[7]   DR-TANet: Dynamic Receptive Temporal Attention Network for Street Scene Change Detection [J].
Chen, Shuo ;
Yang, Kailun ;
Stiefelhagen, Rainer .
2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, :502-509
[8]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[9]  
Dosovitskiy A., 2021, INT C LEARN REPR
[10]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149