Toward Efficient Remote Sensing Image Change Detection via Cross-Temporal Context Learning

被引:7
作者
Song, Ze [1 ,2 ]
Wei, Xiaohui [1 ,2 ]
Kang, Xudong [3 ]
Li, Shutao [1 ,2 ]
Liu, Jinyang [1 ,2 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[2] Hunan Univ, Key Lab Visual Percept & Artificial Intelligence H, Changsha 410082, Peoples R China
[3] Hunan Univ, Sch Robot, Changsha 410082, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Attention mechanism; change detection (CD); high-resolution optical remote sensing image; NETWORK;
D O I
10.1109/TGRS.2023.3280902
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Change detection (CD) aims to find areas of specific changes in multitemporal remote sensing images. The existing methods fail to adequately explore the cross-temporal global context, making the establishment of spatial-temporal deep global associations insufficient and inefficient. As a result, their performance is vulnerable to complex and various objects in changing scenes. Hence, we propose a cross-temporal context learning network, termed as CCLNet, where the intratemporal and intertemporal long-range dependencies are mined and interactively fused, to fully exploit the cross-temporal context information. Specifically, a lightweight convolutional neural network (CNN) is first used to extract deep semantic features. Then, a well-designed cross-temporal fusion transformer (CFT) is proposed to locate the changing objects in the scene by establishing the long-range dependence across bitemporal images. Thanks to this, temporal-specific information extraction and cross-temporal information integration are seamlessly integrated into the same network, thereby significantly improving the discriminative features of changing objects. Furthermore, this allows us to use naive backbones with low computational costs to achieve reliable CD performance. Experiments on mainstream benchmarks show that our proposed method can handle CD tasks faster than state-of-the-art (SOTA) methods while maintaining better or comparable matching accuracy on a single RTX3090.
引用
收藏
页数:10
相关论文
共 46 条
  • [1] Street-view change detection with deconvolutional networks
    Alcantarilla, Pablo F.
    Stent, Simon
    Ros, German
    Arroyo, Roberto
    Gherardi, Riccardo
    [J]. AUTONOMOUS ROBOTS, 2018, 42 (07) : 1301 - 1322
  • [2] A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION
    Bandara, Wele Gedara Chaminda
    Patel, Vishal M.
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 207 - 210
  • [3] PPCNET: A Combined Patch-Level and Pixel-Level End-to-End Deep Network for High-Resolution Remote Sensing Image Change Detection
    Bao, Tengfei
    Fu, Chenqin
    Fang, Tao
    Huo, Hong
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (10) : 1797 - 1801
  • [4] Carion Nicolas, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P213, DOI 10.1007/978-3-030-58452-8_13
  • [5] Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering
    Celik, Turgay
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) : 772 - 776
  • [6] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [8] DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images
    Chen, Jie
    Yuan, Ziyang
    Peng, Jian
    Chen, Li
    Huang, Haozhe
    Zhu, Jiawei
    Liu, Yu
    Li, Haifeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 1194 - 1206
  • [9] Dai Z, 2021, ADV NEUR IN, V34
  • [10] Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652