Heterogeneous Image Change Detection Based on Dual Image Translation and Dual Contrastive Learning

被引:2
作者
Ma, Zongfang [1 ]
Wang, Ruiqi [1 ]
Hao, Fan [2 ]
Song, Lin [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Informat & Control Engn, Xian 710055, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Integrated Circuits, Beijing 100876, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image reconstruction; Optical imaging; Representation learning; Optical sensors; Image sensors; Contrastive learning; heterogeneous change detection (CD); image translation; multiscale feature; REMOTE-SENSING IMAGES; UNSUPERVISED CHANGE DETECTION; SAR; CLASSIFICATION; NETWORK;
D O I
10.1109/TGRS.2024.3402391
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Nowadays, remote sensing (RS) change detection (CD) plays an important role in Earth observation applications. Recently, the value of cross-modal CD has gradually emerged because of the complementary features in content. However, existing domain adaption-based methods are generally limited to the optical domain and suffer from imbalanced information between modalities. In this article, a novel CD method based on dual image translation and dual contrastive learning (C3D) is proposed for heterogeneous RS images, including a translation module and a CD module. First, the translation module aims to learn a comparable representation between the different domains through a C3D structure based on feature samples, which can break the consistency constraint and better solve the imbalanced information. Then the similarity metric of patches is compared by contextual features at different scales in the CD module to achieve a more accurate classification of changed and unchanged pixels. The C3D is compared with state-of-the-art methods and validated by the basic experimental results on five datasets. In addition, further experiments on the translation module were also performed to explore the effectiveness of contrastive learning in the CD task.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [21] Dual multi scale networks for medical image segmentation using contrastive learning
    Dhamale, Akshat
    Rajalakshmi, Ratnavel
    Balasundaram, Ananthakrishnan
    IMAGE AND VISION COMPUTING, 2025, 154
  • [22] When dual contrastive learning meets disentangled features for unpaired image deraining
    Tianming Wang
    Kaige Wang
    Qing Li
    Machine Vision and Applications, 2023, 34
  • [23] Diverse Image Captioning via Conditional Variational Autoencoder and Dual Contrastive Learning
    Xu, Jing
    Liu, Bing
    Zhou, Yong
    Liu, Mingming
    Yao, Rui
    Shao, Zhiwen
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (01)
  • [24] Dual heterogeneous graph contrastive learning for QoS prediction
    Xiu, Yuting
    Ding, Ding
    Wu, Ziteng
    Zhao, Yuekun
    Liu, Jiaqi
    APPLIED INTELLIGENCE, 2025, 55 (07)
  • [25] Image Translation and Reconstruction Using a Single Dual Mode Lightweight Encoder
    Amendola, Jose
    Cenkeramaddi, Linga Reddy
    Jha, Ajit
    IEEE ACCESS, 2024, 12 : 26787 - 26799
  • [26] Continuous image anomaly detection based on contrastive lifelong learning
    Wentao Fan
    Weimin Shangguan
    Nizar Bouguila
    Applied Intelligence, 2023, 53 : 17693 - 17707
  • [27] Dual-decoding branch contrastive augmentation for image manipulation localization
    Zeng, Qiang
    Wang, Hongxia
    Zhou, Yang
    Zhang, Rui
    KNOWLEDGE-BASED SYSTEMS, 2025, 309
  • [28] Dual Learning-Based Graph Neural Network for Remote Sensing Image Super-Resolution
    Liu, Ziyu
    Feng, Ruyi
    Wang, Lizhe
    Han, Wei
    Zeng, Tieyong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [29] Continuous image anomaly detection based on contrastive lifelong learning
    Fan, Wentao
    Shangguan, Weimin
    Bouguila, Nizar
    APPLIED INTELLIGENCE, 2023, 53 (14) : 17693 - 17707
  • [30] Dual-Branch Difference Amplification Graph Convolutional Network for Hyperspectral Image Change Detection
    Qu, Jiahui
    Xu, Yunshuang
    Dong, Wenqian
    Li, Yunsong
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60