Heterogeneous Image Change Detection Based on Dual Image Translation and Dual Contrastive Learning

被引:2
作者
Ma, Zongfang [1 ]
Wang, Ruiqi [1 ]
Hao, Fan [2 ]
Song, Lin [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Informat & Control Engn, Xian 710055, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Integrated Circuits, Beijing 100876, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image reconstruction; Optical imaging; Representation learning; Optical sensors; Image sensors; Contrastive learning; heterogeneous change detection (CD); image translation; multiscale feature; REMOTE-SENSING IMAGES; UNSUPERVISED CHANGE DETECTION; SAR; CLASSIFICATION; NETWORK;
D O I
10.1109/TGRS.2024.3402391
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Nowadays, remote sensing (RS) change detection (CD) plays an important role in Earth observation applications. Recently, the value of cross-modal CD has gradually emerged because of the complementary features in content. However, existing domain adaption-based methods are generally limited to the optical domain and suffer from imbalanced information between modalities. In this article, a novel CD method based on dual image translation and dual contrastive learning (C3D) is proposed for heterogeneous RS images, including a translation module and a CD module. First, the translation module aims to learn a comparable representation between the different domains through a C3D structure based on feature samples, which can break the consistency constraint and better solve the imbalanced information. Then the similarity metric of patches is compared by contextual features at different scales in the CD module to achieve a more accurate classification of changed and unchanged pixels. The C3D is compared with state-of-the-art methods and validated by the basic experimental results on five datasets. In addition, further experiments on the translation module were also performed to explore the effectiveness of contrastive learning in the CD task.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [31] Dual Contrastive Learning Network for Graph Clustering
    Peng, Xin
    Cheng, Jieren
    Tang, Xiangyan
    Liu, Jingxin
    Wu, Jiahua
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 10846 - 10856
  • [32] Sparse-Constrained Adaptive Structure Consistency-Based Unsupervised Image Regression for Heterogeneous Remote- Sensing Change Detection
    Sun, Yuli
    Lei, Lin
    Guan, Dongdong
    Li, Ming
    Kuang, Gangyao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [33] Remote Sensing Image Change Detection Transformer Network Based on Dual-Feature Mixed Attention
    Song, Xinyang
    Hua, Zhen
    Li, Jinjiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [34] Progressive Negative Enhancing Contrastive Learning for Image Dehazing and Beyond
    Cheng, De
    Li, Yan
    Zhang, Dingwen
    Wang, Nannan
    Sun, Jiande
    Gao, Xinbo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8783 - 8798
  • [35] Bipartite Adversarial Autoencoders With Structural Self-Similarity for Unsupervised Heterogeneous Remote Sensing Image Change Detection
    Jia, Meng
    Zhang, Cheng
    Lv, Zhiyong
    Zhao, Zhiqiang
    Wang, Lei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [36] Dual Heterogeneous Network for Hyperspectral Image Classification
    Jin, Mingxin
    Wang, Cong
    Yuan, Yuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (03) : 2905 - 2917
  • [37] Transformer-based contrastive learning framework for image anomaly detection
    Wentao Fan
    Weimin Shangguan
    Yewang Chen
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3413 - 3426
  • [38] Asymmetric slack contrastive learning for full use of feature information in image translation
    Zhang, Yusen
    Li, Min
    Gou, Yao
    He, Yujie
    KNOWLEDGE-BASED SYSTEMS, 2024, 299
  • [39] Transformer-based contrastive learning framework for image anomaly detection
    Fan, Wentao
    Shangguan, Weimin
    Chen, Yewang
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (10) : 3413 - 3426
  • [40] Change-Aware Cascaded Dual-Decoder Network for Remote Sensing Image Change Detection
    Yang, Feng
    Yuan, Yifeng
    Qin, Anyong
    Zhao, Yue
    Song, Tiecheng
    Gao, Chenqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62