Heterogeneous Image Change Detection Based on Dual Image Translation and Dual Contrastive Learning

被引:2
|
作者
Ma, Zongfang [1 ]
Wang, Ruiqi [1 ]
Hao, Fan [2 ]
Song, Lin [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Informat & Control Engn, Xian 710055, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Integrated Circuits, Beijing 100876, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image reconstruction; Optical imaging; Representation learning; Optical sensors; Image sensors; Contrastive learning; heterogeneous change detection (CD); image translation; multiscale feature; REMOTE-SENSING IMAGES; UNSUPERVISED CHANGE DETECTION; SAR; CLASSIFICATION; NETWORK;
D O I
10.1109/TGRS.2024.3402391
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Nowadays, remote sensing (RS) change detection (CD) plays an important role in Earth observation applications. Recently, the value of cross-modal CD has gradually emerged because of the complementary features in content. However, existing domain adaption-based methods are generally limited to the optical domain and suffer from imbalanced information between modalities. In this article, a novel CD method based on dual image translation and dual contrastive learning (C3D) is proposed for heterogeneous RS images, including a translation module and a CD module. First, the translation module aims to learn a comparable representation between the different domains through a C3D structure based on feature samples, which can break the consistency constraint and better solve the imbalanced information. Then the similarity metric of patches is compared by contextual features at different scales in the CD module to achieve a more accurate classification of changed and unchanged pixels. The C3D is compared with state-of-the-art methods and validated by the basic experimental results on five datasets. In addition, further experiments on the translation module were also performed to explore the effectiveness of contrastive learning in the CD task.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [1] Unsupervised Change Detection From Heterogeneous Data Based on Image Translation
    Liu, Zhun-Ga
    Zhang, Zuo-Wei
    Pan, Quan
    Ning, Liang-Bo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Spectral normalization and dual contrastive regularization for image-to-image translation
    Zhao, Chen
    Cai, Wei-Ling
    Yuan, Zheng
    VISUAL COMPUTER, 2025, 41 (01) : 129 - 140
  • [3] Dual Circle Contrastive Learning-Based Blind Image Super-Resolution
    Qiu, Yajun
    Zhu, Qiang
    Zhu, Shuyuan
    Zeng, Bing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1757 - 1771
  • [4] A Hyperspectral Image Change Detection Framework With Self-Supervised Contrastive Learning Pretrained Model
    Ou, Xianfeng
    Liu, Liangzhen
    Tan, Shulun
    Zhang, Guoyun
    Li, Wujing
    Tu, Bing
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 7724 - 7740
  • [5] Deep Image Translation With an Affinity-Based Change Prior for Unsupervised Multimodal Change Detection
    Luppino, Luigi Tommaso
    Kampffmeyer, Michael
    Bianchi, Filippo Maria
    Moser, Gabriele
    Serpico, Sebastiano Bruno
    Jenssen, Robert
    Anfinsen, Stian Normann
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] CTACL:HYPERSPECTRAL IMAGE CHANGE DETECTION BASED ON ADAPTIVE CONTRASTIVE LEARNING
    Tian, Shunli
    Zhang, Xiangrong
    Wang, Guanchun
    Han, Xiao
    Chen, Puhua
    Cheng, Xina
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7340 - 7343
  • [7] Contrastive learning for unsupervised image-to-image translation
    Lee, Hanbit
    Seol, Jinseok
    Lee, Sang-goo
    Park, Jaehui
    Shim, Junho
    APPLIED SOFT COMPUTING, 2024, 151
  • [8] HETEROGENEOUS IMAGE CHANGE DETECTION BASED ON DEEP IMAGE TRANSLATION AND FEATURE REFINEMENT-AGGREGATION
    Zhao, Tianrui
    Wang, Lu
    Zhao, Chunhui
    Liu, Tian
    Ohtsuki, Tomoaki
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1705 - 1709
  • [9] Background-focused contrastive learning for unpaired image-to-image translation
    Shao, Mingwen
    Han, Minggui
    Meng, Lingzhuang
    Liu, Fukang
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (04)
  • [10] Multi-feature contrastive learning for unpaired image-to-image translation
    Gou, Yao
    Li, Min
    Song, Yu
    He, Yujie
    Wang, Litao
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 4111 - 4122