Heterogeneous Image Change Detection Based on Dual Image Translation and Dual Contrastive Learning

被引:2
作者
Ma, Zongfang [1 ]
Wang, Ruiqi [1 ]
Hao, Fan [2 ]
Song, Lin [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Informat & Control Engn, Xian 710055, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Integrated Circuits, Beijing 100876, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image reconstruction; Optical imaging; Representation learning; Optical sensors; Image sensors; Contrastive learning; heterogeneous change detection (CD); image translation; multiscale feature; REMOTE-SENSING IMAGES; UNSUPERVISED CHANGE DETECTION; SAR; CLASSIFICATION; NETWORK;
D O I
10.1109/TGRS.2024.3402391
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Nowadays, remote sensing (RS) change detection (CD) plays an important role in Earth observation applications. Recently, the value of cross-modal CD has gradually emerged because of the complementary features in content. However, existing domain adaption-based methods are generally limited to the optical domain and suffer from imbalanced information between modalities. In this article, a novel CD method based on dual image translation and dual contrastive learning (C3D) is proposed for heterogeneous RS images, including a translation module and a CD module. First, the translation module aims to learn a comparable representation between the different domains through a C3D structure based on feature samples, which can break the consistency constraint and better solve the imbalanced information. Then the similarity metric of patches is compared by contextual features at different scales in the CD module to achieve a more accurate classification of changed and unchanged pixels. The C3D is compared with state-of-the-art methods and validated by the basic experimental results on five datasets. In addition, further experiments on the translation module were also performed to explore the effectiveness of contrastive learning in the CD task.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [41] An unsupervised heterogeneous change detection method based on image translation network and post-processing algorithm
    Wang, Decheng
    Zhao, Feng
    Yi, Hui
    Li, Yinan
    Chen, Xiangning
    [J]. INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2022, 15 (01) : 1056 - 1080
  • [42] Hate Speech Detection via Dual Contrastive Learning
    Lu, Junyu
    Lin, Hongfei
    Zhang, Xiaokun
    Li, Zhaoqing
    Zhang, Tongyue
    Zong, Linlin
    Ma, Fenglong
    Xu, Bo
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 2787 - 2795
  • [43] Dual Contrastive Learning with Anatomical Auxiliary Supervision for Few-Shot Medical Image Segmentation
    Wu, Huisi
    Xiao, Fangyan
    Liang, Chongxin
    [J]. COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 : 417 - 434
  • [44] An unsupervised dual contrastive learning framework for scatter correction in cone-beam CT image
    Wang, Tangsheng
    Liu, Xuan
    Dai, Jingjing
    Zhang, Chulong
    He, Wenfeng
    Liu, Lin
    Chan, Yinping
    He, Yutong
    Zhao, Hanqing
    Xie, Yaoqin
    Liang, Xiaokun
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 165
  • [45] UCGAN: a contrastive learning-based unaligned image translation model with importance reweighting
    Wang, Shibin
    Zhang, Shiying
    Liu, Dong
    Zhong, Jinghui
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (01)
  • [46] Purified Contrastive Learning With Global and Local Representation for Hyperspectral Image Classification
    Zhao, Lin
    Li, Jia
    Luo, Wenqiang
    Ouyang, Er
    Wu, Jianhui
    Zhang, Guoyun
    Li, Wujin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [47] DualAD: Dual adversarial network for image anomaly detection☆
    Wan, Yonghao
    Feng, Aimin
    [J]. IET COMPUTER VISION, 2024, 18 (08) : 1138 - 1148
  • [48] Image Block Compression Based on Dual-Learning Dictionaries
    Pan Wenchao
    Li Bo
    Chong Yanwen
    [J]. 2020 12TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2020, : 79 - 85
  • [49] Dual Perspective Contrastive Learning Based Subgraph Anomaly Detection on Attributed Networks
    Hu, Songlin
    Shao, Minglai
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 481 - 493
  • [50] Label contrastive learning for image classification
    Yang, Han
    Li, Jun
    [J]. SOFT COMPUTING, 2023, 27 (18) : 13477 - 13486