Commonality Autoencoder: Learning Common Features for Change Detection From Heterogeneous Images

被引:143
作者
Wu, Yue [1 ]
Li, Jiaheng [2 ]
Yuan, Yongzhe [1 ]
Qin, A. K. [3 ]
Miao, Qi-Guang [1 ]
Gong, Mao-Guo [2 ]
机构
[1] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
[2] Xidian Univ, Key Lab Intel Iigent Percept & Image Understandin, Minist Educ China, Xian 710071, Peoples R China
[3] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Melbourne, Vic 3122, Australia
基金
中国国家自然科学基金; 澳大利亚研究理事会;
关键词
Remote sensing; Feature extraction; Optical sensors; Optical imaging; Radar polarimetry; Image segmentation; Decoding; Change detection; commonality autoencoder; convolutional autoencoder (CAE); deep neural networks (DNNs); UNSUPERVISED CHANGE DETECTION; LAND-COVER CHANGE; FEATURE REPRESENTATION; CLASSIFICATION;
D O I
10.1109/TNNLS.2021.3056238
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Change detection based on heterogeneous images, such as optical images and synthetic aperture radar images, is a challenging problem because of their huge appearance differences. To combat this problem, we propose an unsupervised change detection method that contains only a convolutional autoencoder (CAE) for feature extraction and the commonality autoencoder for commonalities exploration. The CAE can eliminate a large part of redundancies in two heterogeneous images and obtain more consistent feature representations. The proposed commonality autoencoder has the ability to discover common features of ground objects between two heterogeneous images by transforming one heterogeneous image representation into another. The unchanged regions with the same ground objects share much more common features than the changed regions. Therefore, the number of common features can indicate changed regions and unchanged regions, and then a difference map can be calculated. At last, the change detection result is generated by applying a segmentation algorithm to the difference map. In our method, the network parameters of the commonality autoencoder are learned by the relevance of unchanged regions instead of the labels. Our experimental results on five real data sets demonstrate the promising performance of the proposed framework compared with several existing approaches.
引用
收藏
页码:4257 / 4270
页数:14
相关论文
共 45 条
  • [1] COEFFICIENT KAPPA - SOME USES, MISUSES, AND ALTERNATIVES
    BRENNAN, RL
    PREDIGER, DJ
    [J]. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1981, 41 (03) : 687 - 699
  • [2] Change Detection in Multisource VHR Images via Deep Siamese Convolutional Multiple-Layers Recurrent Neural Network
    Chen, Hongruixuan
    Wu, Chen
    Du, Bo
    Zhang, Liangpei
    Wang, Le
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (04): : 2848 - 2864
  • [3] Potential effects in multi-resolution post-classification change detection
    Colditz, Rene R.
    Acosta-Velazquez, Joanna
    Diaz Gallegos, Jose Reyes
    Vazquez Lule, Alma Delia
    Teresa Rodriguez-Zuniga, Maria
    Maeda, Pedro
    Cruz Lopez, Maria Isabel
    Ressl, Rainer
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2012, 33 (20) : 6426 - 6445
  • [4] De S, 2017, INT GEOSCI REMOTE SE, P5193, DOI 10.1109/IGARSS.2017.8128171
  • [5] Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images
    Du, Bo
    Ru, Lixiang
    Wu, Chen
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12): : 9976 - 9992
  • [6] A coupling translation network for change detection in heterogeneous images
    Gong, Maoguo
    Niu, Xudong
    Zhan, Tao
    Zhang, Mingyang
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2019, 40 (09) : 3647 - 3672
  • [7] Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks
    Gong, Maoguo
    Zhao, Jiaojiao
    Liu, Jia
    Miao, Qiguang
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (01) : 125 - 138
  • [8] Coupled Dictionary Learning for Change Detection From Multisource Data
    Gong, Maoguo
    Zhang, Puzhao
    Su, Linzhi
    Liu, Jia
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12): : 7077 - 7091
  • [9] From W-Net to CDGAN: Bitemporal Change Detection via Deep Learning Techniques
    Hou, Bin
    Liu, Qingjie
    Wang, Heng
    Wang, Yunhong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03): : 1790 - 1802
  • [10] A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images
    Liu, Jia
    Gong, Maoguo
    Qin, Kai
    Zhang, Puzhao
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (03) : 545 - 559