Remote Sensing Image Mode Translation by Spatial Disentangled Representation Based GAN

被引:0
|
作者
Han Zishuo [1 ]
Wang Chunping [1 ]
Fu Qiang [1 ]
Zhao Bin [1 ]
机构
[1] Army Engn Univ, Dept Elect & Opt Engn, Shijiazhuang Campus, Shijiazhuang 050003, Hebei, Peoples R China
关键词
remote sensing; image translation; synthetic aperture radar; optical remote sensing image; cycleconsistent adversarial networks;
D O I
10.3788/A0S202141.0728003
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Resting on the translation framework of spatially separated images, we proposed a cycle-consistent generative adversarial network (GAN) based on spatial disentangled representation to address the large mode difference and difficult translation between synthetic aperture radar images and optical remote sensing images. The proposed model separates images into style and content features by a deeper network layer and jump connection. Furthermore, the content features arc translated by content mapping learning and combined with target style features for image translation. In addition, PatchGAN, as the discriminator, enhances the image detail generation, and target error loss and generation & reconstruction loss arc introduced to limit the translation task to one-to-one mapping, thus reducing the information added and constraining the GAN. The experimental results in SEN1-2, SARptical, and WHU-SEN-City datasets show that compared with other image translation algorithms, the proposed method can translate two types of remote sensing images and generate images of high resolution, complete detail features, and strong authenticity.
引用
收藏
页数:14
相关论文
共 21 条
  • [11] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [12] Diverse Image-to-Image Translation via Disentangled Representations
    Lee, Hsin-Ying
    Tseng, Hung-Yu
    Huang, Jia-Bin
    Singh, Maneesh
    Yang, Ming-Hsuan
    [J]. COMPUTER VISION - ECCV 2018, PT I, 2018, 11205 : 36 - 52
  • [13] Feature Pyramid Networks for Object Detection
    Lin, Tsung-Yi
    Dollar, Piotr
    Girshick, Ross
    He, Kaiming
    Hariharan, Bharath
    Belongie, Serge
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 936 - 944
  • [14] QuC W, 2017, 2017 SAR BIG DAT ER, P1
  • [15] RenS Q, 2017, PROPOSALNETWORKSJ IE, P39
  • [16] THE SEN1-2 DATASET FOR DEEP LEARNING IN SAR-OPTICAL DATA FUSION
    Schmitt, M.
    Hughes, L. H.
    Zhu, X. X.
    [J]. ISPRS TC I MID-TERM SYMPOSIUM INNOVATIVE SENSING - FROM SENSORS TO METHODS AND APPLICATIONS, 2018, 4-1 : 141 - 146
  • [17] SAR-to-Optical Image Translation Using Supervised Cycle-Consistent Adversarial Networks
    Wang, Lei
    Xu, Xin
    Yu, Yue
    Yang, Rui
    Gui, Rong
    Xu, Zhaozhuo
    Pu, Fangling
    [J]. IEEE ACCESS, 2019, 7 : 129136 - 129149
  • [18] Wang YY, 2018, INT GEOSCI REMOTE SE, P6840, DOI 10.1109/IGARSS.2018.8518298
  • [19] Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks
    Yang, Xue
    Sun, Hao
    Fu, Kun
    Yang, Jirui
    Sun, Xian
    Yan, Menglong
    Guo, Zhi
    [J]. REMOTE SENSING, 2018, 10 (01)
  • [20] YangL SuJ, 2020, J ACTA OPTICA SINICA, V402