Enhanced Unpaired Image-to-Image Translation via Transformation in Saliency Domain

被引:0
|
作者
Shibasaki, Kei [1 ]
Ikehara, Masaaki [1 ]
机构
[1] Keio Univ, Fac Sci & Technol, Dept Elect & Informat Engn, Yokohama, Kanagawa 2238522, Japan
来源
IEEE ACCESS | 2023年 / 11卷
关键词
Computer vision; Generative adversarial networks; Saliency detection; deep learning; unpaired image to image translation; generative adversarial networks; saliency domain;
D O I
10.1109/ACCESS.2023.3338629
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unpaired image to image translation is the task of converting images in unpaired datasets. The primary goal of the task is to translate a source image into the image aligned with the target domain while keeping the fundamental content. Existing researches have introduced effective techniques to translate images with unpaired datasets, focusing on preserving the fundamental content. However, these techniques have limitations in dealing with significant shape changes and preserving backgrounds that should not be transformed. The proposed method attempts to address these problems by utilizing the saliency domain for translation and simultaneously learning the translation in the saliency domain as well as in the image domain. The saliency domain represents the shape and position of the main object. The explicit learning of transformations within the saliency domain improves network's ability to transform shapes while maintaining the background. Experimental results show that the proposed method successfully addresses the problems of unpaired image to image translation and achieves competitive metrics with existing methods.
引用
收藏
页码:137495 / 137505
页数:11
相关论文
共 50 条
  • [1] Unpaired image-to-image translation of structural damage
    Varghese, Subin
    Hoskere, Vedhus
    ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [2] CycleSAR: SAR Image Despeckling as Unpaired Image-to-Image Translation
    Lattari, Francesco
    Santomarco, Vincenzo
    Santambrogio, Riccardo
    Rucci, Alessio
    Matteucci, Matteo
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [3] Unpaired Image-to-Image Translation via Latent Energy Transport
    Zhao, Yang
    Chen, Changyou
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16413 - 16422
  • [4] Random Reconstructed Unpaired Image-to-Image Translation
    Zhang, Xiaoqin
    Fan, Chenxiang
    Xiao, Zhiheng
    Zhao, Li
    Chen, Huiling
    Chang, Xiaojun
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (03) : 3144 - 3154
  • [5] Asymmetric GAN for Unpaired Image-to-Image Translation
    Li, Yu
    Tang, Sheng
    Zhang, Rui
    Zhang, Yongdong
    Li, Jintao
    Yan, Shuicheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (12) : 5881 - 5896
  • [6] UNPAIRED IMAGE-TO-IMAGE TRANSLATION FROM SHARED DEEP SPACE
    Wu, Xuehui
    Shao, Jie
    Gao, Lianli
    Shen, Heng Tao
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2127 - 2131
  • [7] Implicit pairs for boosting unpaired image-to-image translation
    Ginger, Yiftach
    Danon, Dov
    Averbuch-Elor, Hadar
    Cohen-Or, Daniel
    VISUAL INFORMATICS, 2020, 4 (04): : 50 - 58
  • [8] Asynchronous Generative Adversarial Network for Asymmetric Unpaired Image-to-Image Translation
    Zheng, Ziqiang
    Bin, Yi
    Lv, Xiaoou
    Wu, Yang
    Yang, Yang
    Shen, Heng Tao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2474 - 2487
  • [9] Exploring Explicit Domain Supervision for Latent Space Disentanglement in Unpaired Image-to-Image Translation
    Lin, Jianxin
    Chen, Zhibo
    Xia, Yingce
    Liu, Sen
    Qin, Tao
    Luo, Jiebo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (04) : 1254 - 1266
  • [10] UMGAN: Underwater Image Enhancement Network for Unpaired Image-to-Image Translation
    Sun, Boyang
    Mei, Yupeng
    Yan, Ni
    Chen, Yingyi
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (02)