Enhanced Unpaired Image-to-Image Translation via Transformation in Saliency Domain

被引:0
|
作者
Shibasaki, Kei [1 ]
Ikehara, Masaaki [1 ]
机构
[1] Keio Univ, Fac Sci & Technol, Dept Elect & Informat Engn, Yokohama, Kanagawa 2238522, Japan
来源
IEEE ACCESS | 2023年 / 11卷
关键词
Computer vision; Generative adversarial networks; Saliency detection; deep learning; unpaired image to image translation; generative adversarial networks; saliency domain;
D O I
10.1109/ACCESS.2023.3338629
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unpaired image to image translation is the task of converting images in unpaired datasets. The primary goal of the task is to translate a source image into the image aligned with the target domain while keeping the fundamental content. Existing researches have introduced effective techniques to translate images with unpaired datasets, focusing on preserving the fundamental content. However, these techniques have limitations in dealing with significant shape changes and preserving backgrounds that should not be transformed. The proposed method attempts to address these problems by utilizing the saliency domain for translation and simultaneously learning the translation in the saliency domain as well as in the image domain. The saliency domain represents the shape and position of the main object. The explicit learning of transformations within the saliency domain improves network's ability to transform shapes while maintaining the background. Experimental results show that the proposed method successfully addresses the problems of unpaired image to image translation and achieves competitive metrics with existing methods.
引用
收藏
页码:137495 / 137505
页数:11
相关论文
共 50 条
  • [31] Injecting-Diffusion: Inject Domain-Independent Contents into Diffusion Models for Unpaired Image-to-Image Translation
    Li, Luying
    Ma, Lizhuang
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 282 - 287
  • [32] Generative image completion with image-to-image translation
    Xu, Shuzhen
    Zhu, Qing
    Wang, Jin
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (11) : 7333 - 7345
  • [33] Generative image completion with image-to-image translation
    Shuzhen Xu
    Qing Zhu
    Jin Wang
    Neural Computing and Applications, 2020, 32 : 7333 - 7345
  • [34] Towards semantically continuous unpaired image-to-image translation via margin adaptive contrastive learning and wavelet transform
    Zhang, Heng
    Yang, Yi-Jun
    Zeng, Wei
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [35] Improving Surgical Training Phantoms by Hyperrealism: Deep Unpaired Image-to-Image Translation from Real Surgeries
    Engelhardt, Sandy
    De Simone, Raffaele
    Full, Peter M.
    Karck, Matthias
    Wolf, Ivo
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 : 747 - 755
  • [36] DeSmoke-LAP: improved unpaired image-to-image translation for desmoking in laparoscopic surgery
    Yirou Pan
    Sophia Bano
    Francisco Vasconcelos
    Hyun Park
    Taikyeong Ted. Jeong
    Danail Stoyanov
    International Journal of Computer Assisted Radiology and Surgery, 2022, 17 : 885 - 893
  • [37] Multi-head mutual-attention CycleGAN for unpaired image-to-image translation
    Ji, Wei
    Guo, Jing
    Li, Yun
    IET IMAGE PROCESSING, 2020, 14 (11) : 2395 - 2402
  • [38] Not every sample is efficient: Analogical generative adversarial network for unpaired image-to-image translation
    Zheng, Ziqiang
    Yang, Jie
    Yu, Zhibin
    Wang, Yubo
    Sun, Zhijian
    Zheng, Bing
    NEURAL NETWORKS, 2022, 148 : 166 - 175
  • [39] EM-LAST: Effective Multidimensional Latent Space Transport for an Unpaired Image-to-Image Translation With an Energy-Based Model
    Han, Giwoong
    Min, Jinhong
    Han, Sung Won
    IEEE ACCESS, 2022, 10 : 72839 - 72849
  • [40] Continuous and Diverse Image-to-Image Translation via Signed Attribute Vectors
    Mao, Qi
    Tseng, Hung-Yu
    Lee, Hsin-Ying
    Huang, Jia-Bin
    Ma, Siwei
    Yang, Ming-Hsuan
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (02) : 517 - 549