Enhanced Unpaired Image-to-Image Translation via Transformation in Saliency Domain

被引:0
|
作者
Shibasaki, Kei [1 ]
Ikehara, Masaaki [1 ]
机构
[1] Keio Univ, Fac Sci & Technol, Dept Elect & Informat Engn, Yokohama, Kanagawa 2238522, Japan
来源
IEEE ACCESS | 2023年 / 11卷
关键词
Computer vision; Generative adversarial networks; Saliency detection; deep learning; unpaired image to image translation; generative adversarial networks; saliency domain;
D O I
10.1109/ACCESS.2023.3338629
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unpaired image to image translation is the task of converting images in unpaired datasets. The primary goal of the task is to translate a source image into the image aligned with the target domain while keeping the fundamental content. Existing researches have introduced effective techniques to translate images with unpaired datasets, focusing on preserving the fundamental content. However, these techniques have limitations in dealing with significant shape changes and preserving backgrounds that should not be transformed. The proposed method attempts to address these problems by utilizing the saliency domain for translation and simultaneously learning the translation in the saliency domain as well as in the image domain. The saliency domain represents the shape and position of the main object. The explicit learning of transformations within the saliency domain improves network's ability to transform shapes while maintaining the background. Experimental results show that the proposed method successfully addresses the problems of unpaired image to image translation and achieves competitive metrics with existing methods.
引用
收藏
页码:137495 / 137505
页数:11
相关论文
共 50 条
  • [41] Continuous and Diverse Image-to-Image Translation via Signed Attribute Vectors
    Qi Mao
    Hung-Yu Tseng
    Hsin-Ying Lee
    Jia-Bin Huang
    Siwei Ma
    Ming-Hsuan Yang
    International Journal of Computer Vision, 2022, 130 : 517 - 549
  • [42] Image-to-Image Translation: Methods and Applications
    Pang, Yingxue
    Lin, Jianxin
    Qin, Tao
    Chen, Zhibo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3859 - 3881
  • [43] DeSmoke-LAP: improved unpaired image-to-image translation for desmoking in laparoscopic surgery
    Pan, Yirou
    Bano, Sophia
    Vasconcelos, Francisco
    Park, Hyun
    Jeong, Taikyeong Ted
    Stoyanov, Danail
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022,
  • [44] DeSmoke-LAP: improved unpaired image-to-image translation for desmoking in laparoscopic surgery
    Pan, Yirou
    Bano, Sophia
    Vasconcelos, Francisco
    Park, Hyun
    Jeong, Taikyeong Ted
    Stoyanov, Danail
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (05) : 885 - 893
  • [45] Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation
    Gao, Fei
    Xu, Xingxin
    Yu, Jun
    Shang, Meimei
    Li, Xiang
    Tao, Dacheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3487 - 3498
  • [46] Expanding the defect image dataset of composite material coating with enhanced image-to-image translation
    Tao, Xinrui
    Gao, Hanjun
    Yang, Kai
    Wu, Qiong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [47] Bridging the Camera Domain Gap With Image-to-Image Translation Improves Glaucoma Diagnosis
    He, Shuang
    Joseph, Sanil
    Bulloch, Gabriella
    Jiang, Feng
    Kasturibai, Hariharasubramanian
    Kim, Ramasamy
    Ravilla, Thulasiraj D.
    Wang, Yueye
    Shi, Danli
    He, Mingguang
    TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2023, 12 (12):
  • [48] Joint image-to-image translation with denoising using enhanced generative adversarial networks
    Yan, Lan
    Zheng, Wenbo
    Wang, Fei-Yue
    Gou, Chao
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 91
  • [49] Towards Fine-Grained Control over Latent Space for Unpaired Image-to-Image Translation
    Luo, Lei
    Hsu, William
    Wang, Shangxian
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT III, 2021, 12893 : 408 - 420
  • [50] Cross-Domain Car Detection Using Unsupervised Image-to-Image Translation: From Day to Night
    Arruda, Vinicius F.
    Paixao, Thiago M.
    Berriel, Rodrigo F.
    De Souza, Alberto F.
    Badue, Claudine
    Sebe, Nicu
    Oliveira-Santos, Thiago
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,