MDT: UNSUPERVISED MULTI-DOMAIN IMAGE-TO-IMAGE TRANSLATOR BASED ON GENERATIVE ADVERSARIAL NETWORKS

被引:0
|
作者
Lin, Ye [1 ]
Fu, Keren [2 ]
Ling, Shenggui [1 ]
Cheng, Peng [3 ]
机构
[1] Sichuan Univ, Natl Key Lab Fundamental Sci Synthet Vis, Chengdu, Sichuan, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Chengdu, Sichuan, Peoples R China
[3] Sichuan Univ, Sch Aeronaut & Astronaut, Chengdu, Sichuan, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
image-to-image translation; style transfer; GANs; multi-domain; domain adaption;
D O I
10.1109/icip40778.2020.9190666
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
In recent years, many methods have been proposed to tackle unsupervised image-to-image translation. However, they mainly focus on two-domain scenarios. To address issues like large cost of training time and resources in translation across multiple (more than two) number of domains, we propose an unsupervised method based on generative adversarial networks. Our method has only one encoder for the consideration of efficiency, together with several domain-specified decoders to transform an image into multiple domains without needing an input domain label. In addition, we propose to employ two constraints namely reconstruction loss and identity loss to further improve the generation. We conduct experiments on two datasets. The results demonstrate the effectiveness and efficiency of our proposed method against state-of-the-art methods.
引用
收藏
页码:598 / 602
页数:5
相关论文
共 50 条
  • [1] Crossing-Domain Generative Adversarial Networks for Unsupervised Multi-Domain Image-to-Image Translation
    Yang, Xuewen
    Xie, Dongliang
    Wang, Xin
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 374 - 382
  • [2] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation
    Choi, Yunjey
    Choi, Minje
    Kim, Munyoung
    Ha, Jung-Woo
    Kim, Sunghun
    Choo, Jaegul
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8789 - 8797
  • [3] Dual Generator Generative Adversarial Networks for Multi-domain Image-to-Image Translation
    Tang, Hao
    Xu, Dan
    Wang, Wei
    Yan, Yan
    Sebe, Nicu
    COMPUTER VISION - ACCV 2018, PT I, 2019, 11361 : 3 - 21
  • [4] SemiStarGAN: Semi-supervised Generative Adversarial Networks for Multi-domain Image-to-Image Translation
    Hsu, Shu-Yu
    Yang, Chih-Yuan
    Huang, Chi-Chia
    Hsu, Jane Yung-jen
    COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 338 - 353
  • [5] Retrieval Guided Unsupervised Multi-domain Image-to-Image Translation
    Gomez, Raul
    Liu, Yahui
    De Nadai, Marco
    Karatzas, Dimosthenis
    Lepri, Bruno
    Sebe, Nicu
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 3164 - 3172
  • [6] Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
    Tang, Hao
    Xu, Dan
    Sebel, Nicu
    Yan, Yan
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [7] SoloGAN: Multi-domain Multimodal Unpaired Image-to-Image Translation via a Single Generative Adversarial Network
    Huang S.
    He C.
    Cheng R.
    IEEE Transactions on Artificial Intelligence, 2022, 3 (05): : 722 - 737
  • [8] MULTI-DOMAIN UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION WITH APPEARANCE ADAPTIVE CONVOLUTION
    Jeong, Somi
    Lee, Jiyoung
    Sohn, Kwanghoon
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1750 - 1754
  • [9] Fingerprinting Image-to-Image Generative Adversarial Networks
    Li, Guanlin
    Xu, Guowen
    Qiu, Han
    Guo, Shangwei
    Wang, Run
    Li, Jiwei
    Zhang, Tianwei
    Lu, Rongxing
    9TH EUROPEAN SYMPOSIUM ON SECURITY AND PRIVACY, EUROS&P 2024, 2024, : 41 - 61
  • [10] Multi-domain medical image translation generation for lung image classification based on generative adversarial networks
    Chen, Yunfeng
    Lin, Yalan
    Xu, Xiaodie
    Ding, Jinzhen
    Li, Chuzhao
    Zeng, Yiming
    Xie, Weifang
    Huang, Jianlong
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 229