MDT: UNSUPERVISED MULTI-DOMAIN IMAGE-TO-IMAGE TRANSLATOR BASED ON GENERATIVE ADVERSARIAL NETWORKS

被引:0
作者
Lin, Ye [1 ]
Fu, Keren [2 ]
Ling, Shenggui [1 ]
Cheng, Peng [3 ]
机构
[1] Sichuan Univ, Natl Key Lab Fundamental Sci Synthet Vis, Chengdu, Sichuan, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Chengdu, Sichuan, Peoples R China
[3] Sichuan Univ, Sch Aeronaut & Astronaut, Chengdu, Sichuan, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) | 2020年
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
image-to-image translation; style transfer; GANs; multi-domain; domain adaption;
D O I
10.1109/icip40778.2020.9190666
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
In recent years, many methods have been proposed to tackle unsupervised image-to-image translation. However, they mainly focus on two-domain scenarios. To address issues like large cost of training time and resources in translation across multiple (more than two) number of domains, we propose an unsupervised method based on generative adversarial networks. Our method has only one encoder for the consideration of efficiency, together with several domain-specified decoders to transform an image into multiple domains without needing an input domain label. In addition, we propose to employ two constraints namely reconstruction loss and identity loss to further improve the generation. We conduct experiments on two datasets. The results demonstrate the effectiveness and efficiency of our proposed method against state-of-the-art methods.
引用
收藏
页码:598 / 602
页数:5
相关论文
共 17 条
  • [1] ComboGAN: Unrestrained Scalability for Image Domain Translation
    Anoosheh, Asha
    Agustsson, Eirikur
    Timofte, Radu
    Van Gool, Luc
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 896 - 903
  • [2] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation
    Choi, Yunjey
    Choi, Minje
    Kim, Munyoung
    Ha, Jung-Woo
    Kim, Sunghun
    Choo, Jaegul
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8789 - 8797
  • [3] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [4] Goodfellow I.J., 2014, ADV NEUR IN, p1406.2661, DOI DOI 10.1145/3422622
  • [5] Multi-PIE
    Gross, Ralph
    Matthews, Iain
    Cohn, Jeffrey
    Kanade, Takeo
    Baker, Simon
    [J]. IMAGE AND VISION COMPUTING, 2010, 28 (05) : 807 - 813
  • [6] Hensel M, 2017, ADV NEUR IN, V30
  • [7] Hui L, 2018, INT C PATT RECOG, P2044, DOI 10.1109/ICPR.2018.8545169
  • [8] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [9] Kim T, 2017, PR MACH LEARN RES, V70
  • [10] Kingma D. P., 2015, P INT C LEARN REPR, V1, P1