Unsupervised multi-domain image translation with domain representation learning

被引:1
|
作者
Liu, Huajun [1 ]
Chen, Lei [1 ]
Sui, Haigang [2 ]
Zhu, Qing [3 ]
Lei, Dian [1 ]
Liu, Shubo [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan, Peoples R China
[2] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan, Peoples R China
[3] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu, Sichuan, Peoples R China
关键词
Image-to-image translation; Multi-domain; Unsupervised; Attribute label;
D O I
10.1016/j.image.2021.116452
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent years have witnessed tremendous improvements in multi-domain image-to-image translation. However, previous methods require multi-generator models or one-generator model with labeled datasets, which will increase the training cost and limit their further applications. In this paper, we propose an unsupervised network that consists of one pair of generator and discriminator as well as n encoders to achieve multi-domain image translation. Our work aims to learn the mappings of n domains simultaneously and automatically using images without any attribute labels. Besides, a representation loss is proposed to extract a proper representation vector for each domain, which would improve the performance of multi-domain image translation. Experiments have shown that our proposed method can perform better than the state-of-the-art multi-domain methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [11] AMMUNIT: An Attention-Based Multimodal Multi-domain UNsupervised Image-to-Image Translation Framework
    Luo, Lei
    Hsu, William H.
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 358 - 370
  • [12] Multi-Domain Image-to-Image Translation with Cross-Granularity Contrastive Learning
    Fu, Huiyuan
    Liu, Jin
    Yu, Ting
    Wang, Xin
    Ma, Huadong
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (07)
  • [13] DMDIT: Diverse multi-domain image-to-image translation
    Shao, Mingwen
    Zhang, Youcai
    Liu, Huan
    Wang, Chao
    Li, Le
    Shao, Xun
    KNOWLEDGE-BASED SYSTEMS, 2021, 229
  • [14] Gated SwitchGAN for Multi-Domain Facial Image Translation
    Zhang, Xiaokang
    Zhu, Yuanlue
    Chen, Wenting
    Liu, Wenshuang
    Shen, Linlin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1990 - 2003
  • [15] WDSRL: Multi-Domain Neural Machine Translation With Word-Level Domain-Sensitive Representation Learning
    Man, Zhibo
    Huang, Zengcheng
    Zhang, Yujie
    Li, Yu
    Chen, Yuanmeng
    Chen, Yufeng
    Xu, Jinan
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 577 - 590
  • [16] A Domain Gap Aware Generative Adversarial Network for Multi-Domain Image Translation
    Xu, Wenju
    Wang, Guanghui
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 72 - 84
  • [17] Representation modeling learning with multi-domain decoupling for unsupervised skeleton-based action recognition
    He, Zhiquan
    Lv, Jiantu
    Fang, Shizhang
    NEUROCOMPUTING, 2024, 582
  • [18] Multi-Domain Image-to-Image Translation with Adaptive Inference Graph
    The-Phuc Nguyen
    Lathuiliere, Stephane
    Ricci, Elisa
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5368 - 5375
  • [19] Multi-cropping contrastive learning and domain consistency for unsupervised image-to-image translation
    Zhao, Chen
    Cai, Wei-Ling
    Yuan, Zheng
    Hu, Cheng-Wei
    IET IMAGE PROCESSING, 2025, 19 (01)
  • [20] A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation
    Liu, Alexander H.
    Liu, Yen-Cheng
    Yeh, Yu-Ying
    Wang, Yu-Chiang Frank
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31