Unpaired font family synthesis using conditional generative adversarial networks

被引:13
|
作者
Ul Hassan, Ammar [1 ]
Ahmed, Hammad [1 ]
Choi, Jaeyoung [1 ]
机构
[1] Soongsil Univ, Dept Comp Sci & Engn, Seoul, South Korea
关键词
Font generation; Generative adversarial networks; Style transfer; Unsupervised image-to-image translation; IMAGE SYNTHESIS;
D O I
10.1016/j.knosys.2021.107304
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic font image synthesis has been an extremely active topic in recent years. Various deep learning-based approaches have been proposed to tackle this font synthesis task by considering it as an image-to-image translation problem in a supervised setting. However, all such approaches mainly focus on one-to-one font mapping, i.e., synthesizing a single font style, making it difficult to handle more practical problems such as the font family synthesis, which is a one-to-many mapping problem. Moreover, this font family synthesis is more challenging because it is an unsupervised image-to-image translation problem, i.e., no paired dataset is available during training. To address this font family synthesis problem, we propose a method that utilizes a single generator to conditionally produce various font family styles to form a font family. To the best of our knowledge, our proposed method is the first to synthesize a font family (multiple font styles belonging to a font), instead of synthesizing a single font style. More specifically, our method is trained to learn a font family by conditioning on various styles, e.g., normal, bold, italic, bold-italic, etc. After training, given an unobserved single font style (normal style font as an input), our method can successfully synthesize the remaining styles (e.g., bold, italic, bold-italic, etc.) to complete the font family. Qualitative and quantitative experiments were conducted to demonstrate the effectiveness of our proposed method. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Enhanced dataset synthesis using conditional generative adversarial networks
    Mert, Ahmet
    BIOMEDICAL ENGINEERING LETTERS, 2023, 13 (01) : 41 - 48
  • [2] Enhanced dataset synthesis using conditional generative adversarial networks
    Ahmet Mert
    Biomedical Engineering Letters, 2023, 13 : 41 - 48
  • [3] Multimodal attention for lip synthesis using conditional generative adversarial networks
    Vidal, Andrea
    Busso, Carlos
    SPEECH COMMUNICATION, 2023, 153
  • [4] Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks
    Sohail, Muhammad
    Riaz, Muhammad Naveed
    Wu, Jing
    Long, Chengnian
    Li, Shaoyuan
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2019, 2019, 11827 : 22 - 31
  • [5] Hybrid Generative Adversarial Networks for Deep MR to CT Synthesis Using Unpaired Data
    Zeng, Guodong
    Zheng, Guoyan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT IV, 2019, 11767 : 759 - 767
  • [6] MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis
    Kumar, Kundan
    Kumar, Rithesh
    de Boissiere, Thibault
    Gestin, Lucas
    Teoh, Wei Zhen
    Sotelo, Jose
    de Brebisson, Alexandre
    Bengio, Yoshua
    Courville, Aaron
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [7] Text to Image Synthesis Using Stacked Conditional Variational Autoencoders and Conditional Generative Adversarial Networks
    Tibebu, Haileleol
    Malik, Aadin
    De Silva, Varuna
    INTELLIGENT COMPUTING, VOL 1, 2022, 506 : 560 - 580
  • [8] Conditional Independence Testing using Generative Adversarial Networks
    Bellot, Alexis
    van der Schaar, Mihaela
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [9] Ultrasonic imaging using conditional generative adversarial networks
    Molinier, Nathan
    Painchaud-April, Guillaume
    Le Duff, Alain
    Toews, Matthew
    Belanger, Pierre
    ULTRASONICS, 2023, 133
  • [10] Clustering Using Conditional Generative Adversarial Networks (cGANs)
    Ruzicka, Marek
    Dopiriak, Matus
    2023 33RD INTERNATIONAL CONFERENCE RADIOELEKTRONIKA, RADIOELEKTRONIKA, 2023,