Unpaired font family synthesis using conditional generative adversarial networks

被引:15
作者
Ul Hassan, Ammar [1 ]
Ahmed, Hammad [1 ]
Choi, Jaeyoung [1 ]
机构
[1] Soongsil Univ, Dept Comp Sci & Engn, Seoul, South Korea
关键词
Font generation; Generative adversarial networks; Style transfer; Unsupervised image-to-image translation; IMAGE SYNTHESIS;
D O I
10.1016/j.knosys.2021.107304
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic font image synthesis has been an extremely active topic in recent years. Various deep learning-based approaches have been proposed to tackle this font synthesis task by considering it as an image-to-image translation problem in a supervised setting. However, all such approaches mainly focus on one-to-one font mapping, i.e., synthesizing a single font style, making it difficult to handle more practical problems such as the font family synthesis, which is a one-to-many mapping problem. Moreover, this font family synthesis is more challenging because it is an unsupervised image-to-image translation problem, i.e., no paired dataset is available during training. To address this font family synthesis problem, we propose a method that utilizes a single generator to conditionally produce various font family styles to form a font family. To the best of our knowledge, our proposed method is the first to synthesize a font family (multiple font styles belonging to a font), instead of synthesizing a single font style. More specifically, our method is trained to learn a font family by conditioning on various styles, e.g., normal, bold, italic, bold-italic, etc. After training, given an unobserved single font style (normal style font as an input), our method can successfully synthesize the remaining styles (e.g., bold, italic, bold-italic, etc.) to complete the font family. Qualitative and quantitative experiments were conducted to demonstrate the effectiveness of our proposed method. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
[31]   Advanced Pigmented Facial Skin Analysis Using Conditional Generative Adversarial Networks [J].
Tsai, An-Chao ;
Huang, Patrick Po-Han ;
Wu, Zhong-Chong ;
Wang, Jhing-Fa .
IEEE ACCESS, 2024, 12 :46646-46656
[32]   BCGAN: Facial Expression Synthesis by Bottleneck-Layered Conditional Generative Adversarial Networks [J].
Shin, Yeji ;
Bum, Junghyun ;
Son, Chang-Hwan ;
Choo, Hyunseung .
PROCEEDINGS OF THE 2021 15TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM 2021), 2021,
[33]   Unpaired image to image transformation via informative coupled generative adversarial networks [J].
Ge, Hongwei ;
Han, Yuxuan ;
Kang, Wenjing ;
Sun, Liang .
FRONTIERS OF COMPUTER SCIENCE, 2021, 15 (04)
[34]   Synthesis of Multimodal Cardiological Signals Using a Conditional Wasserstein Generative Adversarial Network [J].
Cretu, Ioana ;
Tindale, Alexander ;
Balachandran, Wamadeva ;
Abbod, Maysam ;
Khir, Ashraf William ;
Meng, Hongying .
IEEE ACCESS, 2024, 12 :133994-134007
[35]   Unpaired image to image transformation via informative coupled generative adversarial networks [J].
Hongwei Ge ;
Yuxuan Han ;
Wenjing Kang ;
Liang Sun .
Frontiers of Computer Science, 2021, 15
[36]   AttentionGAN: Unpaired Image-to-Image Translation Using Attention-Guided Generative Adversarial Networks [J].
Tang, Hao ;
Liu, Hong ;
Xu, Dan ;
Torr, Philip H. S. ;
Sebe, Nicu .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (04) :1972-1987
[37]   Realistic Data Synthesis Using Enhanced Generative Adversarial Networks [J].
Baowaly, Mrinal Kanti ;
Liu, Chao-Lin ;
Chen, Kuan-Ta .
2019 IEEE SECOND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND KNOWLEDGE ENGINEERING (AIKE), 2019, :289-292
[38]   Multivariate Time Series Synthesis Using Generative Adversarial Networks [J].
Leznik, Mark ;
Michalsky, Patrick ;
Willis, Peter ;
Schanzel, Benjamin ;
Ostberg, Per-Olov ;
Domaschka, Joerg .
PROCEEDINGS OF THE ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE '21), 2021, :43-50
[39]   Synthesis of Dependent Multichannel ECG using Generative Adversarial Networks [J].
Brophy, Eoin .
CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, :3229-3232
[40]   Multimodal MRI synthesis using unified generative adversarial networks [J].
Dai, Xianjin ;
Lei, Yang ;
Fu, Yabo ;
Curran, Walter J. ;
Liu, Tian ;
Mao, Hui ;
Yang, Xiaofeng .
MEDICAL PHYSICS, 2020, 47 (12) :6343-6354