Unpaired font family synthesis using conditional generative adversarial networks

被引:15
作者
Ul Hassan, Ammar [1 ]
Ahmed, Hammad [1 ]
Choi, Jaeyoung [1 ]
机构
[1] Soongsil Univ, Dept Comp Sci & Engn, Seoul, South Korea
关键词
Font generation; Generative adversarial networks; Style transfer; Unsupervised image-to-image translation; IMAGE SYNTHESIS;
D O I
10.1016/j.knosys.2021.107304
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic font image synthesis has been an extremely active topic in recent years. Various deep learning-based approaches have been proposed to tackle this font synthesis task by considering it as an image-to-image translation problem in a supervised setting. However, all such approaches mainly focus on one-to-one font mapping, i.e., synthesizing a single font style, making it difficult to handle more practical problems such as the font family synthesis, which is a one-to-many mapping problem. Moreover, this font family synthesis is more challenging because it is an unsupervised image-to-image translation problem, i.e., no paired dataset is available during training. To address this font family synthesis problem, we propose a method that utilizes a single generator to conditionally produce various font family styles to form a font family. To the best of our knowledge, our proposed method is the first to synthesize a font family (multiple font styles belonging to a font), instead of synthesizing a single font style. More specifically, our method is trained to learn a font family by conditioning on various styles, e.g., normal, bold, italic, bold-italic, etc. After training, given an unobserved single font style (normal style font as an input), our method can successfully synthesize the remaining styles (e.g., bold, italic, bold-italic, etc.) to complete the font family. Qualitative and quantitative experiments were conducted to demonstrate the effectiveness of our proposed method. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
[41]   A Survey of Image Synthesis and Editing with Generative Adversarial Networks [J].
Xian Wu ;
Kun Xu ;
Peter Hall .
TsinghuaScienceandTechnology, 2017, 22 (06) :660-674
[42]   A Survey of Image Synthesis and Editing with Generative Adversarial Networks [J].
Wu, Xian ;
Xu, Kun ;
Hall, Peter .
TSINGHUA SCIENCE AND TECHNOLOGY, 2017, 22 (06) :660-674
[43]   Dehaze of Cataractous Retinal Images Using an Unpaired Generative Adversarial Network [J].
Luo, Yuhao ;
Chen, Kun ;
Liu, Lei ;
Liu, Jicheng ;
Mao, Jianbo ;
Ke, Genjie ;
Sun, Mingzhai .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (12) :3374-3383
[44]   Crossfire Conditional Generative Adversarial Networks for Singing Voice Extraction [J].
Yuan, Weitao ;
Wang, Shengbei ;
Li, Xiangrui ;
Unoki, Masashi ;
Wang, Wenwu .
INTERSPEECH 2021, 2021, :3041-3045
[45]   Generative Adversarial Networks Based on Penalty of Conditional Entropy Distance [J].
Tan H.-W. ;
Wang G.-D. ;
Zhou L.-Y. ;
Zhang Z.-L. .
Zhang, Zi-Li (zhangzl@swu.edu.cn), 1600, Chinese Academy of Sciences (32) :1116-1128
[46]   Using Conditional Generative Adversarial Networks to Boost the Performance of Machine Learning in Microbiome Datasets [J].
Reiman, Derek ;
Dai, Yang .
PROCEEDINGS OF THE 1ST INTERNATIONAL CONFERENCE ON DEEP LEARNING THEORY AND APPLICATIONS (DELTA), 2020, :103-110
[47]   Colorization of Logo Sketch Based on Conditional Generative Adversarial Networks [J].
Tian, Nannan ;
Liu, Yuan ;
Wu, Bo ;
Li, Xiaofeng .
ELECTRONICS, 2021, 10 (04) :1-15
[48]   Unsupervised Video Summarization with Attentive Conditional Generative Adversarial Networks [J].
He, Xufeng ;
Hua, Yang ;
Song, Tao ;
Zhang, Zongpu ;
Xue, Zhengui ;
Ma, Ruhui ;
Robertson, Neil ;
Guan, Haibing .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :2296-2304
[49]   Speech enhancement through improvised conditional generative adversarial networks [J].
Ram, Saravana Ram ;
Kumar, Vinoth M. ;
Subramanian, Balambigai ;
Bacanin, Nebojsa ;
Zivkovic, Miodrag ;
Strumberger, Ivana .
MICROPROCESSORS AND MICROSYSTEMS, 2020, 79
[50]   Seismic Data Augmentation Based on Conditional Generative Adversarial Networks [J].
Li, Yuanming ;
Ku, Bonhwa ;
Zhang, Shou ;
Ahn, Jae-Kwang ;
Ko, Hanseok .
SENSORS, 2020, 20 (23) :1-13