Unpaired font family synthesis using conditional generative adversarial networks

被引:15
作者
Ul Hassan, Ammar [1 ]
Ahmed, Hammad [1 ]
Choi, Jaeyoung [1 ]
机构
[1] Soongsil Univ, Dept Comp Sci & Engn, Seoul, South Korea
关键词
Font generation; Generative adversarial networks; Style transfer; Unsupervised image-to-image translation; IMAGE SYNTHESIS;
D O I
10.1016/j.knosys.2021.107304
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic font image synthesis has been an extremely active topic in recent years. Various deep learning-based approaches have been proposed to tackle this font synthesis task by considering it as an image-to-image translation problem in a supervised setting. However, all such approaches mainly focus on one-to-one font mapping, i.e., synthesizing a single font style, making it difficult to handle more practical problems such as the font family synthesis, which is a one-to-many mapping problem. Moreover, this font family synthesis is more challenging because it is an unsupervised image-to-image translation problem, i.e., no paired dataset is available during training. To address this font family synthesis problem, we propose a method that utilizes a single generator to conditionally produce various font family styles to form a font family. To the best of our knowledge, our proposed method is the first to synthesize a font family (multiple font styles belonging to a font), instead of synthesizing a single font style. More specifically, our method is trained to learn a font family by conditioning on various styles, e.g., normal, bold, italic, bold-italic, etc. After training, given an unobserved single font style (normal style font as an input), our method can successfully synthesize the remaining styles (e.g., bold, italic, bold-italic, etc.) to complete the font family. Qualitative and quantitative experiments were conducted to demonstrate the effectiveness of our proposed method. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
[21]   Human Video Synthesis Using Generative Adversarial Networks [J].
Azeem, Abdullah ;
Riaz, Waqar ;
Siddique, Abubakar ;
Saifullah ;
Junaid, Tahir .
FIFTH INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2020, 11526
[22]   Content loss and conditional space relationship in conditional generative adversarial networks [J].
Eken, Enes .
TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2022, 30 (05) :1741-1757
[23]   Towards recovery of conditional vectors from conditional generative adversarial networks [J].
Ding, Sihao ;
Wallin, Andreas .
PATTERN RECOGNITION LETTERS, 2019, 122 :66-72
[24]   Face Sketch Synthesis using Conditional Adversarial Networks [J].
Philip, Chikontwe ;
Jong, Lee Hyo .
2017 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2017, :373-378
[25]   Conditional Generative Adversarial Networks for modelling fuel sprays [J].
Ates, Cihan ;
Karwan, Farhad ;
Okraschevski, Max ;
Koch, Rainer ;
Bauer, Hans-Joerg .
ENERGY AND AI, 2023, 12
[26]   Conditional Generative Adversarial Networks for Domain Transfer: A Survey [J].
Zhou, Guoqiang ;
Fan, Yi ;
Shi, Jiachen ;
Lu, Yuyuan ;
Shen, Jun .
APPLIED SCIENCES-BASEL, 2022, 12 (16)
[27]   Face Depth Estimation With Conditional Generative Adversarial Networks [J].
Arslan, Abdullah Taha ;
Seke, Erol .
IEEE ACCESS, 2019, 7 :23222-23231
[28]   Probabilistic simulation of electricity price scenarios using Conditional Generative Adversarial Networks [J].
Walter, Viktor ;
Wagner, Andreas .
ENERGY AND AI, 2024, 18
[29]   Rain Streak Removal for Single Images Using Conditional Generative Adversarial Networks [J].
Hettiarachchi, Prasad ;
Nawaratne, Rashmika ;
Alahakoon, Damminda ;
De Silva, Daswin ;
Chilamkurti, Naveen .
APPLIED SCIENCES-BASEL, 2021, 11 (05) :1-11
[30]   Probabilistic Multistep Time Series Forecasting Using Conditional Generative Adversarial Networks [J].
Zuniga, Gerardo ;
Acuna, Gonzalo .
2021 IEEE LATIN AMERICAN CONFERENCE ON COMPUTATIONAL INTELLIGENCE (LA-CCI), 2021,