CLIP-FONT: SEMENTIC SELF-SUPERVISED FEW-SHOT FONT GENERATION WITH CLIP

被引:1
作者
Xiong, Jialu [1 ]
Wang, Yefei [2 ]
Zeng, Jinshan [2 ]
机构
[1] Jiangxi Normal Univ, Sch Digital Ind, Shangrao, Peoples R China
[2] Jiangxi Normal Univ, Sch Comp & Informat Engn, Nanchang, Jiangxi, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024 | 2024年
基金
中国国家自然科学基金;
关键词
Font generation; few-shot; self-supervision;
D O I
10.1109/ICASSP48485.2024.10447490
中图分类号
学科分类号
摘要
Font design is a very resource-intensive endeavor, especially for intricate fonts. The task of few-shot font generation (FFG) has attracted great interest recently. This method captures style from a limited set of reference glyphs and then transfers it to other characters to generate diverse style fonts. Existing FFG methods mainly revolve around learning font content or style. However, these methods often only learn content or style or lack the ability to represent style and content, resulting in poor font quality. To address these issues, we introduce CLIP-Font-a novel few-shot font generation model. CLIP-Font uses font text semantics for self-supervision to guide font generation at the content level, and uses attention-based contrast learning at the style level to capture the representation capabilities of the font fine-grained style enhancement model. Experimental results on various datasets demonstrate the effectiveness of our method, surpassing the performance of existing FFG techniques.
引用
收藏
页码:3620 / 3624
页数:5
相关论文
共 24 条
  • [1] Font transformer for few-shot font generation
    Chen, Xu
    Wu, Lei
    Su, Yongliang
    Meng, Lei
    Meng, Xiangxu
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 245
  • [2] Few-Shot Font Generation With Weakly Supervised Localized Representations
    Park, Song
    Chun, Sanghyuk
    Cha, Junbum
    Lee, Bado
    Shim, Hyunjung
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1479 - 1495
  • [3] MA-Font: Few-Shot Font Generation by Multi-Adaptation Method
    Qiu, Yanbo
    Chu, Kaibin
    Zhang, Ji
    Feng, Chengtao
    IEEE ACCESS, 2024, 12 : 60765 - 60781
  • [4] Few-Shot Font Generation by Learning Style Difference and Similarity
    He, Xiao
    Zhu, Mingrui
    Wang, Nannan
    Gao, Xinbo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (09) : 8013 - 8025
  • [5] Learning font-style space using style-guided discriminator for few-shot font generation
    Ul Hassan, Ammar
    Memon, Irfanullah
    Choi, Jaeyoung
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 242
  • [6] A Survey of Self-Supervised and Few-Shot Object Detection
    Huang, Gabriel
    Laradji, Issam
    Vazquez, David
    Lacoste-Julien, Simon
    Rodriguez, Pau
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4071 - 4089
  • [7] MLFont: Few-Shot Chinese Font Generation via Deep Meta-Learning
    Chen, Xu
    Wu, Lei
    He, Minggang
    Meng, Lei
    Meng, Xiangxu
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR '21), 2021, : 37 - 45
  • [8] HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution
    Li, Hua
    Lian, Zhouhui
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (06):
  • [9] JointFontGAN: Joint Geometry-Content GAN for Font Generation via Few-Shot Learning
    Xi, Yankun
    Yan, Guoli
    Hua, Jing
    Zhong, Zichun
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 4309 - 4317
  • [10] DEEP SELF-SUPERVISED LEARNING FOR FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION
    Li, Yu
    Zhang, Lei
    Wei, Wei
    Zhang, Yanning
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 501 - 504