Realistic real-time processing of anime portraits based on generative adversarial networks

被引:3
|
作者
Zhu, Gaofeng [1 ]
Qu, Zhiguo [1 ]
Sun, Le [1 ]
Liu, Yuming [2 ]
Yang, Jianfeng [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing 210044, Peoples R China
[2] Guangzhou Univ, Sch Comp Sci & Cyber Engn, Guangzhou 510000, Peoples R China
关键词
Generative adversarial networks; Real-time; Image processing;
D O I
10.1007/s11554-024-01481-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, more and more brands use interesting anime characters to promote and increase brand awareness. However, real-time and interesting promotional materials are also one of the key factors to attract people, so real-time processing of anime characters has also become an effective way to enhance brand awareness. In recent years, with the rapid development of deep learning, image style conversion based on AI technology has become a much-attended artificial intelligence application, but it also suffers from the disadvantages of complex model structure, slow conversion speed, and inconspicuous identity features, which need to be improved. In view of this, this study proposes an anime portrait realization (ARF-GAN) algorithm based on generative adversarial network. This algorithm is based on the Pix2Pix architecture and also uses the U-net network structure with jump connections to connect the encoder's feature maps directly to the decoder, which in turn enables the network to reconstruct the output data in a better way and the network architecture is more lightweight.This algorithm is based on the Pix2Pix architecture and also uses the U-net network structure with jump connections to connect the encoder's feature maps directly to the decoder, which in turn enables the network to reconstruct the output data in a better way and the network architecture is more lightweight. It also introduces the CBAM module, which can enhance the model's expressive and generative capabilities without increasing the model's complexity, and improve the model's real-time image processing capability. In addition, this paper also compensates for the problem of image blurring brought by the original architecture by introducing the deblurring module. The experimental results on CartoonFaceAB, DanBooru show that the proposed ARF-GAN has a better generative effect for the task of realizing anime portraits. And comparing with different types of image generating models, it shows better accuracy and lower complexity by using several evaluation indexes such as PSNR and SSIM. This makes it more suitable for brand advertisement promotion, so it has good application value for improving brand awareness.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Uncouple Generative Adversarial Networks for Transferring Stylized Portraits to Realistic Faces
    Wang, Wenxiao
    Wong, Hon-Cheng
    Lo, Sio-Long
    Zhang, Guifang
    IEEE ACCESS, 2020, 8 : 213825 - 213839
  • [2] Exploring real-time super-resolution generative adversarial networks
    Hu, Xiaoyan
    Wang, Zechen
    Liu, Xiangjun
    Li, Xinran
    Cheng, Guang
    Gong, Jian
    INTERNATIONAL JOURNAL OF SENSOR NETWORKS, 2021, 36 (02) : 85 - 96
  • [3] Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks
    Li, Chuan
    Wand, Michael
    COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 702 - 716
  • [4] RTSRGAN: Real-Time Super-Resolution Generative Adversarial Networks
    Hu, Xiaoyan
    Liu, Xiangjun
    Wang, Zechen
    Li, Xinran
    Peng, Wenqiang
    Cheng, Guang
    2019 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2019, : 321 - 326
  • [5] Real-time segmentation of various insulators using generative adversarial networks
    Chang, Wenkai
    Yang, Guodong
    Yu, Junzhi
    Liang, Zize
    IET COMPUTER VISION, 2018, 12 (05) : 596 - 602
  • [6] The Research of Anime Character Portrait Generation Based on Optimized Generative Adversarial Networks
    Yi, Zhentong
    Wu, Gui
    Pan, Xueliang
    Tao, Jun
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 7361 - 7366
  • [7] Anime Image Style Transfer Algorithm Based on Improved Generative Adversarial Networks
    Li, Yunhong
    Zhu, Jingkun
    Liu, Xingrui
    Chen, Jinni
    Su, Xueping
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (04): : 117 - 123
  • [8] Using Generative Adversarial Networks for Conditional Creation of Anime Posters
    Sankalpa, Donthi
    Ramesh, Jayroop
    Zualkernan, Imran
    Proceedings of the 2022 IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology, IAICT 2022, 2022, : 197 - 203
  • [9] Generative Adversarial Shaders for Real-Time Realism Enhancement
    Salmi, A.
    Csefalvay, Sz
    Imber, J.
    COMPUTER GRAPHICS FORUM, 2023, 42 (08)
  • [10] Real-Time Location-to-Image Generative Adversarial Networks with Sparse Sensor Data
    Zhang, Duo
    Ye, Qisheng
    Wang, Di
    Liang, Weixiang
    Hu, Guanghui
    Yang, Zhi-Xin
    2023 29TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE, M2VIP 2023, 2023,