Study on 2D Sprite*3.Generation Using the Impersonator Network

被引:0
作者
Choi, Yongjun [1 ]
Seo, Beomjoo [1 ]
Kang, Shinjin [1 ]
Choi, Jongin [2 ]
机构
[1] Hongik Univ, Sch Games Engn, 2639 Sejong Ro, Sejong, South Korea
[2] Seoul Womens Univ, Dept Digital Media, 621 Hwarangro, Seoul, South Korea
来源
KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS | 2023年 / 17卷 / 07期
基金
新加坡国家研究基金会;
关键词
Generative Adversarial Networks (GANs); 2D Sprite Animation; Deep; Learning; Game Development; Impersonator Model;
D O I
10.3837/tiis.2023.07.003
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study presents a method for capturing photographs of users as input and converting them into 2D character animation sprites using a generative adversarial network-based artificial intelligence network. Traditionally, 2D character animations have been created by manually creating an entire sequence of sprite images, which incurs high development costs. To address this issue, this study proposes a technique that combines motion videos and sample 2D images. In the 2D sprite generation process that uses the proposed technique, a sequence of images is extracted from real-life images captured by the user, and these are combined with character images from within the game. Our research aims to leverage cutting-edge deep learning-based image manipulation techniques, such as the GAN-based motion transfer network (impersonator) and background noise removal (U2-Net), to generate a sequence of animation sprites from a single image. The proposed technique enables the creation of diverse animations and motions just one image. By utilizing these advancements, we focus on enhancing productivity in the game and animation industry through improved efficiency and streamlined production processes. By employing state-of-the-art techniques, our research enables the generation of 2D sprite images with various motions, offering significant potential for boosting productivity and creativity in the industry.
引用
收藏
页码:1794 / 1806
页数:13
相关论文
共 38 条
  • [1] Deep Video-Based Performance Cloning
    Aberman, K.
    Shi, M.
    Liao, J.
    Liscbinski, D.
    Chen, B.
    Cohen-Or, D.
    [J]. COMPUTER GRAPHICS FORUM, 2019, 38 (02) : 219 - 233
  • [2] Synthesizing Images of Humans in Unseen Poses
    Balakrishnan, Guha
    Zhao, Amy
    Dalca, Adrian V.
    Durand, Fredo
    Guttag, John
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8340 - 8348
  • [3] Bern R., 2018, PROC EUROPEAN C COMP, P500
  • [4] Everybody Dance Now
    Chan, Caroline
    Ginosar, Shiry
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5932 - 5941
  • [5] A Variational U-Net for Conditional Appearance and Shape Generation
    Esser, Patrick
    Sutter, Ekaterina
    Ommer, Bjoern
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8857 - 8866
  • [6] Image Style Transfer Using Convolutional Neural Networks
    Gatys, Leon A.
    Ecker, Alexander S.
    Bethge, Matthias
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2414 - 2423
  • [7] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    [J]. COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144
  • [8] Game Sprite Generator Using a Multi Discriminator GAN
    Hong, Seungjin
    Kim, Sookyun
    Kang, Shinjin
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2019, 13 (08): : 4255 - 4269
  • [9] End-to-end Recovery of Human Shape and Pose
    Kanazawa, Angjoo
    Black, Michael J.
    Jacobs, David W.
    Malik, Jitendra
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7122 - 7131
  • [10] Kang S, 2020, IEEE CONF COMPU INTE, P628, DOI [10.1109/cog47356.2020.9231650, 10.1109/CoG47356.2020.9231650]